[TensorRT] VERBOSE: Registered plugin creator - ::GridAnchor_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::GridAnchorRect_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::NMS_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::Reorg_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::Region_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::Clip_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::LReLU_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::PriorBox_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::Normalize_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::ScatterND version 1 [TensorRT] VERBOSE: Registered plugin creator - ::RPROI_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::BatchedNMS_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::BatchedNMSDynamic_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::FlattenConcat_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::CropAndResize version 1 [TensorRT] VERBOSE: Registered plugin creator - ::DetectionLayer_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::EfficientNMS_ONNX_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::EfficientNMS_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::Proposal version 1 [TensorRT] VERBOSE: Registered plugin creator - ::ProposalLayer_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::PyramidROIAlign_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::ResizeNearest_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::Split version 1 [TensorRT] VERBOSE: Registered plugin creator - ::SpecialSlice_TRT version 1 [TensorRT] VERBOSE: Registered plugin creator - ::InstanceNormalization_TRT version 1 [TensorRT] INFO: [MemUsageChange] Init CUDA: CPU +197, GPU +0, now: CPU 227, GPU 1196 (MiB) [TensorRT] VERBOSE: Plugin creator already registered - ::GridAnchor_TRT version 1 [TensorRT] VERBOSE: Plugin creator already registered - ::GridAnchorRect_TRT version 1 [TensorRT] VERBOSE: Plugin creator already registered - ::NMS_TRT version 1 [TensorRT] VERBOSE: Plugin creator already registered - ::Reorg_TRT version 1 [TensorRT] VERBOSE: Plugin creator already registered - ::Region_TRT version 1 [TensorRT] VERBOSE: Plugin creator already registered - ::Clip_TRT version 1 [TensorRT] VERBOSE: Plugin creator already registered - ::LReLU_TRT version 1 [TensorRT] VERBOSE: Plugin creator already registered - ::PriorBox_TRT version 1 [TensorRT] VERBOSE: Plugin creator already registered - ::Normalize_TRT version 1 [TensorRT] VERBOSE: Plugin creator already registered - ::ScatterND version 1 [TensorRT] VERBOSE: Plugin creator already registered - ::RPROI_TRT version 1 [TensorRT] VERBOSE: Plugin creator already registered - ::BatchedNMS_TRT version 1 [TensorRT] VERBOSE: Plugin creator already registered - ::BatchedNMSDynamic_TRT version 1 [TensorRT] VERBOSE: Plugin creator already registered - ::FlattenConcat_TRT version 1 [TensorRT] VERBOSE: Plugin creator already registered - ::CropAndResize version 1 [TensorRT] VERBOSE: Plugin creator already registered - ::DetectionLayer_TRT version 1 [TensorRT] VERBOSE: Plugin creator already registered - ::EfficientNMS_ONNX_TRT version 1 [TensorRT] VERBOSE: Plugin creator already registered - ::EfficientNMS_TRT version 1 [TensorRT] VERBOSE: Plugin creator already registered - ::Proposal version 1 [TensorRT] VERBOSE: Plugin creator already registered - ::ProposalLayer_TRT version 1 [TensorRT] VERBOSE: Plugin creator already registered - ::PyramidROIAlign_TRT version 1 [TensorRT] VERBOSE: Plugin creator already registered - ::ResizeNearest_TRT version 1 [TensorRT] VERBOSE: Plugin creator already registered - ::Split version 1 [TensorRT] VERBOSE: Plugin creator already registered - ::SpecialSlice_TRT version 1 [TensorRT] VERBOSE: Plugin creator already registered - ::InstanceNormalization_TRT version 1 [TensorRT] VERBOSE: Adding network input: input_tensor with dtype: float32, dimensions: (1, 320, 320, 3) [TensorRT] VERBOSE: Registering tensor: input_tensor for ONNX tensor: input_tensor [TensorRT] VERBOSE: Importing initializer: preprocessor/scale_value:0 [TensorRT] VERBOSE: Importing initializer: preprocessor/mean_value:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: const_fold_opt__2278 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_BN/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_BN/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_BN/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_BN/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_expand/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_expand/Conv2D_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_BN/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_BN/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_expand/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_expand/Conv2D_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_depthwise/depthwise_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_depthwise/depthwise_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_project/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_project/Conv2D_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_expand/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_expand/Conv2D_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/Conv2D/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_BN/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_BN/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_expand/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_expand/Conv2D_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_depthwise/depthwise_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_depthwise/depthwise_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_project/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_project/Conv2D_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_expand/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_expand/Conv2D_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_depthwise/depthwise_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_depthwise/depthwise_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_project/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_project/Conv2D_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_expand/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_expand/Conv2D_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_depthwise/depthwise_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_depthwise/depthwise_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_BN/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_BN/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_expand/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_expand/Conv2D_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_depthwise/depthwise_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_depthwise/depthwise_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_project/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_project/Conv2D_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_expand/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_expand/Conv2D_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/Conv2D/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_BN/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_BN/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_expand/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_expand/Conv2D_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_depthwise/depthwise_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_depthwise/depthwise_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_project/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_project/Conv2D_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_expand/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_expand/Conv2D_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_depthwise/depthwise_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_depthwise/depthwise_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D_bias_fused_bn [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1_bn/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1_bn/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/Conv2D/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape__1478:0 [TensorRT] WARNING: onnx2trt_utils.cpp:364: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32. [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_3/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_3/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_3/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_2/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_2/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_4/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_4/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_4/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_4/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_3/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_3/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_3/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_2/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_2/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_4/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_4/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_4/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_4/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_3/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_3/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_3/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_2/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_2/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_1/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_1/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_1/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_1/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_3/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_4/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape__1612:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_4/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_4/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_4/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_4/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_3/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_3/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_3/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_1/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_1/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_1/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_1/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4__1558:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2__1577:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_4/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_4/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_4/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_4/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_1/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_1/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_1/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_1/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_6__1442:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3__1461:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_1/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_1/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_1/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_1/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_0/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_0/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_0/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_0/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_9__1344:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_8__1343:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_0/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_0/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_0/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_0/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3__1693:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2__1692:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_0/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_0/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_0/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_0/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_0/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_0/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_0/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_0/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape__1809:0 [TensorRT] VERBOSE: Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1__1810:0 [TensorRT] VERBOSE: Importing initializer: WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/scale_value:0 [TensorRT] VERBOSE: Importing initializer: WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/slicer_value:0 [TensorRT] VERBOSE: Importing initializer: WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/slicer_value:1 [TensorRT] VERBOSE: Importing initializer: WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/slicer_value:2 [TensorRT] VERBOSE: Importing initializer: nms/anchors:0 [TensorRT] VERBOSE: Parsing node: preprocessor/transpose [Transpose] [TensorRT] VERBOSE: Searching for input: input_tensor [TensorRT] VERBOSE: preprocessor/transpose [Transpose] inputs: [input_tensor -> (1, 320, 320, 3)[FLOAT]], [TensorRT] VERBOSE: Registering layer: preprocessor/transpose for ONNX node: preprocessor/transpose [TensorRT] VERBOSE: Registering tensor: preprocessor/transpose:0_0 for ONNX tensor: preprocessor/transpose:0_0 [TensorRT] VERBOSE: preprocessor/transpose [Transpose] outputs: [preprocessor/transpose:0_0 -> (1, 3, 320, 320)[FLOAT]], [TensorRT] VERBOSE: Parsing node: preprocessor/scale [Mul] [TensorRT] VERBOSE: Searching for input: preprocessor/transpose:0_0 [TensorRT] VERBOSE: Searching for input: preprocessor/scale_value:0 [TensorRT] VERBOSE: preprocessor/scale [Mul] inputs: [preprocessor/transpose:0_0 -> (1, 3, 320, 320)[FLOAT]], [preprocessor/scale_value:0 -> (1, 1, 1, 1)[FLOAT]], [TensorRT] VERBOSE: Registering layer: preprocessor/scale_value:0 for ONNX node: preprocessor/scale_value:0 [TensorRT] VERBOSE: Registering layer: preprocessor/scale for ONNX node: preprocessor/scale [TensorRT] VERBOSE: Registering tensor: preprocessor/scale:0_1 for ONNX tensor: preprocessor/scale:0_1 [TensorRT] VERBOSE: preprocessor/scale [Mul] outputs: [preprocessor/scale:0_1 -> (1, 3, 320, 320)[FLOAT]], [TensorRT] VERBOSE: Parsing node: preprocessor/mean [Sub] [TensorRT] VERBOSE: Searching for input: preprocessor/scale:0_1 [TensorRT] VERBOSE: Searching for input: preprocessor/mean_value:0 [TensorRT] VERBOSE: preprocessor/mean [Sub] inputs: [preprocessor/scale:0_1 -> (1, 3, 320, 320)[FLOAT]], [preprocessor/mean_value:0 -> (1, 1, 1, 1)[FLOAT]], [TensorRT] VERBOSE: Registering layer: preprocessor/mean_value:0 for ONNX node: preprocessor/mean_value:0 [TensorRT] VERBOSE: Registering layer: preprocessor/mean for ONNX node: preprocessor/mean [TensorRT] VERBOSE: Registering tensor: preprocessor/mean:0_2 for ONNX tensor: preprocessor/mean:0_2 [TensorRT] VERBOSE: preprocessor/mean [Sub] outputs: [preprocessor/mean:0_2 -> (1, 3, 320, 320)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D [Conv] [TensorRT] VERBOSE: Searching for input: preprocessor/mean:0_2 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D [Conv] inputs: [preprocessor/mean:0_2 -> (1, 3, 320, 320)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D_weights_fused_bn -> (32, 3, 3, 3)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D_bias_fused_bn -> (32)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 3, 320, 320) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (2, 2), prepadding: (0, 0), postpadding: (1, 1), dilations: (1, 1), numOutputs: 32 [TensorRT] VERBOSE: Convolution output dimensions: (1, 32, 160, 160) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/bn_Conv1/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/bn_Conv1/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/bn_Conv1/FusedBatchNormV3:0 -> (1, 32, 160, 160)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/bn_Conv1/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/bn_Conv1/FusedBatchNormV3:0 -> (1, 32, 160, 160)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6:0 -> (1, 32, 160, 160)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6:0 -> (1, 32, 160, 160)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise_weights_fused_bn -> (32, 1, 3, 3)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise_bias_fused_bn -> (32)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 32, 160, 160) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 32 [TensorRT] VERBOSE: Convolution output dimensions: (1, 32, 160, 160) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_BN/FusedBatchNormV3:0 -> (1, 32, 160, 160)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_BN/FusedBatchNormV3:0 -> (1, 32, 160, 160)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6:0 -> (1, 32, 160, 160)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6:0 -> (1, 32, 160, 160)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D_weights_fused_bn -> (16, 32, 1, 1)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D_bias_fused_bn -> (16)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 32, 160, 160) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 16 [TensorRT] VERBOSE: Convolution output dimensions: (1, 16, 160, 160) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project_BN/FusedBatchNormV3:0 -> (1, 16, 160, 160)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project_BN/FusedBatchNormV3:0 -> (1, 16, 160, 160)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D/ReadVariableOp:0 -> (96, 16, 1, 1)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 16, 160, 160) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 96 [TensorRT] VERBOSE: Convolution output dimensions: (1, 96, 160, 160) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D:0 -> (1, 96, 160, 160)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 [BatchNormalization] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_BN/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_BN/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D:0 -> (1, 96, 160, 160)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_BN/ReadVariableOp:0 -> (96)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_BN/ReadVariableOp_1:0 -> (96)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3/ReadVariableOp:0 -> (96)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3/ReadVariableOp_1:0 -> (96)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3:0 -> (1, 96, 160, 160)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3:0 -> (1, 96, 160, 160)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6:0 -> (1, 96, 160, 160)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6:0 -> (1, 96, 160, 160)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise_weights_fused_bn -> (96, 1, 3, 3)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise_bias_fused_bn -> (96)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 96, 160, 160) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (2, 2), prepadding: (0, 0), postpadding: (1, 1), dilations: (1, 1), numOutputs: 96 [TensorRT] VERBOSE: Convolution output dimensions: (1, 96, 80, 80) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_BN/FusedBatchNormV3:0 -> (1, 96, 80, 80)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_BN/FusedBatchNormV3:0 -> (1, 96, 80, 80)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6:0 -> (1, 96, 80, 80)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6:0 -> (1, 96, 80, 80)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D_weights_fused_bn -> (24, 96, 1, 1)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D_bias_fused_bn -> (24)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 96, 80, 80) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 24 [TensorRT] VERBOSE: Convolution output dimensions: (1, 24, 80, 80) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project_BN/FusedBatchNormV3:0 -> (1, 24, 80, 80)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project_BN/FusedBatchNormV3:0 -> (1, 24, 80, 80)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D/ReadVariableOp:0 -> (144, 24, 1, 1)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 24, 80, 80) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 144 [TensorRT] VERBOSE: Convolution output dimensions: (1, 144, 80, 80) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D:0 -> (1, 144, 80, 80)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 [BatchNormalization] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_BN/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_BN/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D:0 -> (1, 144, 80, 80)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_BN/ReadVariableOp:0 -> (144)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_BN/ReadVariableOp_1:0 -> (144)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3/ReadVariableOp:0 -> (144)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3/ReadVariableOp_1:0 -> (144)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3:0 -> (1, 144, 80, 80)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3:0 -> (1, 144, 80, 80)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6:0 -> (1, 144, 80, 80)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6:0 -> (1, 144, 80, 80)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise_weights_fused_bn -> (144, 1, 3, 3)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise_bias_fused_bn -> (144)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 144, 80, 80) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 144 [TensorRT] VERBOSE: Convolution output dimensions: (1, 144, 80, 80) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_BN/FusedBatchNormV3:0 -> (1, 144, 80, 80)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_BN/FusedBatchNormV3:0 -> (1, 144, 80, 80)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6:0 -> (1, 144, 80, 80)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6:0 -> (1, 144, 80, 80)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D_weights_fused_bn -> (24, 144, 1, 1)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D_bias_fused_bn -> (24)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 144, 80, 80) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 24 [TensorRT] VERBOSE: Convolution output dimensions: (1, 24, 80, 80) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project_BN/FusedBatchNormV3:0 -> (1, 24, 80, 80)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add [Add] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add [Add] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project_BN/FusedBatchNormV3:0 -> (1, 24, 80, 80)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project_BN/FusedBatchNormV3:0 -> (1, 24, 80, 80)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add [Add] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add:0 -> (1, 24, 80, 80)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_expand/Conv2D [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_expand/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_expand/Conv2D_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_expand/Conv2D [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add:0 -> (1, 24, 80, 80)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_expand/Conv2D_weights_fused_bn -> (144, 24, 1, 1)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_expand/Conv2D_bias_fused_bn -> (144)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 24, 80, 80) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_expand/Conv2D for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_expand/Conv2D [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 144 [TensorRT] VERBOSE: Convolution output dimensions: (1, 144, 80, 80) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_expand_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_expand_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_expand/Conv2D [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_expand_BN/FusedBatchNormV3:0 -> (1, 144, 80, 80)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_expand_relu/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_expand_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_expand_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_expand_BN/FusedBatchNormV3:0 -> (1, 144, 80, 80)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_expand_relu/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_expand_relu/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_expand_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_expand_relu/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_expand_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_expand_relu/Relu6:0 -> (1, 144, 80, 80)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_expand_relu/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_expand_relu/Relu6:0 -> (1, 144, 80, 80)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise_weights_fused_bn -> (144, 1, 3, 3)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise_bias_fused_bn -> (144)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 144, 80, 80) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (2, 2), prepadding: (0, 0), postpadding: (1, 1), dilations: (1, 1), numOutputs: 144 [TensorRT] VERBOSE: Convolution output dimensions: (1, 144, 40, 40) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_BN/FusedBatchNormV3:0 -> (1, 144, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_BN/FusedBatchNormV3:0 -> (1, 144, 40, 40)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6:0 -> (1, 144, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6:0 -> (1, 144, 40, 40)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D_weights_fused_bn -> (32, 144, 1, 1)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D_bias_fused_bn -> (32)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 144, 40, 40) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 32 [TensorRT] VERBOSE: Convolution output dimensions: (1, 32, 40, 40) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project_BN/FusedBatchNormV3:0 -> (1, 32, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project_BN/FusedBatchNormV3:0 -> (1, 32, 40, 40)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D/ReadVariableOp:0 -> (192, 32, 1, 1)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 32, 40, 40) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 192 [TensorRT] VERBOSE: Convolution output dimensions: (1, 192, 40, 40) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D:0 -> (1, 192, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 [BatchNormalization] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_BN/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_BN/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D:0 -> (1, 192, 40, 40)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_BN/ReadVariableOp:0 -> (192)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_BN/ReadVariableOp_1:0 -> (192)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3/ReadVariableOp:0 -> (192)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3/ReadVariableOp_1:0 -> (192)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3:0 -> (1, 192, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3:0 -> (1, 192, 40, 40)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6:0 -> (1, 192, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6:0 -> (1, 192, 40, 40)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise_weights_fused_bn -> (192, 1, 3, 3)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise_bias_fused_bn -> (192)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 192, 40, 40) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 192 [TensorRT] VERBOSE: Convolution output dimensions: (1, 192, 40, 40) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_BN/FusedBatchNormV3:0 -> (1, 192, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_BN/FusedBatchNormV3:0 -> (1, 192, 40, 40)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6:0 -> (1, 192, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6:0 -> (1, 192, 40, 40)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D_weights_fused_bn -> (32, 192, 1, 1)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D_bias_fused_bn -> (32)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 192, 40, 40) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 32 [TensorRT] VERBOSE: Convolution output dimensions: (1, 32, 40, 40) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project_BN/FusedBatchNormV3:0 -> (1, 32, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add [Add] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add [Add] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project_BN/FusedBatchNormV3:0 -> (1, 32, 40, 40)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project_BN/FusedBatchNormV3:0 -> (1, 32, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add [Add] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add:0 -> (1, 32, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_expand/Conv2D [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_expand/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_expand/Conv2D_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_expand/Conv2D [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add:0 -> (1, 32, 40, 40)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_expand/Conv2D_weights_fused_bn -> (192, 32, 1, 1)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_expand/Conv2D_bias_fused_bn -> (192)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 32, 40, 40) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_expand/Conv2D for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_expand/Conv2D [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 192 [TensorRT] VERBOSE: Convolution output dimensions: (1, 192, 40, 40) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_expand_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_expand_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_expand/Conv2D [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_expand_BN/FusedBatchNormV3:0 -> (1, 192, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_expand_relu/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_expand_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_expand_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_expand_BN/FusedBatchNormV3:0 -> (1, 192, 40, 40)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_expand_relu/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_expand_relu/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_expand_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_expand_relu/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_expand_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_expand_relu/Relu6:0 -> (1, 192, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_depthwise/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_expand_relu/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_depthwise/depthwise_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_depthwise/depthwise_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_depthwise/depthwise [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_expand_relu/Relu6:0 -> (1, 192, 40, 40)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_depthwise/depthwise_weights_fused_bn -> (192, 1, 3, 3)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_depthwise/depthwise_bias_fused_bn -> (192)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 192, 40, 40) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_depthwise/depthwise for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_depthwise/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 192 [TensorRT] VERBOSE: Convolution output dimensions: (1, 192, 40, 40) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_depthwise_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_depthwise_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_depthwise/depthwise [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_depthwise_BN/FusedBatchNormV3:0 -> (1, 192, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_depthwise_relu/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_depthwise_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_depthwise_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_depthwise_BN/FusedBatchNormV3:0 -> (1, 192, 40, 40)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_depthwise_relu/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_depthwise_relu/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_depthwise_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_depthwise_relu/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_depthwise_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_depthwise_relu/Relu6:0 -> (1, 192, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_project/Conv2D [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_depthwise_relu/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_project/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_project/Conv2D_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_project/Conv2D [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_depthwise_relu/Relu6:0 -> (1, 192, 40, 40)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_project/Conv2D_weights_fused_bn -> (32, 192, 1, 1)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_project/Conv2D_bias_fused_bn -> (32)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 192, 40, 40) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_project/Conv2D for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_project/Conv2D [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 32 [TensorRT] VERBOSE: Convolution output dimensions: (1, 32, 40, 40) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_project_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_project/Conv2D [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_project_BN/FusedBatchNormV3:0 -> (1, 32, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_add/add [Add] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_add/add [Add] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add:0 -> (1, 32, 40, 40)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_project_BN/FusedBatchNormV3:0 -> (1, 32, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_add/add for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_add/add [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_add/add:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_add/add:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_add/add [Add] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_add/add:0 -> (1, 32, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_expand/Conv2D [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_add/add:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_expand/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_expand/Conv2D_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_expand/Conv2D [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_add/add:0 -> (1, 32, 40, 40)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_expand/Conv2D_weights_fused_bn -> (192, 32, 1, 1)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_expand/Conv2D_bias_fused_bn -> (192)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 32, 40, 40) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_expand/Conv2D for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_expand/Conv2D [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 192 [TensorRT] VERBOSE: Convolution output dimensions: (1, 192, 40, 40) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_expand_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_expand_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_expand/Conv2D [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_expand_BN/FusedBatchNormV3:0 -> (1, 192, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_add/add:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/Conv2D/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_add/add:0 -> (1, 32, 40, 40)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/Conv2D/ReadVariableOp:0 -> (128, 32, 1, 1)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd/ReadVariableOp:0 -> (128)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 32, 40, 40) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 40, 40) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd:0 -> (1, 128, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_expand_relu/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_expand_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_expand_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_expand_BN/FusedBatchNormV3:0 -> (1, 192, 40, 40)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_expand_relu/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_expand_relu/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_expand_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_expand_relu/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_expand_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_expand_relu/Relu6:0 -> (1, 192, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_expand_relu/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_expand_relu/Relu6:0 -> (1, 192, 40, 40)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise_weights_fused_bn -> (192, 1, 3, 3)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise_bias_fused_bn -> (192)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 192, 40, 40) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (2, 2), prepadding: (0, 0), postpadding: (1, 1), dilations: (1, 1), numOutputs: 192 [TensorRT] VERBOSE: Convolution output dimensions: (1, 192, 20, 20) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_BN/FusedBatchNormV3:0 -> (1, 192, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_BN/FusedBatchNormV3:0 -> (1, 192, 20, 20)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6:0 -> (1, 192, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6:0 -> (1, 192, 20, 20)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D_weights_fused_bn -> (64, 192, 1, 1)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D_bias_fused_bn -> (64)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 192, 20, 20) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64 [TensorRT] VERBOSE: Convolution output dimensions: (1, 64, 20, 20) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project_BN/FusedBatchNormV3:0 -> (1, 64, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project_BN/FusedBatchNormV3:0 -> (1, 64, 20, 20)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D/ReadVariableOp:0 -> (384, 64, 1, 1)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 64, 20, 20) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 384 [TensorRT] VERBOSE: Convolution output dimensions: (1, 384, 20, 20) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D:0 -> (1, 384, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 [BatchNormalization] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_BN/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_BN/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D:0 -> (1, 384, 20, 20)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_BN/ReadVariableOp:0 -> (384)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_BN/ReadVariableOp_1:0 -> (384)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3/ReadVariableOp:0 -> (384)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3/ReadVariableOp_1:0 -> (384)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3:0 -> (1, 384, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3:0 -> (1, 384, 20, 20)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6:0 -> (1, 384, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6:0 -> (1, 384, 20, 20)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise_weights_fused_bn -> (384, 1, 3, 3)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise_bias_fused_bn -> (384)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 384, 20, 20) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 384 [TensorRT] VERBOSE: Convolution output dimensions: (1, 384, 20, 20) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_BN/FusedBatchNormV3:0 -> (1, 384, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_BN/FusedBatchNormV3:0 -> (1, 384, 20, 20)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6:0 -> (1, 384, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6:0 -> (1, 384, 20, 20)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D_weights_fused_bn -> (64, 384, 1, 1)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D_bias_fused_bn -> (64)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 384, 20, 20) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64 [TensorRT] VERBOSE: Convolution output dimensions: (1, 64, 20, 20) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project_BN/FusedBatchNormV3:0 -> (1, 64, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add [Add] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add [Add] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project_BN/FusedBatchNormV3:0 -> (1, 64, 20, 20)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project_BN/FusedBatchNormV3:0 -> (1, 64, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add [Add] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add:0 -> (1, 64, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_expand/Conv2D [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_expand/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_expand/Conv2D_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_expand/Conv2D [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add:0 -> (1, 64, 20, 20)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_expand/Conv2D_weights_fused_bn -> (384, 64, 1, 1)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_expand/Conv2D_bias_fused_bn -> (384)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 64, 20, 20) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_expand/Conv2D for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_expand/Conv2D [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 384 [TensorRT] VERBOSE: Convolution output dimensions: (1, 384, 20, 20) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_expand_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_expand_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_expand/Conv2D [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_expand_BN/FusedBatchNormV3:0 -> (1, 384, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_expand_relu/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_expand_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_expand_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_expand_BN/FusedBatchNormV3:0 -> (1, 384, 20, 20)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_expand_relu/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_expand_relu/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_expand_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_expand_relu/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_expand_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_expand_relu/Relu6:0 -> (1, 384, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_depthwise/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_expand_relu/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_depthwise/depthwise_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_depthwise/depthwise_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_depthwise/depthwise [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_expand_relu/Relu6:0 -> (1, 384, 20, 20)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_depthwise/depthwise_weights_fused_bn -> (384, 1, 3, 3)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_depthwise/depthwise_bias_fused_bn -> (384)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 384, 20, 20) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_depthwise/depthwise for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_depthwise/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 384 [TensorRT] VERBOSE: Convolution output dimensions: (1, 384, 20, 20) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_depthwise_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_depthwise_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_depthwise/depthwise [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_depthwise_BN/FusedBatchNormV3:0 -> (1, 384, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_depthwise_relu/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_depthwise_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_depthwise_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_depthwise_BN/FusedBatchNormV3:0 -> (1, 384, 20, 20)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_depthwise_relu/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_depthwise_relu/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_depthwise_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_depthwise_relu/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_depthwise_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_depthwise_relu/Relu6:0 -> (1, 384, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_project/Conv2D [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_depthwise_relu/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_project/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_project/Conv2D_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_project/Conv2D [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_depthwise_relu/Relu6:0 -> (1, 384, 20, 20)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_project/Conv2D_weights_fused_bn -> (64, 384, 1, 1)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_project/Conv2D_bias_fused_bn -> (64)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 384, 20, 20) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_project/Conv2D for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_project/Conv2D [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64 [TensorRT] VERBOSE: Convolution output dimensions: (1, 64, 20, 20) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_project_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_project/Conv2D [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_project_BN/FusedBatchNormV3:0 -> (1, 64, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_add/add [Add] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_add/add [Add] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add:0 -> (1, 64, 20, 20)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_project_BN/FusedBatchNormV3:0 -> (1, 64, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_add/add for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_add/add [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_add/add:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_add/add:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_add/add [Add] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_add/add:0 -> (1, 64, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_expand/Conv2D [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_add/add:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_expand/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_expand/Conv2D_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_expand/Conv2D [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_add/add:0 -> (1, 64, 20, 20)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_expand/Conv2D_weights_fused_bn -> (384, 64, 1, 1)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_expand/Conv2D_bias_fused_bn -> (384)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 64, 20, 20) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_expand/Conv2D for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_expand/Conv2D [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 384 [TensorRT] VERBOSE: Convolution output dimensions: (1, 384, 20, 20) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_expand_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_expand_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_expand/Conv2D [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_expand_BN/FusedBatchNormV3:0 -> (1, 384, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_expand_relu/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_expand_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_expand_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_expand_BN/FusedBatchNormV3:0 -> (1, 384, 20, 20)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_expand_relu/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_expand_relu/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_expand_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_expand_relu/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_expand_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_expand_relu/Relu6:0 -> (1, 384, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_depthwise/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_expand_relu/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_depthwise/depthwise_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_depthwise/depthwise_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_depthwise/depthwise [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_expand_relu/Relu6:0 -> (1, 384, 20, 20)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_depthwise/depthwise_weights_fused_bn -> (384, 1, 3, 3)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_depthwise/depthwise_bias_fused_bn -> (384)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 384, 20, 20) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_depthwise/depthwise for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_depthwise/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 384 [TensorRT] VERBOSE: Convolution output dimensions: (1, 384, 20, 20) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_depthwise_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_depthwise_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_depthwise/depthwise [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_depthwise_BN/FusedBatchNormV3:0 -> (1, 384, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_depthwise_relu/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_depthwise_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_depthwise_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_depthwise_BN/FusedBatchNormV3:0 -> (1, 384, 20, 20)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_depthwise_relu/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_depthwise_relu/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_depthwise_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_depthwise_relu/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_depthwise_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_depthwise_relu/Relu6:0 -> (1, 384, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_project/Conv2D [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_depthwise_relu/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_project/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_project/Conv2D_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_project/Conv2D [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_depthwise_relu/Relu6:0 -> (1, 384, 20, 20)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_project/Conv2D_weights_fused_bn -> (64, 384, 1, 1)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_project/Conv2D_bias_fused_bn -> (64)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 384, 20, 20) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_project/Conv2D for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_project/Conv2D [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64 [TensorRT] VERBOSE: Convolution output dimensions: (1, 64, 20, 20) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_project_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_project/Conv2D [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_project_BN/FusedBatchNormV3:0 -> (1, 64, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_add/add [Add] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_add/add:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_add/add [Add] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_add/add:0 -> (1, 64, 20, 20)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_project_BN/FusedBatchNormV3:0 -> (1, 64, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_add/add for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_add/add [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_add/add:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_add/add:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_add/add [Add] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_add/add:0 -> (1, 64, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_expand/Conv2D [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_add/add:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_expand/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_expand/Conv2D_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_expand/Conv2D [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_add/add:0 -> (1, 64, 20, 20)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_expand/Conv2D_weights_fused_bn -> (384, 64, 1, 1)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_expand/Conv2D_bias_fused_bn -> (384)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 64, 20, 20) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_expand/Conv2D for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_expand/Conv2D [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 384 [TensorRT] VERBOSE: Convolution output dimensions: (1, 384, 20, 20) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_expand_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_expand_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_expand/Conv2D [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_expand_BN/FusedBatchNormV3:0 -> (1, 384, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_expand_relu/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_expand_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_expand_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_expand_BN/FusedBatchNormV3:0 -> (1, 384, 20, 20)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_expand_relu/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_expand_relu/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_expand_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_expand_relu/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_expand_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_expand_relu/Relu6:0 -> (1, 384, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_depthwise/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_expand_relu/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_depthwise/depthwise_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_depthwise/depthwise_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_depthwise/depthwise [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_expand_relu/Relu6:0 -> (1, 384, 20, 20)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_depthwise/depthwise_weights_fused_bn -> (384, 1, 3, 3)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_depthwise/depthwise_bias_fused_bn -> (384)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 384, 20, 20) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_depthwise/depthwise for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_depthwise/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 384 [TensorRT] VERBOSE: Convolution output dimensions: (1, 384, 20, 20) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_depthwise_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_depthwise_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_depthwise/depthwise [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_depthwise_BN/FusedBatchNormV3:0 -> (1, 384, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_depthwise_relu/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_depthwise_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_depthwise_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_depthwise_BN/FusedBatchNormV3:0 -> (1, 384, 20, 20)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_depthwise_relu/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_depthwise_relu/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_depthwise_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_depthwise_relu/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_depthwise_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_depthwise_relu/Relu6:0 -> (1, 384, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_depthwise_relu/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_depthwise_relu/Relu6:0 -> (1, 384, 20, 20)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D_weights_fused_bn -> (96, 384, 1, 1)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D_bias_fused_bn -> (96)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 384, 20, 20) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 96 [TensorRT] VERBOSE: Convolution output dimensions: (1, 96, 20, 20) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project_BN/FusedBatchNormV3:0 -> (1, 96, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project_BN/FusedBatchNormV3:0 -> (1, 96, 20, 20)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D/ReadVariableOp:0 -> (576, 96, 1, 1)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 96, 20, 20) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 576 [TensorRT] VERBOSE: Convolution output dimensions: (1, 576, 20, 20) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D:0 -> (1, 576, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 [BatchNormalization] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_BN/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_BN/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D:0 -> (1, 576, 20, 20)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_BN/ReadVariableOp:0 -> (576)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_BN/ReadVariableOp_1:0 -> (576)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3/ReadVariableOp:0 -> (576)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3/ReadVariableOp_1:0 -> (576)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3:0 -> (1, 576, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3:0 -> (1, 576, 20, 20)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6:0 -> (1, 576, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6:0 -> (1, 576, 20, 20)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise_weights_fused_bn -> (576, 1, 3, 3)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise_bias_fused_bn -> (576)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 576, 20, 20) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 576 [TensorRT] VERBOSE: Convolution output dimensions: (1, 576, 20, 20) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_BN/FusedBatchNormV3:0 -> (1, 576, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_BN/FusedBatchNormV3:0 -> (1, 576, 20, 20)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6:0 -> (1, 576, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6:0 -> (1, 576, 20, 20)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D_weights_fused_bn -> (96, 576, 1, 1)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D_bias_fused_bn -> (96)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 576, 20, 20) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 96 [TensorRT] VERBOSE: Convolution output dimensions: (1, 96, 20, 20) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project_BN/FusedBatchNormV3:0 -> (1, 96, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add [Add] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add [Add] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project_BN/FusedBatchNormV3:0 -> (1, 96, 20, 20)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project_BN/FusedBatchNormV3:0 -> (1, 96, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add [Add] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add:0 -> (1, 96, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_expand/Conv2D [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_expand/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_expand/Conv2D_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_expand/Conv2D [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add:0 -> (1, 96, 20, 20)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_expand/Conv2D_weights_fused_bn -> (576, 96, 1, 1)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_expand/Conv2D_bias_fused_bn -> (576)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 96, 20, 20) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_expand/Conv2D for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_expand/Conv2D [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 576 [TensorRT] VERBOSE: Convolution output dimensions: (1, 576, 20, 20) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_expand_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_expand_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_expand/Conv2D [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_expand_BN/FusedBatchNormV3:0 -> (1, 576, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_expand_relu/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_expand_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_expand_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_expand_BN/FusedBatchNormV3:0 -> (1, 576, 20, 20)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_expand_relu/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_expand_relu/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_expand_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_expand_relu/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_expand_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_expand_relu/Relu6:0 -> (1, 576, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_depthwise/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_expand_relu/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_depthwise/depthwise_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_depthwise/depthwise_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_depthwise/depthwise [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_expand_relu/Relu6:0 -> (1, 576, 20, 20)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_depthwise/depthwise_weights_fused_bn -> (576, 1, 3, 3)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_depthwise/depthwise_bias_fused_bn -> (576)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 576, 20, 20) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_depthwise/depthwise for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_depthwise/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 576 [TensorRT] VERBOSE: Convolution output dimensions: (1, 576, 20, 20) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_depthwise_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_depthwise_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_depthwise/depthwise [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_depthwise_BN/FusedBatchNormV3:0 -> (1, 576, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_depthwise_relu/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_depthwise_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_depthwise_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_depthwise_BN/FusedBatchNormV3:0 -> (1, 576, 20, 20)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_depthwise_relu/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_depthwise_relu/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_depthwise_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_depthwise_relu/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_depthwise_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_depthwise_relu/Relu6:0 -> (1, 576, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_project/Conv2D [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_depthwise_relu/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_project/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_project/Conv2D_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_project/Conv2D [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_depthwise_relu/Relu6:0 -> (1, 576, 20, 20)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_project/Conv2D_weights_fused_bn -> (96, 576, 1, 1)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_project/Conv2D_bias_fused_bn -> (96)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 576, 20, 20) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_project/Conv2D for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_project/Conv2D [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 96 [TensorRT] VERBOSE: Convolution output dimensions: (1, 96, 20, 20) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_project_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_project/Conv2D [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_project_BN/FusedBatchNormV3:0 -> (1, 96, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_add/add [Add] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_add/add [Add] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add:0 -> (1, 96, 20, 20)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_project_BN/FusedBatchNormV3:0 -> (1, 96, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_add/add for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_add/add [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_add/add:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_add/add:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_add/add [Add] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_add/add:0 -> (1, 96, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_expand/Conv2D [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_add/add:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_expand/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_expand/Conv2D_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_expand/Conv2D [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_add/add:0 -> (1, 96, 20, 20)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_expand/Conv2D_weights_fused_bn -> (576, 96, 1, 1)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_expand/Conv2D_bias_fused_bn -> (576)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 96, 20, 20) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_expand/Conv2D for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_expand/Conv2D [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 576 [TensorRT] VERBOSE: Convolution output dimensions: (1, 576, 20, 20) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_expand_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_expand_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_expand/Conv2D [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_expand_BN/FusedBatchNormV3:0 -> (1, 576, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_add/add:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/Conv2D/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_add/add:0 -> (1, 96, 20, 20)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/Conv2D/ReadVariableOp:0 -> (128, 96, 1, 1)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd/ReadVariableOp:0 -> (128)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 96, 20, 20) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 20, 20) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd:0 -> (1, 128, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_expand_relu/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_expand_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_expand_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_expand_BN/FusedBatchNormV3:0 -> (1, 576, 20, 20)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_expand_relu/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_expand_relu/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_expand_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_expand_relu/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_expand_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_expand_relu/Relu6:0 -> (1, 576, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_expand_relu/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_expand_relu/Relu6:0 -> (1, 576, 20, 20)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise_weights_fused_bn -> (576, 1, 3, 3)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise_bias_fused_bn -> (576)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 576, 20, 20) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (2, 2), prepadding: (0, 0), postpadding: (1, 1), dilations: (1, 1), numOutputs: 576 [TensorRT] VERBOSE: Convolution output dimensions: (1, 576, 10, 10) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_BN/FusedBatchNormV3:0 -> (1, 576, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_BN/FusedBatchNormV3:0 -> (1, 576, 10, 10)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6:0 -> (1, 576, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6:0 -> (1, 576, 10, 10)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D_weights_fused_bn -> (160, 576, 1, 1)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D_bias_fused_bn -> (160)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 576, 10, 10) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 160 [TensorRT] VERBOSE: Convolution output dimensions: (1, 160, 10, 10) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project_BN/FusedBatchNormV3:0 -> (1, 160, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project_BN/FusedBatchNormV3:0 -> (1, 160, 10, 10)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D/ReadVariableOp:0 -> (960, 160, 1, 1)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 160, 10, 10) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 960 [TensorRT] VERBOSE: Convolution output dimensions: (1, 960, 10, 10) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D:0 -> (1, 960, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 [BatchNormalization] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_BN/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_BN/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D:0 -> (1, 960, 10, 10)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_BN/ReadVariableOp:0 -> (960)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_BN/ReadVariableOp_1:0 -> (960)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3/ReadVariableOp:0 -> (960)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3/ReadVariableOp_1:0 -> (960)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3:0 -> (1, 960, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3:0 -> (1, 960, 10, 10)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6:0 -> (1, 960, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6:0 -> (1, 960, 10, 10)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise_weights_fused_bn -> (960, 1, 3, 3)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise_bias_fused_bn -> (960)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 960, 10, 10) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 960 [TensorRT] VERBOSE: Convolution output dimensions: (1, 960, 10, 10) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_BN/FusedBatchNormV3:0 -> (1, 960, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_BN/FusedBatchNormV3:0 -> (1, 960, 10, 10)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6:0 -> (1, 960, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6:0 -> (1, 960, 10, 10)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D_weights_fused_bn -> (160, 960, 1, 1)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D_bias_fused_bn -> (160)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 960, 10, 10) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 160 [TensorRT] VERBOSE: Convolution output dimensions: (1, 160, 10, 10) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project_BN/FusedBatchNormV3:0 -> (1, 160, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add [Add] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add [Add] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project_BN/FusedBatchNormV3:0 -> (1, 160, 10, 10)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project_BN/FusedBatchNormV3:0 -> (1, 160, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add [Add] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add:0 -> (1, 160, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_expand/Conv2D [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_expand/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_expand/Conv2D_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_expand/Conv2D [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add:0 -> (1, 160, 10, 10)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_expand/Conv2D_weights_fused_bn -> (960, 160, 1, 1)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_expand/Conv2D_bias_fused_bn -> (960)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 160, 10, 10) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_expand/Conv2D for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_expand/Conv2D [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 960 [TensorRT] VERBOSE: Convolution output dimensions: (1, 960, 10, 10) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_expand_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_expand_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_expand/Conv2D [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_expand_BN/FusedBatchNormV3:0 -> (1, 960, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_expand_relu/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_expand_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_expand_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_expand_BN/FusedBatchNormV3:0 -> (1, 960, 10, 10)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_expand_relu/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_expand_relu/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_expand_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_expand_relu/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_expand_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_expand_relu/Relu6:0 -> (1, 960, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_depthwise/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_expand_relu/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_depthwise/depthwise_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_depthwise/depthwise_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_depthwise/depthwise [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_expand_relu/Relu6:0 -> (1, 960, 10, 10)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_depthwise/depthwise_weights_fused_bn -> (960, 1, 3, 3)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_depthwise/depthwise_bias_fused_bn -> (960)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 960, 10, 10) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_depthwise/depthwise for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_depthwise/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 960 [TensorRT] VERBOSE: Convolution output dimensions: (1, 960, 10, 10) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_depthwise_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_depthwise_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_depthwise/depthwise [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_depthwise_BN/FusedBatchNormV3:0 -> (1, 960, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_depthwise_relu/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_depthwise_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_depthwise_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_depthwise_BN/FusedBatchNormV3:0 -> (1, 960, 10, 10)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_depthwise_relu/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_depthwise_relu/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_depthwise_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_depthwise_relu/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_depthwise_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_depthwise_relu/Relu6:0 -> (1, 960, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_project/Conv2D [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_depthwise_relu/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_project/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_project/Conv2D_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_project/Conv2D [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_depthwise_relu/Relu6:0 -> (1, 960, 10, 10)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_project/Conv2D_weights_fused_bn -> (160, 960, 1, 1)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_project/Conv2D_bias_fused_bn -> (160)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 960, 10, 10) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_project/Conv2D for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_project/Conv2D [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 160 [TensorRT] VERBOSE: Convolution output dimensions: (1, 160, 10, 10) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_project_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_project/Conv2D [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_project_BN/FusedBatchNormV3:0 -> (1, 160, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_add/add [Add] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_add/add [Add] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add:0 -> (1, 160, 10, 10)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_project_BN/FusedBatchNormV3:0 -> (1, 160, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_add/add for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_add/add [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_add/add:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_add/add:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_add/add [Add] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_add/add:0 -> (1, 160, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_expand/Conv2D [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_add/add:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_expand/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_expand/Conv2D_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_expand/Conv2D [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_add/add:0 -> (1, 160, 10, 10)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_expand/Conv2D_weights_fused_bn -> (960, 160, 1, 1)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_expand/Conv2D_bias_fused_bn -> (960)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 160, 10, 10) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_expand/Conv2D for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_expand/Conv2D [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 960 [TensorRT] VERBOSE: Convolution output dimensions: (1, 960, 10, 10) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_expand_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_expand_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_expand/Conv2D [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_expand_BN/FusedBatchNormV3:0 -> (1, 960, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_expand_relu/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_expand_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_expand_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_expand_BN/FusedBatchNormV3:0 -> (1, 960, 10, 10)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_expand_relu/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_expand_relu/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_expand_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_expand_relu/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_expand_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_expand_relu/Relu6:0 -> (1, 960, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_depthwise/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_expand_relu/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_depthwise/depthwise_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_depthwise/depthwise_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_depthwise/depthwise [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_expand_relu/Relu6:0 -> (1, 960, 10, 10)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_depthwise/depthwise_weights_fused_bn -> (960, 1, 3, 3)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_depthwise/depthwise_bias_fused_bn -> (960)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 960, 10, 10) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_depthwise/depthwise for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_depthwise/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 960 [TensorRT] VERBOSE: Convolution output dimensions: (1, 960, 10, 10) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_depthwise_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_depthwise_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_depthwise/depthwise [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_depthwise_BN/FusedBatchNormV3:0 -> (1, 960, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_depthwise_relu/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_depthwise_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_depthwise_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_depthwise_BN/FusedBatchNormV3:0 -> (1, 960, 10, 10)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_depthwise_relu/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_depthwise_relu/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_depthwise_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_depthwise_relu/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_depthwise_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_depthwise_relu/Relu6:0 -> (1, 960, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_depthwise_relu/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D_weights_fused_bn [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D_bias_fused_bn [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_depthwise_relu/Relu6:0 -> (1, 960, 10, 10)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D_weights_fused_bn -> (320, 960, 1, 1)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D_bias_fused_bn -> (320)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 960, 10, 10) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 320 [TensorRT] VERBOSE: Convolution output dimensions: (1, 320, 10, 10) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project_BN/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project_BN/FusedBatchNormV3:0 -> (1, 320, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project_BN/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project_BN/FusedBatchNormV3:0 -> (1, 320, 10, 10)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D/ReadVariableOp:0 -> (1280, 320, 1, 1)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 320, 10, 10) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1280 [TensorRT] VERBOSE: Convolution output dimensions: (1, 1280, 10, 10) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D:0 -> (1, 1280, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 [BatchNormalization] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1_bn/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1_bn/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D:0 -> (1, 1280, 10, 10)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1_bn/ReadVariableOp:0 -> (1280)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1_bn/ReadVariableOp_1:0 -> (1280)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3/ReadVariableOp:0 -> (1280)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3/ReadVariableOp_1:0 -> (1280)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3:0 -> (1, 1280, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3:0 -> (1, 1280, 10, 10)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6:0 -> (1, 1280, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/Conv2D/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6:0 -> (1, 1280, 10, 10)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/Conv2D/ReadVariableOp:0 -> (128, 1280, 1, 1)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd/ReadVariableOp:0 -> (128)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 1280, 10, 10) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 10, 10) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd:0 -> (1, 128, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: Transpose__1965 [Transpose] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd:0 [TensorRT] VERBOSE: Transpose__1965 [Transpose] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd:0 -> (1, 128, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Registering layer: Transpose__1965 for ONNX node: Transpose__1965 [TensorRT] VERBOSE: Registering tensor: Transpose__1965:0 for ONNX tensor: Transpose__1965:0 [TensorRT] VERBOSE: Transpose__1965 [Transpose] outputs: [Transpose__1965:0 -> (1, 10, 10, 128)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd:0 -> (1, 128, 10, 10)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/ReadVariableOp:0 -> (128, 1, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 10, 10) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (2, 2), prepadding: (0, 0), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 5, 5) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise:0 -> (1, 128, 5, 5)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd:0 -> (1, 128, 10, 10)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/ReadVariableOp:0 -> (128, 1, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 10, 10) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 10, 10) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise:0 -> (1, 128, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463 [Unsqueeze] [TensorRT] VERBOSE: Searching for input: Transpose__1965:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463 [Unsqueeze] inputs: [Transpose__1965:0 -> (1, 10, 10, 128)[FLOAT]], [TensorRT] VERBOSE: Original shape: (1, 10, 10, 128), unsqueezing to: (1, 10, 10, 1, 128) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463 [Unsqueeze] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 -> (1, 10, 10, 1, 128)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise:0 -> (1, 128, 5, 5)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/ReadVariableOp_1:0 -> (128, 128, 1, 1)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 5, 5) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 5, 5) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d:0 -> (1, 128, 5, 5)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise:0 -> (1, 128, 10, 10)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/ReadVariableOp_1:0 -> (128, 128, 1, 1)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 10, 10) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 10, 10) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2:0 -> (1, 128, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Concat__1464 [Concat] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Concat__1464 [Concat] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 -> (1, 10, 10, 1, 128)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 -> (1, 10, 10, 1, 128)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Concat__1464 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Concat__1464 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Concat__1464:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Concat__1464:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Concat__1464 [Concat] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Concat__1464:0 -> (1, 10, 10, 2, 128)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 [BatchNormalization] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d:0 -> (1, 128, 5, 5)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/ReadVariableOp_1:0 -> (128)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3/ReadVariableOp_1:0 -> (128)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3:0 -> (1, 128, 5, 5)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 [BatchNormalization] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2:0 -> (1, 128, 10, 10)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/ReadVariableOp_1:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp_1:0 -> (128)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3:0 -> (1, 128, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465 [Unsqueeze] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Concat__1464:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465 [Unsqueeze] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Concat__1464:0 -> (1, 10, 10, 2, 128)[FLOAT]], [TensorRT] VERBOSE: Original shape: (1, 10, 10, 2, 128), unsqueezing to: (1, 10, 1, 10, 2, 128) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465 [Unsqueeze] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 -> (1, 10, 1, 10, 2, 128)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3:0 -> (1, 128, 5, 5)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6:0 -> (1, 128, 5, 5)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3:0 -> (1, 128, 10, 10)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6:0 -> (1, 128, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Concat__1467 [Concat] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Concat__1467 [Concat] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 -> (1, 10, 1, 10, 2, 128)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 -> (1, 10, 1, 10, 2, 128)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Concat__1467 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Concat__1467 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Concat__1467:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Concat__1467:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Concat__1467 [Concat] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Concat__1467:0 -> (1, 10, 2, 10, 2, 128)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6:0 -> (1, 128, 5, 5)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/ReadVariableOp:0 -> (128, 1, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 5, 5) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 3, 3) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise:0 -> (1, 128, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6:0 -> (1, 128, 5, 5)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/ReadVariableOp:0 -> (128, 1, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 5, 5) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 5, 5) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise:0 -> (1, 128, 5, 5)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_2/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_2/depthwise [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6:0 -> (1, 128, 10, 10)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/ReadVariableOp:0 -> (128, 1, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 10, 10) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_2/depthwise for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_2/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 10, 10) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_2/depthwise:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_2/depthwise:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_2/depthwise [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_2/depthwise:0 -> (1, 128, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise:0 -> (1, 128, 3, 3)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/ReadVariableOp_1:0 -> (128, 128, 1, 1)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 3, 3) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 3, 3) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d:0 -> (1, 128, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3 [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise:0 -> (1, 128, 5, 5)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/ReadVariableOp_1:0 -> (128, 128, 1, 1)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 5, 5) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3 [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 5, 5) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3:0 -> (1, 128, 5, 5)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_2 [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_2/depthwise:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_2 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_2/depthwise:0 -> (1, 128, 10, 10)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/ReadVariableOp_1:0 -> (128, 128, 1, 1)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 10, 10) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_2 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_2 [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 10, 10) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_2:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_2:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_2 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_2:0 -> (1, 128, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape [Reshape] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Concat__1467:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape__1478:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape [Reshape] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Concat__1467:0 -> (1, 10, 2, 10, 2, 128)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape__1478:0 -> (4)[INT32]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape [Reshape] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape:0 -> (1, 20, 20, 128)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3 [BatchNormalization] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d:0 -> (1, 128, 3, 3)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/ReadVariableOp_1:0 -> (128)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3/ReadVariableOp_1:0 -> (128)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3:0 -> (1, 128, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_3/FusedBatchNormV3 [BatchNormalization] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_3/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_3/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_3/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_3/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3:0 -> (1, 128, 5, 5)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_3/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_3/ReadVariableOp_1:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_3/FusedBatchNormV3/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_3/FusedBatchNormV3/ReadVariableOp_1:0 -> (128)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_3/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_3/FusedBatchNormV3 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_3/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_3/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_3/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_3/FusedBatchNormV3:0 -> (1, 128, 5, 5)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_2/FusedBatchNormV3 [BatchNormalization] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_2:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_2/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_2/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_2/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_2:0 -> (1, 128, 10, 10)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_2/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_2/ReadVariableOp_1:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp_1:0 -> (128)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_2/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_2/FusedBatchNormV3 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_2/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_2/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_2/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_2/FusedBatchNormV3:0 -> (1, 128, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: Transpose__2001 [Transpose] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape:0 [TensorRT] VERBOSE: Transpose__2001 [Transpose] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape:0 -> (1, 20, 20, 128)[FLOAT]], [TensorRT] VERBOSE: Registering layer: Transpose__2001 for ONNX node: Transpose__2001 [TensorRT] VERBOSE: Registering tensor: Transpose__2001:0 for ONNX tensor: Transpose__2001:0 [TensorRT] VERBOSE: Transpose__2001 [Transpose] outputs: [Transpose__2001:0 -> (1, 128, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3:0 -> (1, 128, 3, 3)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6:0 -> (1, 128, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_3/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_3/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_3/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_3/FusedBatchNormV3:0 -> (1, 128, 5, 5)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_3/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_3/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_3/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_3/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_3/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_3/Relu6:0 -> (1, 128, 5, 5)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_2/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_2/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_2/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_2/FusedBatchNormV3:0 -> (1, 128, 10, 10)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_2/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_2/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_2/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_2/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_2/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_2/Relu6:0 -> (1, 128, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add [Add] [TensorRT] VERBOSE: Searching for input: Transpose__2001:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add [Add] inputs: [Transpose__2001:0 -> (1, 128, 20, 20)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd:0 -> (1, 128, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add [Add] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add:0 -> (1, 128, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6:0 -> (1, 128, 3, 3)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/ReadVariableOp:0 -> (128, 1, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 3, 3) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 3, 3) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise:0 -> (1, 128, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_3/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_3/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_3/depthwise [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_3/Relu6:0 -> (1, 128, 5, 5)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/ReadVariableOp:0 -> (128, 1, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 5, 5) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_3/depthwise for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_3/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 5, 5) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_3/depthwise:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_3/depthwise:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_3/depthwise [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_3/depthwise:0 -> (1, 128, 5, 5)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_2/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2/depthwise [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_2/Relu6:0 -> (1, 128, 10, 10)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2/ReadVariableOp:0 -> (128, 1, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 10, 10) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2/depthwise for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 10, 10) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2/depthwise:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2/depthwise:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2/depthwise [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2/depthwise:0 -> (1, 128, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add:0 -> (1, 128, 20, 20)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/ReadVariableOp:0 -> (128, 1, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 20, 20) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 20, 20) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise:0 -> (1, 128, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4 [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise:0 -> (1, 128, 3, 3)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/ReadVariableOp_1:0 -> (128, 128, 1, 1)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 3, 3) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4 [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 3, 3) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4:0 -> (1, 128, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_3 [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_3/depthwise:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_3 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_3/depthwise:0 -> (1, 128, 5, 5)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/ReadVariableOp_1:0 -> (128, 128, 1, 1)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 5, 5) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_3 [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 5, 5) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_3 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_3:0 -> (1, 128, 5, 5)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2 [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2/depthwise:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2/depthwise:0 -> (1, 128, 10, 10)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4/ReadVariableOp_1:0 -> (128, 128, 1, 1)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 10, 10) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2 [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 10, 10) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2:0 -> (1, 128, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise:0 -> (1, 128, 20, 20)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/ReadVariableOp_1:0 -> (128, 128, 1, 1)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 20, 20) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 20, 20) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d:0 -> (1, 128, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_4/FusedBatchNormV3 [BatchNormalization] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_4/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_4/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_4/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_4/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_4/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4:0 -> (1, 128, 3, 3)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_4/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_4/ReadVariableOp_1:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_4/FusedBatchNormV3/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_4/FusedBatchNormV3/ReadVariableOp_1:0 -> (128)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_4/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_4/FusedBatchNormV3 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_4/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_4/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_4/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_4/FusedBatchNormV3:0 -> (1, 128, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_3/FusedBatchNormV3 [BatchNormalization] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_3:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_3/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_3/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_3/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_3/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_3:0 -> (1, 128, 5, 5)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_3/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_3/ReadVariableOp_1:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_3/FusedBatchNormV3/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_3/FusedBatchNormV3/ReadVariableOp_1:0 -> (128)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_3/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_3/FusedBatchNormV3 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_3/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_3/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_3/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_3/FusedBatchNormV3:0 -> (1, 128, 5, 5)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_2/FusedBatchNormV3 [BatchNormalization] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_2/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_2/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_2/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2:0 -> (1, 128, 10, 10)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_2/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_2/ReadVariableOp_1:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp_1:0 -> (128)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_2/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_2/FusedBatchNormV3 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_2/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_2/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_2/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_2/FusedBatchNormV3:0 -> (1, 128, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 [BatchNormalization] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d:0 -> (1, 128, 20, 20)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/ReadVariableOp_1:0 -> (128)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3/ReadVariableOp_1:0 -> (128)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3:0 -> (1, 128, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_4/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_4/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_4/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_4/FusedBatchNormV3:0 -> (1, 128, 3, 3)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_4/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_4/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_4/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_4/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_4/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_4/Relu6:0 -> (1, 128, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_3/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_3/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_3/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_3/FusedBatchNormV3:0 -> (1, 128, 5, 5)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_3/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_3/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_3/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_3/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_3/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_3/Relu6:0 -> (1, 128, 5, 5)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_2/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_2/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_2/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_2/FusedBatchNormV3:0 -> (1, 128, 10, 10)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_2/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_2/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_2/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_2/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_2/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_2/Relu6:0 -> (1, 128, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3:0 -> (1, 128, 20, 20)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6:0 -> (1, 128, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_4/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_4/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_4/depthwise [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_4/Relu6:0 -> (1, 128, 3, 3)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/ReadVariableOp:0 -> (128, 1, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 3, 3) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_4/depthwise for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_4/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 3, 3) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_4/depthwise:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_4/depthwise:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_4/depthwise [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_4/depthwise:0 -> (1, 128, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_3/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_3/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_3/depthwise [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_3/Relu6:0 -> (1, 128, 5, 5)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2/ReadVariableOp:0 -> (128, 1, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 5, 5) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_3/depthwise for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_3/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 5, 5) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_3/depthwise:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_3/depthwise:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_3/depthwise [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_3/depthwise:0 -> (1, 128, 5, 5)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_2/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2/depthwise [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_2/Relu6:0 -> (1, 128, 10, 10)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3/ReadVariableOp:0 -> (128, 1, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 10, 10) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2/depthwise for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 10, 10) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2/depthwise:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2/depthwise:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2/depthwise [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2/depthwise:0 -> (1, 128, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: Transpose__2009 [Transpose] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6:0 [TensorRT] VERBOSE: Transpose__2009 [Transpose] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6:0 -> (1, 128, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Registering layer: Transpose__2009 for ONNX node: Transpose__2009 [TensorRT] VERBOSE: Registering tensor: Transpose__2009:0 for ONNX tensor: Transpose__2009:0 [TensorRT] VERBOSE: Transpose__2009 [Transpose] outputs: [Transpose__2009:0 -> (1, 20, 20, 128)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_1/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_1/depthwise [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6:0 -> (1, 128, 20, 20)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/ReadVariableOp:0 -> (128, 1, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 20, 20) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_1/depthwise for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_1/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 20, 20) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_1/depthwise:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_1/depthwise:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_1/depthwise [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_1/depthwise:0 -> (1, 128, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_4 [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_4/depthwise:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_4 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_4/depthwise:0 -> (1, 128, 3, 3)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/ReadVariableOp_1:0 -> (128, 128, 1, 1)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 3, 3) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_4 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_4 [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 3, 3) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_4:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_4:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_4 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_4:0 -> (1, 128, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_3 [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_3/depthwise:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_3 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_3/depthwise:0 -> (1, 128, 5, 5)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4/ReadVariableOp_1:0 -> (128, 128, 1, 1)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 5, 5) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_3 [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 5, 5) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_3 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_3:0 -> (1, 128, 5, 5)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2 [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2/depthwise:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2/depthwise:0 -> (1, 128, 10, 10)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2/ReadVariableOp_1:0 -> (128, 128, 1, 1)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 10, 10) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2 [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 10, 10) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2:0 -> (1, 128, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596 [Unsqueeze] [TensorRT] VERBOSE: Searching for input: Transpose__2009:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596 [Unsqueeze] inputs: [Transpose__2009:0 -> (1, 20, 20, 128)[FLOAT]], [TensorRT] VERBOSE: Original shape: (1, 20, 20, 128), unsqueezing to: (1, 20, 20, 1, 128) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596 [Unsqueeze] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 -> (1, 20, 20, 1, 128)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_1 [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_1/depthwise:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_1 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_1/depthwise:0 -> (1, 128, 20, 20)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/ReadVariableOp_1:0 -> (128, 128, 1, 1)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 20, 20) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_1 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_1 [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 20, 20) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_1:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_1 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_1:0 -> (1, 128, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_4/FusedBatchNormV3 [BatchNormalization] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_4:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_4/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_4/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_4/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_4/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_4/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_4:0 -> (1, 128, 3, 3)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_4/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_4/ReadVariableOp_1:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_4/FusedBatchNormV3/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_4/FusedBatchNormV3/ReadVariableOp_1:0 -> (128)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_4/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_4/FusedBatchNormV3 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_4/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_4/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_4/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_4/FusedBatchNormV3:0 -> (1, 128, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_3/FusedBatchNormV3 [BatchNormalization] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_3:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_3/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_3/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_3/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_3/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_3:0 -> (1, 128, 5, 5)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_3/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_3/ReadVariableOp_1:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_3/FusedBatchNormV3/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_3/FusedBatchNormV3/ReadVariableOp_1:0 -> (128)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_3/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_3/FusedBatchNormV3 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_3/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_3/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_3/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_3/FusedBatchNormV3:0 -> (1, 128, 5, 5)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_2/FusedBatchNormV3 [BatchNormalization] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_2/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_2/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_2/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2:0 -> (1, 128, 10, 10)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_2/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_2/ReadVariableOp_1:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp_1:0 -> (128)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_2/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_2/FusedBatchNormV3 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_2/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_2/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_2/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_2/FusedBatchNormV3:0 -> (1, 128, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Concat__1598 [Concat] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Concat__1598 [Concat] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 -> (1, 20, 20, 1, 128)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 -> (1, 20, 20, 1, 128)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Concat__1598 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Concat__1598 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Concat__1598:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Concat__1598:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Concat__1598 [Concat] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Concat__1598:0 -> (1, 20, 20, 2, 128)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_1/FusedBatchNormV3 [BatchNormalization] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_1/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_1/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_1/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_1/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_1/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_1:0 -> (1, 128, 20, 20)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_1/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_1/ReadVariableOp_1:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_1/FusedBatchNormV3/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_1/FusedBatchNormV3/ReadVariableOp_1:0 -> (128)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_1/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_1/FusedBatchNormV3 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_1/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_1/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_1/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_1/FusedBatchNormV3:0 -> (1, 128, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_4/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_4/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_4/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_4/FusedBatchNormV3:0 -> (1, 128, 3, 3)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_4/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_4/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_4/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_4/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_4/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_4/Relu6:0 -> (1, 128, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_3/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_3/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_3/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_3/FusedBatchNormV3:0 -> (1, 128, 5, 5)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_3/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_3/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_3/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_3/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_3/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_3/Relu6:0 -> (1, 128, 5, 5)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_2/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_2/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_2/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_2/FusedBatchNormV3:0 -> (1, 128, 10, 10)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_2/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_2/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_2/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_2/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_2/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_2/Relu6:0 -> (1, 128, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599 [Unsqueeze] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Concat__1598:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599 [Unsqueeze] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Concat__1598:0 -> (1, 20, 20, 2, 128)[FLOAT]], [TensorRT] VERBOSE: Original shape: (1, 20, 20, 2, 128), unsqueezing to: (1, 20, 1, 20, 2, 128) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599 [Unsqueeze] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 -> (1, 20, 1, 20, 2, 128)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_1/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_1/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_1/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_1/FusedBatchNormV3:0 -> (1, 128, 20, 20)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_1/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_1/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_1/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_1/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_1/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_1/Relu6:0 -> (1, 128, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_4/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4/depthwise [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_4/Relu6:0 -> (1, 128, 3, 3)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2/ReadVariableOp:0 -> (128, 1, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 3, 3) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4/depthwise for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 3, 3) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4/depthwise:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4/depthwise:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4/depthwise [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4/depthwise:0 -> (1, 128, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_3/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3/depthwise [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_3/Relu6:0 -> (1, 128, 5, 5)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3/ReadVariableOp:0 -> (128, 1, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 5, 5) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3/depthwise for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 5, 5) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3/depthwise:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3/depthwise:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3/depthwise [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3/depthwise:0 -> (1, 128, 5, 5)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_2/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_2/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_2/depthwise [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_2/Relu6:0 -> (1, 128, 10, 10)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/ReadVariableOp:0 -> (128, 1, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 10, 10) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_2/depthwise for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_2/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 10, 10) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_2/depthwise:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_2/depthwise:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_2/depthwise [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_2/depthwise:0 -> (1, 128, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_2/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_2/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_3/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_2/depthwise [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_2/Relu6:0 -> (1, 128, 10, 10)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_3/ReadVariableOp:0 -> (128, 1, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 10, 10) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_2/depthwise for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_2/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 10, 10) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_2/depthwise:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_2/depthwise:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_2/depthwise [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_2/depthwise:0 -> (1, 128, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Concat__1601 [Concat] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Concat__1601 [Concat] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 -> (1, 20, 1, 20, 2, 128)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 -> (1, 20, 1, 20, 2, 128)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Concat__1601 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Concat__1601 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Concat__1601:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Concat__1601:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Concat__1601 [Concat] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Concat__1601:0 -> (1, 20, 2, 20, 2, 128)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_1/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_1/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_1/depthwise [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_1/Relu6:0 -> (1, 128, 20, 20)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/ReadVariableOp:0 -> (128, 1, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 20, 20) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_1/depthwise for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_1/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 20, 20) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_1/depthwise:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_1/depthwise:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_1/depthwise [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_1/depthwise:0 -> (1, 128, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4 [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4/depthwise:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4/depthwise:0 -> (1, 128, 3, 3)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4/ReadVariableOp_1:0 -> (128, 128, 1, 1)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 3, 3) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4 [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 3, 3) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4:0 -> (1, 128, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3 [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3/depthwise:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3/depthwise:0 -> (1, 128, 5, 5)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2/ReadVariableOp_1:0 -> (128, 128, 1, 1)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 5, 5) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3 [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 5, 5) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3:0 -> (1, 128, 5, 5)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_2/depthwise:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_2/depthwise:0 -> (1, 128, 10, 10)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/ReadVariableOp_1:0 -> (24, 128, 1, 1)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1/ReadVariableOp:0 -> (24)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 10, 10) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 24 [TensorRT] VERBOSE: Convolution output dimensions: (1, 24, 10, 10) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2:0 -> (1, 24, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_2/depthwise:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_4/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_2/depthwise:0 -> (1, 128, 10, 10)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_4/ReadVariableOp_1:0 -> (24, 128, 1, 1)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd/ReadVariableOp:0 -> (24)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 10, 10) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 24 [TensorRT] VERBOSE: Convolution output dimensions: (1, 24, 10, 10) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2:0 -> (1, 24, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_1 [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_1/depthwise:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_1 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_1/depthwise:0 -> (1, 128, 20, 20)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/ReadVariableOp_1:0 -> (128, 128, 1, 1)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 20, 20) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_1 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_1 [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 20, 20) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_1:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_1 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_1:0 -> (1, 128, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape [Reshape] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Concat__1601:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape__1612:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape [Reshape] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Concat__1601:0 -> (1, 20, 2, 20, 2, 128)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape__1612:0 -> (4)[INT32]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape [Reshape] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape:0 -> (1, 40, 40, 128)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_4/FusedBatchNormV3 [BatchNormalization] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_4/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_4/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_4/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_4/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_4/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4:0 -> (1, 128, 3, 3)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_4/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_4/ReadVariableOp_1:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_4/FusedBatchNormV3/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_4/FusedBatchNormV3/ReadVariableOp_1:0 -> (128)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_4/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_4/FusedBatchNormV3 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_4/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_4/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_4/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_4/FusedBatchNormV3:0 -> (1, 128, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_3/FusedBatchNormV3 [BatchNormalization] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_3/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_3/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_3/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_3/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_3/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3:0 -> (1, 128, 5, 5)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_3/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_3/ReadVariableOp_1:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_3/FusedBatchNormV3/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_3/FusedBatchNormV3/ReadVariableOp_1:0 -> (128)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_3/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_3/FusedBatchNormV3 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_3/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_3/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_3/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_3/FusedBatchNormV3:0 -> (1, 128, 5, 5)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2__1556 [Transpose] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2__1556 [Transpose] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2:0 -> (1, 24, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2__1556 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2__1556 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2__1556:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2__1556:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2__1556 [Transpose] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2__1556:0 -> (1, 10, 10, 24)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2__1575 [Transpose] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2__1575 [Transpose] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2:0 -> (1, 24, 10, 10)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2__1575 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2__1575 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2__1575:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2__1575:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2__1575 [Transpose] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2__1575:0 -> (1, 10, 10, 24)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_1/FusedBatchNormV3 [BatchNormalization] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_1/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_1/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_1/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_1/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_1/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_1:0 -> (1, 128, 20, 20)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_1/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_1/ReadVariableOp_1:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_1/FusedBatchNormV3/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_1/FusedBatchNormV3/ReadVariableOp_1:0 -> (128)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_1/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_1/FusedBatchNormV3 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_1/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_1/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_1/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_1/FusedBatchNormV3:0 -> (1, 128, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: Transpose__2021 [Transpose] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape:0 [TensorRT] VERBOSE: Transpose__2021 [Transpose] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape:0 -> (1, 40, 40, 128)[FLOAT]], [TensorRT] VERBOSE: Registering layer: Transpose__2021 for ONNX node: Transpose__2021 [TensorRT] VERBOSE: Registering tensor: Transpose__2021:0 for ONNX tensor: Transpose__2021:0 [TensorRT] VERBOSE: Transpose__2021 [Transpose] outputs: [Transpose__2021:0 -> (1, 128, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_4/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_4/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_4/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_4/FusedBatchNormV3:0 -> (1, 128, 3, 3)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_4/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_4/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_4/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_4/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_4/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_4/Relu6:0 -> (1, 128, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_3/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_3/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_3/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_3/FusedBatchNormV3:0 -> (1, 128, 5, 5)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_3/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_3/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_3/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_3/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_3/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_3/Relu6:0 -> (1, 128, 5, 5)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_1/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_1/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_1/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_1/FusedBatchNormV3:0 -> (1, 128, 20, 20)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_1/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_1/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_1/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_1/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_1/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_1/Relu6:0 -> (1, 128, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4 [Reshape] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2__1556:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4__1558:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4 [Reshape] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2__1556:0 -> (1, 10, 10, 24)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4__1558:0 -> (5)[INT32]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4 [Reshape] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4:0 -> (1, 10, 10, 6, 4)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2 [Reshape] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2__1575:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2__1577:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2 [Reshape] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2__1575:0 -> (1, 10, 10, 24)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2__1577:0 -> (3)[INT32]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2 [Reshape] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0 -> (1, 600, 4)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 [Add] [TensorRT] VERBOSE: Searching for input: Transpose__2021:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 [Add] inputs: [Transpose__2021:0 -> (1, 128, 40, 40)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd:0 -> (1, 128, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 [Add] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1:0 -> (1, 128, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_4/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_4/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_4/depthwise [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_4/Relu6:0 -> (1, 128, 3, 3)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3/ReadVariableOp:0 -> (128, 1, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 3, 3) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_4/depthwise for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_4/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 3, 3) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_4/depthwise:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_4/depthwise:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_4/depthwise [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_4/depthwise:0 -> (1, 128, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_3/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_3/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_3/depthwise [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_3/Relu6:0 -> (1, 128, 5, 5)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/ReadVariableOp:0 -> (128, 1, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 5, 5) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_3/depthwise for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_3/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 5, 5) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_3/depthwise:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_3/depthwise:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_3/depthwise [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_3/depthwise:0 -> (1, 128, 5, 5)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_3/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_3/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_3/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_3/depthwise [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_3/Relu6:0 -> (1, 128, 5, 5)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_3/ReadVariableOp:0 -> (128, 1, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 5, 5) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_3/depthwise for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_3/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 5, 5) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_3/depthwise:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_3/depthwise:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_3/depthwise [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_3/depthwise:0 -> (1, 128, 5, 5)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_1/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_1/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_1/depthwise [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_1/Relu6:0 -> (1, 128, 20, 20)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2/ReadVariableOp:0 -> (128, 1, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 20, 20) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_1/depthwise for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_1/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 20, 20) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_1/depthwise:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_1/depthwise:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_1/depthwise [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_1/depthwise:0 -> (1, 128, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_5 [Reshape] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2__1577:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_5 [Reshape] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4:0 -> (1, 10, 10, 6, 4)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2__1577:0 -> (3)[INT32]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_5 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_5 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_5:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_5:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_5 [Reshape] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_5:0 -> (1, 600, 4)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1:0 -> (1, 128, 40, 40)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/ReadVariableOp:0 -> (128, 1, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 40, 40) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 40, 40) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise:0 -> (1, 128, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_4 [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_4/depthwise:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_4 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_4/depthwise:0 -> (1, 128, 3, 3)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2/ReadVariableOp_1:0 -> (128, 128, 1, 1)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 3, 3) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_4 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_4 [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 3, 3) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_4:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_4:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_4 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_4:0 -> (1, 128, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_3/depthwise:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_3/depthwise:0 -> (1, 128, 5, 5)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/ReadVariableOp_1:0 -> (24, 128, 1, 1)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1/ReadVariableOp:0 -> (24)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 5, 5) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 24 [TensorRT] VERBOSE: Convolution output dimensions: (1, 24, 5, 5) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3:0 -> (1, 24, 5, 5)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_3/depthwise:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_4/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_3/depthwise:0 -> (1, 128, 5, 5)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_4/ReadVariableOp_1:0 -> (24, 128, 1, 1)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd/ReadVariableOp:0 -> (24)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 5, 5) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 24 [TensorRT] VERBOSE: Convolution output dimensions: (1, 24, 5, 5) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3:0 -> (1, 24, 5, 5)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_1 [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_1/depthwise:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_1 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_1/depthwise:0 -> (1, 128, 20, 20)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4/ReadVariableOp_1:0 -> (128, 128, 1, 1)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 20, 20) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_1 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_1 [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 20, 20) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_1:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_1 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_1:0 -> (1, 128, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise:0 -> (1, 128, 40, 40)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/ReadVariableOp_1:0 -> (128, 128, 1, 1)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 40, 40) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 40, 40) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d [Conv] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d:0 -> (1, 128, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_4/FusedBatchNormV3 [BatchNormalization] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_4:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_4/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_4/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_4/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_4/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_4/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_4:0 -> (1, 128, 3, 3)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_4/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_4/ReadVariableOp_1:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_4/FusedBatchNormV3/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_4/FusedBatchNormV3/ReadVariableOp_1:0 -> (128)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_4/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_4/FusedBatchNormV3 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_4/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_4/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_4/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_4/FusedBatchNormV3:0 -> (1, 128, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3__1440 [Transpose] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3__1440 [Transpose] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3:0 -> (1, 24, 5, 5)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3__1440 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3__1440 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3__1440:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3__1440:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3__1440 [Transpose] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3__1440:0 -> (1, 5, 5, 24)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3__1459 [Transpose] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3__1459 [Transpose] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3:0 -> (1, 24, 5, 5)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3__1459 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3__1459 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3__1459:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3__1459:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3__1459 [Transpose] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3__1459:0 -> (1, 5, 5, 24)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_1/FusedBatchNormV3 [BatchNormalization] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_1/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_1/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_1/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_1/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_1/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_1:0 -> (1, 128, 20, 20)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_1/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_1/ReadVariableOp_1:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_1/FusedBatchNormV3/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_1/FusedBatchNormV3/ReadVariableOp_1:0 -> (128)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_1/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_1/FusedBatchNormV3 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_1/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_1/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_1/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_1/FusedBatchNormV3:0 -> (1, 128, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 [BatchNormalization] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d:0 -> (1, 128, 40, 40)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/ReadVariableOp_1:0 -> (128)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3/ReadVariableOp_1:0 -> (128)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3:0 -> (1, 128, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_4/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_4/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_4/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_4/FusedBatchNormV3:0 -> (1, 128, 3, 3)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_4/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_4/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_4/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_4/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_4/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_4/Relu6:0 -> (1, 128, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_1/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_1/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_1/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_1/FusedBatchNormV3:0 -> (1, 128, 20, 20)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_1/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_1/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_1/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_1/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_1/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_1/Relu6:0 -> (1, 128, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_6 [Reshape] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3__1440:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_6__1442:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_6 [Reshape] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3__1440:0 -> (1, 5, 5, 24)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_6__1442:0 -> (5)[INT32]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_6 [Reshape] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_6:0 -> (1, 5, 5, 6, 4)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3 [Reshape] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3__1459:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3__1461:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3 [Reshape] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3__1459:0 -> (1, 5, 5, 24)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3__1461:0 -> (3)[INT32]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3 [Reshape] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0 -> (1, 150, 4)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 [Clip] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3:0 -> (1, 128, 40, 40)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 for ONNX node: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6:0 for ONNX tensor: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 [Clip] outputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6:0 -> (1, 128, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_4/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_4/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_4/depthwise [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_4/Relu6:0 -> (1, 128, 3, 3)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/ReadVariableOp:0 -> (128, 1, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 3, 3) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_4/depthwise for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_4/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 3, 3) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_4/depthwise:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_4/depthwise:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_4/depthwise [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_4/depthwise:0 -> (1, 128, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_4/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_4/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_3/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_4/depthwise [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_4/Relu6:0 -> (1, 128, 3, 3)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_3/ReadVariableOp:0 -> (128, 1, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 3, 3) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_4/depthwise for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_4/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 3, 3) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_4/depthwise:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_4/depthwise:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_4/depthwise [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_4/depthwise:0 -> (1, 128, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_1/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_1/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_1/depthwise [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_1/Relu6:0 -> (1, 128, 20, 20)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3/ReadVariableOp:0 -> (128, 1, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 20, 20) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_1/depthwise for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_1/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 20, 20) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_1/depthwise:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_1/depthwise:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_1/depthwise [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_1/depthwise:0 -> (1, 128, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_7 [Reshape] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3__1461:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_7 [Reshape] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_6:0 -> (1, 5, 5, 6, 4)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3__1461:0 -> (3)[INT32]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_7 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_7 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_7:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_7:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_7 [Reshape] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_7:0 -> (1, 150, 4)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d/depthwise [Conv] inputs: [StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6:0 -> (1, 128, 40, 40)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/ReadVariableOp:0 -> (128, 1, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 40, 40) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d/depthwise for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 40, 40) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d/depthwise:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d/depthwise:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d/depthwise [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d/depthwise:0 -> (1, 128, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_4/depthwise:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_4/depthwise:0 -> (1, 128, 3, 3)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/ReadVariableOp_1:0 -> (24, 128, 1, 1)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1/ReadVariableOp:0 -> (24)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 3, 3) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 24 [TensorRT] VERBOSE: Convolution output dimensions: (1, 24, 3, 3) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4:0 -> (1, 24, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_4/depthwise:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_4/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_4/depthwise:0 -> (1, 128, 3, 3)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_4/ReadVariableOp_1:0 -> (24, 128, 1, 1)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd/ReadVariableOp:0 -> (24)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 3, 3) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 24 [TensorRT] VERBOSE: Convolution output dimensions: (1, 24, 3, 3) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4:0 -> (1, 24, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_1 [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_1/depthwise:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_1 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_1/depthwise:0 -> (1, 128, 20, 20)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2/ReadVariableOp_1:0 -> (128, 128, 1, 1)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 20, 20) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_1 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_1 [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 20, 20) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_1:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_1 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_1:0 -> (1, 128, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d/depthwise:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d/depthwise:0 -> (1, 128, 40, 40)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/ReadVariableOp_1:0 -> (128, 128, 1, 1)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 40, 40) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 40, 40) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d:0 -> (1, 128, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4__1341 [Transpose] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4__1341 [Transpose] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4:0 -> (1, 24, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4__1341 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4__1341 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4__1341:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4__1341:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4__1341 [Transpose] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4__1341:0 -> (1, 3, 3, 24)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4__1360 [Transpose] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4__1360 [Transpose] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4:0 -> (1, 24, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4__1360 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4__1360 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4__1360:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4__1360:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4__1360 [Transpose] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4__1360:0 -> (1, 3, 3, 24)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_1/FusedBatchNormV3 [BatchNormalization] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_1/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_1/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_1/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_1/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_1/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_1:0 -> (1, 128, 20, 20)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_1/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_1/ReadVariableOp_1:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_1/FusedBatchNormV3/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_1/FusedBatchNormV3/ReadVariableOp_1:0 -> (128)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_1/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_1/FusedBatchNormV3 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_1/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_1/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_1/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_1/FusedBatchNormV3:0 -> (1, 128, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_0/FusedBatchNormV3 [BatchNormalization] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_0/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_0/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_0/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_0/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_0/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d:0 -> (1, 128, 40, 40)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_0/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_0/ReadVariableOp_1:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_0/FusedBatchNormV3/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_0/FusedBatchNormV3/ReadVariableOp_1:0 -> (128)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_0/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_0/FusedBatchNormV3 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_0/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_0/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_0/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_0/FusedBatchNormV3:0 -> (1, 128, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_1/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_1/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_1/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_1/FusedBatchNormV3:0 -> (1, 128, 20, 20)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_1/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_1/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_1/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_1/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_1/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_1/Relu6:0 -> (1, 128, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4 [Reshape] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4__1360:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_9__1344:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4 [Reshape] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4__1360:0 -> (1, 3, 3, 24)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_9__1344:0 -> (3)[INT32]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4 [Reshape] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0 -> (1, 54, 4)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_8 [Reshape] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4__1341:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_8__1343:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_8 [Reshape] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4__1341:0 -> (1, 3, 3, 24)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_8__1343:0 -> (5)[INT32]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_8 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_8 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_8:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_8:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_8 [Reshape] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_8:0 -> (1, 3, 3, 6, 4)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_0/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_0/FusedBatchNormV3:0 -> (1, 128, 40, 40)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6:0 -> (1, 128, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_1/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/depthwise [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_1/Relu6:0 -> (1, 128, 20, 20)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/ReadVariableOp:0 -> (128, 1, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 20, 20) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/depthwise for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 20, 20) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/depthwise:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/depthwise:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/depthwise [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/depthwise:0 -> (1, 128, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_1/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_1/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_3/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_1/depthwise [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_1/Relu6:0 -> (1, 128, 20, 20)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_3/ReadVariableOp:0 -> (128, 1, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 20, 20) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_1/depthwise for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_1/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 20, 20) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_1/depthwise:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_1/depthwise:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_1/depthwise [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_1/depthwise:0 -> (1, 128, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_9 [Reshape] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_8:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_9__1344:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_9 [Reshape] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_8:0 -> (1, 3, 3, 6, 4)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_9__1344:0 -> (3)[INT32]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_9 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_9 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_9:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_9:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_9 [Reshape] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_9:0 -> (1, 54, 4)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/depthwise [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6:0 -> (1, 128, 40, 40)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/ReadVariableOp:0 -> (128, 1, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 40, 40) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/depthwise for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 40, 40) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/depthwise:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/depthwise:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/depthwise [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/depthwise:0 -> (1, 128, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/depthwise:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/depthwise:0 -> (1, 128, 20, 20)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/ReadVariableOp_1:0 -> (24, 128, 1, 1)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1/ReadVariableOp:0 -> (24)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 20, 20) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 24 [TensorRT] VERBOSE: Convolution output dimensions: (1, 24, 20, 20) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1:0 -> (1, 24, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_1/depthwise:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_4/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_1/depthwise:0 -> (1, 128, 20, 20)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_4/ReadVariableOp_1:0 -> (24, 128, 1, 1)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd/ReadVariableOp:0 -> (24)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 20, 20) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 24 [TensorRT] VERBOSE: Convolution output dimensions: (1, 24, 20, 20) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1:0 -> (1, 24, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/depthwise:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/depthwise:0 -> (1, 128, 40, 40)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/ReadVariableOp_1:0 -> (128, 128, 1, 1)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 40, 40) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 40, 40) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d:0 -> (1, 128, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1__1690 [Transpose] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1__1690 [Transpose] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1:0 -> (1, 24, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1__1690 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1__1690 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1__1690:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1__1690:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1__1690 [Transpose] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1__1690:0 -> (1, 20, 20, 24)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1__1709 [Transpose] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1__1709 [Transpose] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1:0 -> (1, 24, 20, 20)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1__1709 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1__1709 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1__1709:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1__1709:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1__1709 [Transpose] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1__1709:0 -> (1, 20, 20, 24)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_0/FusedBatchNormV3 [BatchNormalization] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_0/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_0/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_0/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_0/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_0/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d:0 -> (1, 128, 40, 40)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_0/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_0/ReadVariableOp_1:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_0/FusedBatchNormV3/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_0/FusedBatchNormV3/ReadVariableOp_1:0 -> (128)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_0/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_0/FusedBatchNormV3 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_0/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_0/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_0/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_0/FusedBatchNormV3:0 -> (1, 128, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_0/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_0/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_0/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_0/FusedBatchNormV3:0 -> (1, 128, 40, 40)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_0/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_0/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_0/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_0/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_0/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_0/Relu6:0 -> (1, 128, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1 [Reshape] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1__1709:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3__1693:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1 [Reshape] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1__1709:0 -> (1, 20, 20, 24)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3__1693:0 -> (3)[INT32]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1 [Reshape] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0 -> (1, 2400, 4)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2 [Reshape] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1__1690:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2__1692:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2 [Reshape] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1__1690:0 -> (1, 20, 20, 24)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2__1692:0 -> (5)[INT32]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2 [Reshape] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2:0 -> (1, 20, 20, 6, 4)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_0/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d/depthwise [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_0/Relu6:0 -> (1, 128, 40, 40)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2/ReadVariableOp:0 -> (128, 1, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 40, 40) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d/depthwise for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 40, 40) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d/depthwise:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d/depthwise:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d/depthwise [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d/depthwise:0 -> (1, 128, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3 [Reshape] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3__1693:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3 [Reshape] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2:0 -> (1, 20, 20, 6, 4)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3__1693:0 -> (3)[INT32]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3 [Reshape] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3:0 -> (1, 2400, 4)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d/depthwise:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d/depthwise:0 -> (1, 128, 40, 40)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4/ReadVariableOp_1:0 -> (128, 128, 1, 1)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 40, 40) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 40, 40) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d:0 -> (1, 128, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_0/FusedBatchNormV3 [BatchNormalization] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_0/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_0/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_0/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_0/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_0/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d:0 -> (1, 128, 40, 40)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_0/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_0/ReadVariableOp_1:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_0/FusedBatchNormV3/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_0/FusedBatchNormV3/ReadVariableOp_1:0 -> (128)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_0/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_0/FusedBatchNormV3 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_0/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_0/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_0/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_0/FusedBatchNormV3:0 -> (1, 128, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_0/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_0/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_0/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_0/FusedBatchNormV3:0 -> (1, 128, 40, 40)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_0/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_0/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_0/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_0/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_0/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_0/Relu6:0 -> (1, 128, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_0/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d/depthwise [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_0/Relu6:0 -> (1, 128, 40, 40)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3/ReadVariableOp:0 -> (128, 1, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 40, 40) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d/depthwise for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 40, 40) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d/depthwise:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d/depthwise:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d/depthwise [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d/depthwise:0 -> (1, 128, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d/depthwise:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d/depthwise:0 -> (1, 128, 40, 40)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2/ReadVariableOp_1:0 -> (128, 128, 1, 1)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 40, 40) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 40, 40) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d:0 -> (1, 128, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_0/FusedBatchNormV3 [BatchNormalization] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_0/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_0/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_0/FusedBatchNormV3/ReadVariableOp:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_0/FusedBatchNormV3/ReadVariableOp_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_0/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d:0 -> (1, 128, 40, 40)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_0/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_0/ReadVariableOp_1:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_0/FusedBatchNormV3/ReadVariableOp:0 -> (128)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_0/FusedBatchNormV3/ReadVariableOp_1:0 -> (128)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_0/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_0/FusedBatchNormV3 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_0/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_0/FusedBatchNormV3:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_0/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_0/FusedBatchNormV3:0 -> (1, 128, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_0/Relu6 [Clip] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_0/FusedBatchNormV3:0 [TensorRT] VERBOSE: Searching for input: const_fold_opt__2278 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_0/Relu6 [Clip] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_0/FusedBatchNormV3:0 -> (1, 128, 40, 40)[FLOAT]], [const_fold_opt__2278 -> ()[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6_max__1743 -> ()[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_0/Relu6 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_0/Relu6 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_0/Relu6:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_0/Relu6:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_0/Relu6 [Clip] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_0/Relu6:0 -> (1, 128, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_0/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d/depthwise [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_0/Relu6:0 -> (1, 128, 40, 40)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/ReadVariableOp:0 -> (128, 1, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 40, 40) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d/depthwise for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 40, 40) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d/depthwise:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d/depthwise:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d/depthwise [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d/depthwise:0 -> (1, 128, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d/depthwise [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_0/Relu6:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_3/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d/depthwise [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_0/Relu6:0 -> (1, 128, 40, 40)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_3/ReadVariableOp:0 -> (128, 1, 3, 3)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 40, 40) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d/depthwise for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d/depthwise [TensorRT] VERBOSE: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [TensorRT] VERBOSE: Convolution output dimensions: (1, 128, 40, 40) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d/depthwise:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d/depthwise:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d/depthwise [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d/depthwise:0 -> (1, 128, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d/depthwise:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d/depthwise:0 -> (1, 128, 40, 40)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/ReadVariableOp_1:0 -> (24, 128, 1, 1)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1/ReadVariableOp:0 -> (24)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 40, 40) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 24 [TensorRT] VERBOSE: Convolution output dimensions: (1, 24, 40, 40) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd:0 -> (1, 24, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd [Conv] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d/depthwise:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_4/ReadVariableOp_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd/ReadVariableOp:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd [Conv] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d/depthwise:0 -> (1, 128, 40, 40)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_4/ReadVariableOp_1:0 -> (24, 128, 1, 1)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd/ReadVariableOp:0 -> (24)[FLOAT]], [TensorRT] VERBOSE: Convolution input dimensions: (1, 128, 40, 40) [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd [TensorRT] VERBOSE: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 24 [TensorRT] VERBOSE: Convolution output dimensions: (1, 24, 40, 40) [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd [Conv] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd:0 -> (1, 24, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd__1807 [Transpose] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd__1807 [Transpose] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd:0 -> (1, 24, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd__1807 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd__1807 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd__1807:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd__1807:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd__1807 [Transpose] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd__1807:0 -> (1, 40, 40, 24)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd__1830 [Transpose] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd__1830 [Transpose] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd:0 -> (1, 24, 40, 40)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd__1830 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd__1830 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd__1830:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd__1830:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd__1830 [Transpose] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd__1830:0 -> (1, 40, 40, 24)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape [Reshape] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd__1807:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape__1809:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape [Reshape] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd__1807:0 -> (1, 40, 40, 24)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape__1809:0 -> (5)[INT32]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape [Reshape] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape:0 -> (1, 40, 40, 6, 4)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape [Reshape] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd__1830:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1__1810:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape [Reshape] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd__1830:0 -> (1, 40, 40, 24)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1__1810:0 -> (3)[INT32]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape [Reshape] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0 -> (1, 9600, 4)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1 [Reshape] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1__1810:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1 [Reshape] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape:0 -> (1, 40, 40, 6, 4)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1__1810:0 -> (3)[INT32]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1 for ONNX node: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1:0 for ONNX tensor: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1 [Reshape] outputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1:0 -> (1, 9600, 4)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/concat [Concat] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0 [TensorRT] VERBOSE: StatefulPartitionedCall/concat [Concat] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0 -> (1, 9600, 4)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0 -> (1, 2400, 4)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0 -> (1, 600, 4)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0 -> (1, 150, 4)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0 -> (1, 54, 4)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/concat for ONNX node: StatefulPartitionedCall/concat [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/concat:0 for ONNX tensor: StatefulPartitionedCall/concat:0 [TensorRT] VERBOSE: StatefulPartitionedCall/concat [Concat] outputs: [StatefulPartitionedCall/concat:0 -> (1, 12804, 4)[FLOAT]], [TensorRT] VERBOSE: Parsing node: StatefulPartitionedCall/concat_1 [Concat] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_5:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_7:0 [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_9:0 [TensorRT] VERBOSE: StatefulPartitionedCall/concat_1 [Concat] inputs: [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1:0 -> (1, 9600, 4)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3:0 -> (1, 2400, 4)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_5:0 -> (1, 600, 4)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_7:0 -> (1, 150, 4)[FLOAT]], [StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_9:0 -> (1, 54, 4)[FLOAT]], [TensorRT] VERBOSE: Registering layer: StatefulPartitionedCall/concat_1 for ONNX node: StatefulPartitionedCall/concat_1 [TensorRT] VERBOSE: Registering tensor: StatefulPartitionedCall/concat_1:0 for ONNX tensor: StatefulPartitionedCall/concat_1:0 [TensorRT] VERBOSE: StatefulPartitionedCall/concat_1 [Concat] outputs: [StatefulPartitionedCall/concat_1:0 -> (1, 12804, 4)[FLOAT]], [TensorRT] VERBOSE: Parsing node: WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/scale [Mul] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/concat:0 [TensorRT] VERBOSE: Searching for input: WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/scale_value:0 [TensorRT] VERBOSE: WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/scale [Mul] inputs: [StatefulPartitionedCall/concat:0 -> (1, 12804, 4)[FLOAT]], [WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/scale_value:0 -> (1, 1, 4)[FLOAT]], [TensorRT] VERBOSE: Registering layer: WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/scale_value:0 for ONNX node: WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/scale_value:0 [TensorRT] VERBOSE: Registering layer: WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/scale for ONNX node: WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/scale [TensorRT] VERBOSE: Registering tensor: WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/scale:0_1 for ONNX tensor: WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/scale:0_1 [TensorRT] VERBOSE: WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/scale [Mul] outputs: [WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/scale:0_1 -> (1, 12804, 4)[FLOAT]], [TensorRT] VERBOSE: Parsing node: WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/slicer [Slice] [TensorRT] VERBOSE: Searching for input: StatefulPartitionedCall/concat_1:0 [TensorRT] VERBOSE: Searching for input: WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/slicer_value:0 [TensorRT] VERBOSE: Searching for input: WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/slicer_value:1 [TensorRT] VERBOSE: Searching for input: WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/slicer_value:2 [TensorRT] VERBOSE: WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/slicer [Slice] inputs: [StatefulPartitionedCall/concat_1:0 -> (1, 12804, 4)[FLOAT]], [WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/slicer_value:0 -> (1)[INT32]], [WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/slicer_value:1 -> (1)[INT32]], [WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/slicer_value:2 -> (1)[INT32]], [TensorRT] VERBOSE: Registering layer: WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/slicer for ONNX node: WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/slicer [TensorRT] VERBOSE: Registering tensor: WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/slicer:0_0 for ONNX tensor: WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/slicer:0_0 [TensorRT] VERBOSE: WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/slicer [Slice] outputs: [WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/slicer:0_0 -> (1, 12804, 3)[FLOAT]], [TensorRT] VERBOSE: Parsing node: nms/non_maximum_suppression [EfficientNMS_TRT] [TensorRT] VERBOSE: Searching for input: WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/scale:0_1 [TensorRT] VERBOSE: Searching for input: WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/slicer:0_0 [TensorRT] VERBOSE: Searching for input: nms/anchors:0 [TensorRT] VERBOSE: nms/non_maximum_suppression [EfficientNMS_TRT] inputs: [WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/scale:0_1 -> (1, 12804, 4)[FLOAT]], [WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/slicer:0_0 -> (1, 12804, 3)[FLOAT]], [nms/anchors:0 -> (1, 12804, 4)[FLOAT]], [TensorRT] INFO: No importer registered for op: EfficientNMS_TRT. Attempting to import as plugin. [TensorRT] INFO: Searching for plugin: EfficientNMS_TRT, plugin_version: 1, plugin_namespace: [TensorRT] VERBOSE: Registering layer: nms/anchors:0 for ONNX node: nms/anchors:0 [TensorRT] INFO: Successfully created plugin: EfficientNMS_TRT [TensorRT] VERBOSE: Registering layer: nms/non_maximum_suppression for ONNX node: nms/non_maximum_suppression [TensorRT] VERBOSE: Registering tensor: num_detections_0 for ONNX tensor: num_detections [TensorRT] VERBOSE: Registering tensor: detection_boxes_1 for ONNX tensor: detection_boxes [TensorRT] VERBOSE: Registering tensor: detection_scores_2 for ONNX tensor: detection_scores [TensorRT] VERBOSE: Registering tensor: detection_classes_3 for ONNX tensor: detection_classes [TensorRT] VERBOSE: nms/non_maximum_suppression [EfficientNMS_TRT] outputs: [num_detections -> (1, 1)[INT32]], [detection_boxes -> (1, 100, 4)[FLOAT]], [detection_scores -> (1, 100)[FLOAT]], [detection_classes -> (1, 100)[INT32]], [TensorRT] VERBOSE: Marking num_detections_0 as output: num_detections [TensorRT] VERBOSE: Marking detection_boxes_1 as output: detection_boxes [TensorRT] VERBOSE: Marking detection_scores_2 as output: detection_scores [TensorRT] VERBOSE: Marking detection_classes_3 as output: detection_classes INFO:EngineBuilder:Network Description INFO:EngineBuilder:Input 'input_tensor' with shape (1, 320, 320, 3) and dtype DataType.FLOAT INFO:EngineBuilder:Output 'num_detections' with shape (1, 1) and dtype DataType.INT32 INFO:EngineBuilder:Output 'detection_boxes' with shape (1, 100, 4) and dtype DataType.FLOAT INFO:EngineBuilder:Output 'detection_scores' with shape (1, 100) and dtype DataType.FLOAT INFO:EngineBuilder:Output 'detection_classes' with shape (1, 100) and dtype DataType.INT32 INFO:EngineBuilder:Building fp16 Engine in /home/pi/TensorRT/samples/python/tensorflow_object_detection_api/engine.trt [TensorRT] INFO: [MemUsageSnapshot] Builder begin: CPU 240 MiB, GPU 1218 MiB [TensorRT] VERBOSE: Applying generic optimizations to the graph for inference. [TensorRT] VERBOSE: Original: 276 layers [TensorRT] VERBOSE: After dead-layer removal: 276 layers [TensorRT] VERBOSE: ShuffleShuffleFusion: Fusing Transpose__1965 with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463 [TensorRT] VERBOSE: ShuffleShuffleFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape with Transpose__2001 [TensorRT] VERBOSE: ShuffleShuffleFusion: Fusing Transpose__2009 with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596 [TensorRT] VERBOSE: ShuffleShuffleFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape with Transpose__2021 [TensorRT] VERBOSE: ShuffleShuffleFusion: Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2__1556 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4 [TensorRT] VERBOSE: ShuffleShuffleFusion: Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2__1575 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2 [TensorRT] VERBOSE: ShuffleShuffleFusion: Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2__1556 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_5 [TensorRT] VERBOSE: ShuffleShuffleFusion: Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3__1440 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_6 [TensorRT] VERBOSE: ShuffleShuffleFusion: Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3__1459 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3 [TensorRT] VERBOSE: ShuffleShuffleFusion: Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3__1440 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_6 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_7 [TensorRT] VERBOSE: ShuffleShuffleFusion: Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4__1341 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_8 [TensorRT] VERBOSE: ShuffleShuffleFusion: Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4__1360 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4 [TensorRT] VERBOSE: ShuffleShuffleFusion: Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4__1341 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_8 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_9 [TensorRT] VERBOSE: ShuffleShuffleFusion: Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1__1690 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2 [TensorRT] VERBOSE: ShuffleShuffleFusion: Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1__1709 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1 [TensorRT] VERBOSE: ShuffleShuffleFusion: Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1__1690 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3 [TensorRT] VERBOSE: ShuffleShuffleFusion: Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd__1807 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape [TensorRT] VERBOSE: ShuffleShuffleFusion: Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd__1830 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape [TensorRT] VERBOSE: ShuffleShuffleFusion: Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd__1807 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1 [TensorRT] VERBOSE: After Myelin optimization: 257 layers [TensorRT] VERBOSE: ConstEltFusion: Fusing preprocessor/scale_value:0 with preprocessor/scale [TensorRT] VERBOSE: Fusing convolution weights from StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D with scale StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_BN/FusedBatchNormV3 [TensorRT] VERBOSE: Fusing convolution weights from StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D with scale StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_BN/FusedBatchNormV3 [TensorRT] VERBOSE: Fusing convolution weights from StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D with scale StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_BN/FusedBatchNormV3 [TensorRT] VERBOSE: Fusing convolution weights from StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D with scale StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_BN/FusedBatchNormV3 [TensorRT] VERBOSE: Fusing convolution weights from StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D with scale StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_BN/FusedBatchNormV3 [TensorRT] VERBOSE: Fusing convolution weights from StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D with scale StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_BN/FusedBatchNormV3 [TensorRT] VERBOSE: Fusing convolution weights from StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D with scale StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1_bn/FusedBatchNormV3 [TensorRT] VERBOSE: Fusing convolution weights from StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d with scale StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3 [TensorRT] VERBOSE: Fusing convolution weights from StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 with scale StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3 [TensorRT] VERBOSE: Fusing convolution weights from StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d with scale StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3 [TensorRT] VERBOSE: Fusing convolution weights from StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3 with scale StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_3/FusedBatchNormV3 [TensorRT] VERBOSE: Fusing convolution weights from StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_2 with scale StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_2/FusedBatchNormV3 [TensorRT] VERBOSE: Fusing convolution weights from StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4 with scale StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_4/FusedBatchNormV3 [TensorRT] VERBOSE: Fusing convolution weights from StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_3 with scale StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_3/FusedBatchNormV3 [TensorRT] VERBOSE: Fusing convolution weights from StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2 with scale StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_2/FusedBatchNormV3 [TensorRT] VERBOSE: Fusing convolution weights from StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d with scale StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3 [TensorRT] VERBOSE: Fusing convolution weights from StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_4 with scale StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_4/FusedBatchNormV3 [TensorRT] VERBOSE: Fusing convolution weights from StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_3 with scale StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_3/FusedBatchNormV3 [TensorRT] VERBOSE: Fusing convolution weights from StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2 with scale StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_2/FusedBatchNormV3 [TensorRT] VERBOSE: Fusing convolution weights from StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_1 with scale StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_1/FusedBatchNormV3 [TensorRT] VERBOSE: Fusing convolution weights from StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4 with scale StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_4/FusedBatchNormV3 [TensorRT] VERBOSE: Fusing convolution weights from StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3 with scale StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_3/FusedBatchNormV3 [TensorRT] VERBOSE: Fusing convolution weights from StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_1 with scale StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_1/FusedBatchNormV3 [TensorRT] VERBOSE: Fusing convolution weights from StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_4 with scale StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_4/FusedBatchNormV3 [TensorRT] VERBOSE: Fusing convolution weights from StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_1 with scale StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_1/FusedBatchNormV3 [TensorRT] VERBOSE: Fusing convolution weights from StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d with scale StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3 [TensorRT] VERBOSE: Fusing convolution weights from StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_1 with scale StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_1/FusedBatchNormV3 [TensorRT] VERBOSE: Fusing convolution weights from StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d with scale StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_0/FusedBatchNormV3 [TensorRT] VERBOSE: Fusing convolution weights from StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d with scale StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_0/FusedBatchNormV3 [TensorRT] VERBOSE: Fusing convolution weights from StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d with scale StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_0/FusedBatchNormV3 [TensorRT] VERBOSE: Fusing convolution weights from StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d with scale StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_0/FusedBatchNormV3 [TensorRT] VERBOSE: After scale fusion: 225 layers [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 [TensorRT] VERBOSE: ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_expand/Conv2D with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_expand_relu/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 [TensorRT] VERBOSE: ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_expand/Conv2D with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_expand_relu/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_depthwise/depthwise with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_depthwise_relu/Relu6 [TensorRT] VERBOSE: ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_project/Conv2D with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_add/add [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_expand/Conv2D with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_expand_relu/Relu6 [TensorRT] VERBOSE: ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 [TensorRT] VERBOSE: ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_expand/Conv2D with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_expand_relu/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_depthwise/depthwise with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_depthwise_relu/Relu6 [TensorRT] VERBOSE: ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_project/Conv2D with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_add/add [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_expand/Conv2D with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_expand_relu/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_depthwise/depthwise with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_depthwise_relu/Relu6 [TensorRT] VERBOSE: ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_project/Conv2D with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_add/add [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_expand/Conv2D with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_expand_relu/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_depthwise/depthwise with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_depthwise_relu/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 [TensorRT] VERBOSE: ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_expand/Conv2D with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_expand_relu/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_depthwise/depthwise with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_depthwise_relu/Relu6 [TensorRT] VERBOSE: ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_project/Conv2D with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_add/add [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_expand/Conv2D with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_expand_relu/Relu6 [TensorRT] VERBOSE: ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 [TensorRT] VERBOSE: ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_expand/Conv2D with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_expand_relu/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_depthwise/depthwise with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_depthwise_relu/Relu6 [TensorRT] VERBOSE: ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_project/Conv2D with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_add/add [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_expand/Conv2D with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_expand_relu/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_depthwise/depthwise with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_depthwise_relu/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_3/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_2 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_2/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_4/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_3 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_3/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_2/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_4 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_4/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_3 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_3/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_2/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_1 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_1/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_4/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_3/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_1 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_1/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_4 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_4/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_1 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_1/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d with StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_1 with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_1/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_0/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_0/Relu6 [TensorRT] VERBOSE: ConvPointWiseClipFusion: Fusing StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d with StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_0/Relu6 [TensorRT] VERBOSE: PointWiseFusion: Fusing preprocessor/scale_value:0 + preprocessor/scale with preprocessor/mean [TensorRT] VERBOSE: PointWiseFusion: Fusing preprocessor/mean_value:0 with PWN(preprocessor/scale_value:0 + preprocessor/scale, preprocessor/mean) [TensorRT] VERBOSE: After vertical fusions: 152 layers [TensorRT] VERBOSE: After dupe layer removal: 152 layers [TensorRT] VERBOSE: After final dead-layer removal: 152 layers [TensorRT] VERBOSE: After tensor merging: 152 layers [TensorRT] VERBOSE: Replacing slice WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/slicer with copy from StatefulPartitionedCall/concat_1:0 to WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/slicer:0_0 [TensorRT] VERBOSE: Eliminating concatenation StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Concat__1464 [TensorRT] VERBOSE: Generating copy for StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 to StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Concat__1464:0 because copy elision not implemented for axis. [TensorRT] VERBOSE: Generating copy for StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 to StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Concat__1464:0 because copy elision not implemented for axis. [TensorRT] VERBOSE: Eliminating concatenation StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Concat__1467 [TensorRT] VERBOSE: Generating copy for StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 to StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Concat__1467:0 because input does not support striding. [TensorRT] VERBOSE: Generating copy for StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 to StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Concat__1467:0 because input does not support striding. [TensorRT] VERBOSE: Eliminating concatenation StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Concat__1598 [TensorRT] VERBOSE: Generating copy for StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 to StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Concat__1598:0 because copy elision not implemented for axis. [TensorRT] VERBOSE: Generating copy for StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 to StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Concat__1598:0 because copy elision not implemented for axis. [TensorRT] VERBOSE: Eliminating concatenation StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Concat__1601 [TensorRT] VERBOSE: Generating copy for StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 to StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Concat__1601:0 because input does not support striding. [TensorRT] VERBOSE: Generating copy for StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 to StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Concat__1601:0 because input does not support striding. [TensorRT] VERBOSE: Eliminating concatenation StatefulPartitionedCall/concat [TensorRT] VERBOSE: Generating copy for StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0 to StatefulPartitionedCall/concat:0 because copy elision not implemented for axis. [TensorRT] VERBOSE: Generating copy for StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0 to StatefulPartitionedCall/concat:0 because copy elision not implemented for axis. [TensorRT] VERBOSE: Generating copy for StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0 to StatefulPartitionedCall/concat:0 because copy elision not implemented for axis. [TensorRT] VERBOSE: Generating copy for StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0 to StatefulPartitionedCall/concat:0 because copy elision not implemented for axis. [TensorRT] VERBOSE: Generating copy for StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0 to StatefulPartitionedCall/concat:0 because copy elision not implemented for axis. [TensorRT] VERBOSE: Eliminating concatenation StatefulPartitionedCall/concat_1 [TensorRT] VERBOSE: Generating copy for StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1:0 to StatefulPartitionedCall/concat_1:0 because copy elision not implemented for axis. [TensorRT] VERBOSE: Generating copy for StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3:0 to StatefulPartitionedCall/concat_1:0 because copy elision not implemented for axis. [TensorRT] VERBOSE: Generating copy for StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_5:0 to StatefulPartitionedCall/concat_1:0 because copy elision not implemented for axis. [TensorRT] VERBOSE: Generating copy for StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_7:0 to StatefulPartitionedCall/concat_1:0 because copy elision not implemented for axis. [TensorRT] VERBOSE: Generating copy for StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_9:0 to StatefulPartitionedCall/concat_1:0 because copy elision not implemented for axis. [TensorRT] VERBOSE: After concat removal: 164 layers [TensorRT] VERBOSE: Graph construction and optimization completed in 0.15352 seconds. [TensorRT] INFO: ---------- Layers Running on DLA ---------- [TensorRT] INFO: ---------- Layers Running on GPU ---------- [TensorRT] INFO: [GpuLayer] preprocessor/transpose [TensorRT] INFO: [GpuLayer] PWN(preprocessor/mean_value:0, PWN(preprocessor/scale_value:0 + preprocessor/scale, preprocessor/mean)) [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_expand_relu/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_expand_relu/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_depthwise_relu/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_add/add [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_expand_relu/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_expand_relu/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_depthwise_relu/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_add/add [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_expand_relu/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_depthwise_relu/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_add/add [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_expand_relu/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_depthwise_relu/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_expand_relu/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_depthwise_relu/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_add/add [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_expand_relu/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_expand_relu/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_depthwise_relu/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_add/add [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_expand_relu/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_depthwise_relu/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise [TensorRT] INFO: [GpuLayer] Transpose__1965 + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_2/depthwise [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_3/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_2/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape + Transpose__2001 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_3/depthwise [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2/depthwise [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_4/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_3/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_2/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_4/depthwise [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_3/depthwise [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2/depthwise [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_1/depthwise [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_4/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_3/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_2/Relu6 [TensorRT] INFO: [GpuLayer] Transpose__2009 + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_1/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4/depthwise [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3/depthwise [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_2/depthwise [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_2/depthwise [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_1/depthwise [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_4/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_3/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_1/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape + Transpose__2021 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2__1575 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_4/depthwise [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_3/depthwise [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_3/depthwise [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_1/depthwise [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2__1556 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_5 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_4/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_1/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3__1459 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_4/depthwise [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_4/depthwise [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_1/depthwise [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3__1440 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_6 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_7 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d/depthwise [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_1/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4__1360 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/depthwise [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_1/depthwise [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4__1341 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_8 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_9 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/depthwise [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_0/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1__1709 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d/depthwise [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1__1690 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_0/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d/depthwise [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_0/Relu6 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d/depthwise [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d/depthwise [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd__1830 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd__1807 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1 [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0 copy [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0 copy [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0 copy [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0 copy [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0 copy [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1:0 copy [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3:0 copy [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_5:0 copy [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_7:0 copy [TensorRT] INFO: [GpuLayer] StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_9:0 copy [TensorRT] INFO: [GpuLayer] WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/scale_value:0 [TensorRT] INFO: [GpuLayer] WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/scale [TensorRT] INFO: [GpuLayer] WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/slicer [TensorRT] INFO: [GpuLayer] nms/anchors:0 [TensorRT] INFO: [GpuLayer] nms/non_maximum_suppression [TensorRT] VERBOSE: Using cublas a tactic source [TensorRT] INFO: [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +158, GPU +245, now: CPU 402, GPU 1468 (MiB) [TensorRT] VERBOSE: Using cuDNN as a tactic source [TensorRT] INFO: [MemUsageChange] Init cuDNN: CPU +241, GPU +346, now: CPU 643, GPU 1814 (MiB) [TensorRT] WARNING: Detected invalid timing cache, setup a local cache instead [TensorRT] VERBOSE: Constructing optimization profile number 0 [1/1]. [TensorRT] VERBOSE: Using kFLOAT for region surrounded by copy operations: StatefulPartitionedCall/concat_1:0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,960,3,1) -> Float(307200,1,960,320) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 3.43385 [TensorRT] VERBOSE: Tactic: 0 Time: 5.3513 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 3.43385 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,960,3,1) -> Float(9600,960:32,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 3.4687 [TensorRT] VERBOSE: Tactic: 0 Time: 8.16375 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 3.4687 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,960,3,1) -> Half(307200,960,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.40099 [TensorRT] VERBOSE: Tactic: 0 Time: 1.85458 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 1.85458 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,960,3,1) -> Half(153600,960:2,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.68651 [TensorRT] VERBOSE: Tactic: 0 Time: 1.49089 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 1.49089 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(307200,960,3,1) -> Float(307200,102400,320,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: preprocessor/transpose (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 2.58182 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 2.58182 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(307200,1,960,320) -> Float(307200,1,960,3) *************** [TensorRT] VERBOSE: --------------- Timing Runner: preprocessor/transpose (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 4.08469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 4.08469 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(9600,960:32,3,1) -> Float(102400,102400:32,320,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: preprocessor/transpose (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 44.1766 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 44.1766 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(307200,960,3,1) -> Half(307200,102400,320,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: preprocessor/transpose (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 2.32401 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 2.32401 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(153600,960:2,3,1) -> Half(204800,102400:2,320,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: preprocessor/transpose (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 4.08948 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 4.08948 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,102400,320,1) -> Float(307200,1,960,3) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 40.2126 [TensorRT] VERBOSE: Tactic: 0 Time: 2.68073 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 2.68073 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,102400,320,1) -> Float(102400,102400:32,320,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 13.2123 [TensorRT] VERBOSE: Tactic: 0 Time: 14.8381 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 13.2123 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,102400,320,1) -> Half(307200,102400,320,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.754687 [TensorRT] VERBOSE: Tactic: 0 Time: 0.621718 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.621718 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,102400,320,1) -> Half(204800,102400:2,320,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.68667 [TensorRT] VERBOSE: Tactic: 0 Time: 0.662865 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.662865 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,1,960,3) -> Float(307200,102400,320,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 12.3711 [TensorRT] VERBOSE: Tactic: 0 Time: 0.827396 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.827396 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,1,960,3) -> Float(102400,102400:32,320,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 6.59531 [TensorRT] VERBOSE: Tactic: 0 Time: 14.9319 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 6.59531 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,1,960,3) -> Half(307200,102400,320,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 3.60714 [TensorRT] VERBOSE: Tactic: 0 Time: 0.50573 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.50573 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,1,960,3) -> Half(204800,102400:2,320,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.486458 [TensorRT] VERBOSE: Tactic: 0 Time: 0.745313 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.486458 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,102400:32,320,1) -> Float(307200,102400,320,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 7.40297 [TensorRT] VERBOSE: Tactic: 0 Time: 1.01625 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 1.01625 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,102400:32,320,1) -> Float(307200,1,960,3) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 5.14109 [TensorRT] VERBOSE: Tactic: 0 Time: 0.710885 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.710885 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,102400:32,320,1) -> Half(307200,102400,320,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 4.14969 [TensorRT] VERBOSE: Tactic: 0 Time: 0.997968 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.997968 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,102400:32,320,1) -> Half(204800,102400:2,320,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.772813 [TensorRT] VERBOSE: Tactic: 0 Time: 1.23615 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.772813 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(307200,102400,320,1) -> Float(307200,102400,320,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.51776 [TensorRT] VERBOSE: Tactic: 0 Time: 0.360208 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.360208 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(307200,102400,320,1) -> Float(307200,1,960,3) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 4.39854 [TensorRT] VERBOSE: Tactic: 0 Time: 0.617447 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.617447 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(307200,102400,320,1) -> Float(102400,102400:32,320,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 3.73474 [TensorRT] VERBOSE: Tactic: 0 Time: 10.8926 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 3.73474 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(307200,102400,320,1) -> Half(204800,102400:2,320,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.474479 [TensorRT] VERBOSE: Tactic: 0 Time: 0.445625 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.445625 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,102400:2,320,1) -> Float(307200,102400,320,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 4.07255 [TensorRT] VERBOSE: Tactic: 0 Time: 0.291979 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.291979 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,102400:2,320,1) -> Float(307200,1,960,3) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 4.33625 [TensorRT] VERBOSE: Tactic: 0 Time: 0.720886 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.720886 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,102400:2,320,1) -> Float(102400,102400:32,320,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 3.6951 [TensorRT] VERBOSE: Tactic: 0 Time: 10.0463 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 3.6951 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,102400:2,320,1) -> Half(307200,102400,320,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 9.9851 [TensorRT] VERBOSE: Tactic: 0 Time: 0.255833 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.255833 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(307200,102400,320,1) -> Float(307200,102400,320,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(preprocessor/mean_value:0, PWN(preprocessor/scale_value:0 + preprocessor/scale, preprocessor/mean)) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 Time: 3.08083 [TensorRT] VERBOSE: Tactic: 1 Time: 2.02552 [TensorRT] VERBOSE: Tactic: 2 Time: 1.80979 [TensorRT] VERBOSE: Tactic: 3 Time: 1.36854 [TensorRT] VERBOSE: Tactic: 4 Time: 1.2187 [TensorRT] VERBOSE: Tactic: 5 Time: 1.21682 [TensorRT] VERBOSE: Tactic: 6 Time: 1.03474 [TensorRT] VERBOSE: Tactic: 7 Time: 0.862969 [TensorRT] VERBOSE: Tactic: 8 Time: 0.856771 [TensorRT] VERBOSE: Tactic: 9 Time: 0.958073 [TensorRT] VERBOSE: Tactic: 28 Time: 2.95406 [TensorRT] VERBOSE: Fastest Tactic: 8 Time: 0.856771 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(preprocessor/mean_value:0, PWN(preprocessor/scale_value:0 + preprocessor/scale, preprocessor/mean)) (PointWise) [TensorRT] VERBOSE: Tactic: 128 Time: 10.1098 [TensorRT] VERBOSE: Tactic: 256 Time: 10.1669 [TensorRT] VERBOSE: Tactic: 512 Time: 10.2159 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 10.1098 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(307200,1,960,3) -> Float(307200,1,960,3) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(preprocessor/mean_value:0, PWN(preprocessor/scale_value:0 + preprocessor/scale, preprocessor/mean)) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 Time: 0.619271 [TensorRT] VERBOSE: Tactic: 1 Time: 0.40724 [TensorRT] VERBOSE: Tactic: 2 Time: 0.363386 [TensorRT] VERBOSE: Tactic: 3 Time: 0.278229 [TensorRT] VERBOSE: Tactic: 4 Time: 0.244583 [TensorRT] VERBOSE: Tactic: 5 Time: 0.247916 [TensorRT] VERBOSE: Tactic: 6 Time: 0.222969 [TensorRT] VERBOSE: Tactic: 7 Time: 0.181094 [TensorRT] VERBOSE: Tactic: 8 Time: 0.427917 [TensorRT] VERBOSE: Tactic: 9 Time: 0.480312 [TensorRT] VERBOSE: Tactic: 28 Time: 1.48255 [TensorRT] VERBOSE: Fastest Tactic: 7 Time: 0.181094 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(preprocessor/mean_value:0, PWN(preprocessor/scale_value:0 + preprocessor/scale, preprocessor/mean)) (PointWise) [TensorRT] VERBOSE: Tactic: 128 Time: 5.05823 [TensorRT] VERBOSE: Tactic: 256 Time: 5.09292 [TensorRT] VERBOSE: Tactic: 512 Time: 5.11646 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 5.05823 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 7 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(102400,102400:32,320,1) -> Float(102400,102400:32,320,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(preprocessor/mean_value:0, PWN(preprocessor/scale_value:0 + preprocessor/scale, preprocessor/mean)) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 24 Time: 19.1278 [TensorRT] VERBOSE: Tactic: 25 Time: 16.2003 [TensorRT] VERBOSE: Tactic: 26 Time: 15.3086 [TensorRT] VERBOSE: Tactic: 27 Time: 14.8196 [TensorRT] VERBOSE: Tactic: 31 Time: 18.8392 [TensorRT] VERBOSE: Fastest Tactic: 27 Time: 14.8196 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(preprocessor/mean_value:0, PWN(preprocessor/scale_value:0 + preprocessor/scale, preprocessor/mean)) (PointWise) [TensorRT] VERBOSE: Tactic: 128 Time: 21.5518 [TensorRT] VERBOSE: Tactic: 256 Time: 27.067 [TensorRT] VERBOSE: Tactic: 512 Time: 27.2199 [TensorRT] VERBOSE: Fastest Tactic: 128 Time: 21.5518 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(307200,102400,320,1) -> Half(307200,102400,320,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(preprocessor/mean_value:0, PWN(preprocessor/scale_value:0 + preprocessor/scale, preprocessor/mean)) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 Time: 3.06057 [TensorRT] VERBOSE: Tactic: 1 Time: 2.08609 [TensorRT] VERBOSE: Tactic: 2 Time: 1.95745 [TensorRT] VERBOSE: Tactic: 3 Time: 1.42927 [TensorRT] VERBOSE: Tactic: 4 Time: 1.28787 [TensorRT] VERBOSE: Tactic: 5 Time: 1.34047 [TensorRT] VERBOSE: Tactic: 6 Time: 1.11016 [TensorRT] VERBOSE: Tactic: 7 Time: 0.943958 [TensorRT] VERBOSE: Tactic: 8 Time: 0.940885 [TensorRT] VERBOSE: Tactic: 9 Time: 1.06859 [TensorRT] VERBOSE: Tactic: 28 Time: 2.95818 [TensorRT] VERBOSE: Fastest Tactic: 8 Time: 0.940885 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(preprocessor/mean_value:0, PWN(preprocessor/scale_value:0 + preprocessor/scale, preprocessor/mean)) (PointWise) [TensorRT] VERBOSE: Tactic: 128 Time: 9.77953 [TensorRT] VERBOSE: Tactic: 256 Time: 9.60323 [TensorRT] VERBOSE: Tactic: 512 Time: 9.25891 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 9.25891 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(204800,102400:2,320,1) -> Half(204800,102400:2,320,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: PWN(preprocessor/mean_value:0, PWN(preprocessor/scale_value:0 + preprocessor/scale, preprocessor/mean)) (PointWiseV2) [TensorRT] VERBOSE: Tactic: 0 Time: 4.15198 [TensorRT] VERBOSE: Tactic: 1 Time: 2.70792 [TensorRT] VERBOSE: Tactic: 2 Time: 2.70177 [TensorRT] VERBOSE: Tactic: 3 Time: 1.84818 [TensorRT] VERBOSE: Tactic: 4 Time: 1.79964 [TensorRT] VERBOSE: Tactic: 5 Time: 1.91823 [TensorRT] VERBOSE: Tactic: 6 Time: 1.43656 [TensorRT] VERBOSE: Tactic: 7 Time: 1.34885 [TensorRT] VERBOSE: Tactic: 8 Time: 1.38542 [TensorRT] VERBOSE: Tactic: 9 Time: 1.58776 [TensorRT] VERBOSE: Tactic: 10 Time: 7.75552 [TensorRT] VERBOSE: Tactic: 11 Time: 4.90589 [TensorRT] VERBOSE: Tactic: 12 Time: 4.57094 [TensorRT] VERBOSE: Tactic: 13 Time: 3.03594 [TensorRT] VERBOSE: Tactic: 14 Time: 2.88771 [TensorRT] VERBOSE: Tactic: 15 Time: 2.84589 [TensorRT] VERBOSE: Tactic: 16 Time: 2.10313 [TensorRT] VERBOSE: Tactic: 17 Time: 1.88859 [TensorRT] VERBOSE: Tactic: 18 Time: 1.91214 [TensorRT] VERBOSE: Tactic: 19 Time: 2.05396 [TensorRT] VERBOSE: Tactic: 28 Time: 4.08875 [TensorRT] VERBOSE: Tactic: 29 Time: 7.71646 [TensorRT] VERBOSE: Fastest Tactic: 7 Time: 1.34885 [TensorRT] VERBOSE: --------------- Timing Runner: PWN(preprocessor/mean_value:0, PWN(preprocessor/scale_value:0 + preprocessor/scale, preprocessor/mean)) (PointWise) [TensorRT] VERBOSE: Tactic: 128 Time: 14.5684 [TensorRT] VERBOSE: Tactic: 256 Time: 14.294 [TensorRT] VERBOSE: Tactic: 512 Time: 2.71083 [TensorRT] VERBOSE: Fastest Tactic: 512 Time: 2.71083 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 7 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,102400,320,1) -> Float(307200,1,960,3) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,102400,320,1) -> Half(307200,102400,320,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,102400,320,1) -> Half(204800,102400:2,320,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,1,960,3) -> Float(307200,102400,320,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,1,960,3) -> Half(307200,102400,320,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,1,960,3) -> Half(204800,102400:2,320,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,102400:32,320,1) -> Float(307200,102400,320,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,102400:32,320,1) -> Float(307200,1,960,3) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,102400:32,320,1) -> Half(307200,102400,320,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,102400:32,320,1) -> Half(204800,102400:2,320,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(307200,102400,320,1) -> Float(307200,102400,320,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(307200,102400,320,1) -> Float(307200,1,960,3) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(307200,102400,320,1) -> Half(204800,102400:2,320,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,102400:2,320,1) -> Float(307200,102400,320,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,102400:2,320,1) -> Float(307200,1,960,3) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,102400:2,320,1) -> Half(307200,102400,320,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(307200,102400,320,1) -> Float(819200,25600,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 9.91912 [TensorRT] VERBOSE: Tactic: 1 Time: 8.11495 [TensorRT] VERBOSE: Tactic: 2 Time: 16.9546 [TensorRT] VERBOSE: Tactic: 5 Time: 75.6189 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 8.11495 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 0.692448 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [TensorRT] VERBOSE: Tactic: 1754984623894446479 Time: 0.675 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [TensorRT] VERBOSE: Tactic: 3611739942397549984 Time: 2.26396 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [TensorRT] VERBOSE: Tactic: 4337000649858996379 Time: 1.05484 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 2.12448 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 1.04136 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 2.18703 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 1.03922 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 0.656041 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [TensorRT] VERBOSE: Tactic: -9137461792520977713 Time: 2.08208 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 2.22339 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [TensorRT] VERBOSE: Tactic: -8133971918129952780 Time: 1.1074 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [TensorRT] VERBOSE: Tactic: -6092040395344634144 Time: 0.725364 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 0.681302 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 0.667031 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 1.06745 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 1.05068 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 2.04396 [TensorRT] VERBOSE: Fastest Tactic: 7144526460361122478 Time: 0.656041 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 7144526460361122478 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(307200,1,960,3) -> Float(819200,1,5120,32) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(307200,102400,320,1) -> Half(819200,25600,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 1.84323 [TensorRT] VERBOSE: Tactic: 1 Time: 1.68594 [TensorRT] VERBOSE: Tactic: 2 Time: 3.42182 [TensorRT] VERBOSE: Tactic: 5 Time: 75.3503 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 1.68594 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(204800,102400:2,320,1) -> Half(409600,25600:2,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TensorRT] VERBOSE: Tactic: 3564772625446233998 Time: 0.524011 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 3650389455493082349 [TensorRT] VERBOSE: Tactic: 3650389455493082349 Time: 0.538333 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TensorRT] VERBOSE: Tactic: 5319956359050645452 Time: 0.497395 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TensorRT] VERBOSE: Tactic: 7205456024582378848 Time: 0.766302 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: -6490690591794140522 [TensorRT] VERBOSE: Tactic: -6490690591794140522 Time: 0.777344 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: -4686027666808657977 [TensorRT] VERBOSE: Tactic: -4686027666808657977 Time: 1.53135 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TensorRT] VERBOSE: Tactic: -4212163711445252890 Time: 1.48516 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TensorRT] VERBOSE: Tactic: -3898373634979201110 Time: 1.52234 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv1_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TensorRT] VERBOSE: Tactic: -2409163523992614473 Time: 0.749375 [TensorRT] VERBOSE: Fastest Tactic: 5319956359050645452 Time: 0.497395 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5319956359050645452 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(819200,25600,160,1) -> Float(819200,1,5120,32) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.72318 [TensorRT] VERBOSE: Tactic: 0 Time: 1.41021 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 1.41021 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(819200,25600,160,1) -> Half(819200,25600,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.00109 [TensorRT] VERBOSE: Tactic: 0 Time: 0.830104 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.830104 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(819200,25600,160,1) -> Half(409600,25600:2,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.22 [TensorRT] VERBOSE: Tactic: 0 Time: 0.662604 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.662604 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(819200,1,5120,32) -> Float(819200,25600,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.73891 [TensorRT] VERBOSE: Tactic: 0 Time: 2.66255 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 1.73891 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(819200,1,5120,32) -> Half(819200,25600,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.758906 [TensorRT] VERBOSE: Tactic: 0 Time: 2.61297 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.758906 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(819200,1,5120,32) -> Half(409600,25600:2,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.03927 [TensorRT] VERBOSE: Tactic: 0 Time: 2.80135 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 1.03927 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(819200,25600,160,1) -> Float(819200,25600,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.01063 [TensorRT] VERBOSE: Tactic: 0 Time: 0.706719 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.706719 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(819200,25600,160,1) -> Float(819200,1,5120,32) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.714271 [TensorRT] VERBOSE: Tactic: 0 Time: 1.24057 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.714271 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(819200,25600,160,1) -> Half(409600,25600:2,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.684791 [TensorRT] VERBOSE: Tactic: 0 Time: 0.656094 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.656094 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(409600,25600:2,160,1) -> Float(819200,25600,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.99125 [TensorRT] VERBOSE: Tactic: 0 Time: 0.569427 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.569427 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(409600,25600:2,160,1) -> Float(819200,1,5120,32) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.725989 [TensorRT] VERBOSE: Tactic: 0 Time: 1.4175 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.725989 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(409600,25600:2,160,1) -> Half(819200,25600,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.29688 [TensorRT] VERBOSE: Tactic: 0 Time: 0.559167 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.559167 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(819200,25600,160,1) -> Float(819200,25600,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: Tactic: -1 Time: 0.965105 [TensorRT] VERBOSE: Fastest Tactic: -1 Time: 0.965105 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 2.02193 [TensorRT] VERBOSE: Tactic: 1 Time: 2.02078 [TensorRT] VERBOSE: Tactic: 2 Time: 2.59807 [TensorRT] VERBOSE: Tactic: 4 Time: 306.826 [TensorRT] VERBOSE: Tactic: 5 Time: 329.357 [TensorRT] VERBOSE: Tactic: 6 Time: 31.914 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 2.02078 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 16.6049 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [TensorRT] VERBOSE: Tactic: 1754984623894446479 Time: 14.6618 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [TensorRT] VERBOSE: Tactic: 3611739942397549984 Time: 53.9973 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724 [TensorRT] VERBOSE: Tactic: 3827454225649558724 Time: 46.8656 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [TensorRT] VERBOSE: Tactic: 4337000649858996379 Time: 25.2745 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 50.4823 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 24.2847 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 53.5744 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896 [TensorRT] VERBOSE: Tactic: 5921334924264294896 Time: 31.6966 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 24.9201 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 14.5675 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038 [TensorRT] VERBOSE: Tactic: 7852627285308570038 Time: 50.1496 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [TensorRT] VERBOSE: Tactic: -9137461792520977713 Time: 50.9801 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509 [TensorRT] VERBOSE: Tactic: -8776506421218919509 Time: 45.6049 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 55.5004 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [TensorRT] VERBOSE: Tactic: -8133971918129952780 Time: 24.1912 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [TensorRT] VERBOSE: Tactic: -6092040395344634144 Time: 16.8631 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 14.5914 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 15.7932 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239 [TensorRT] VERBOSE: Tactic: -2318106587342035239 Time: 48.0874 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657 [TensorRT] VERBOSE: Tactic: -1343271414618805657 Time: 31.6892 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 24.8404 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 23.8016 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 50.0593 [TensorRT] VERBOSE: Fastest Tactic: 7144526460361122478 Time: 14.5675 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(819200,1,5120,32) -> Float(819200,1,5120,32) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(819200,25600,160,1) -> Half(819200,25600,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 1.10854 [TensorRT] VERBOSE: Tactic: 1 Time: 1.10292 [TensorRT] VERBOSE: Tactic: 2 Time: 47.0563 [TensorRT] VERBOSE: Tactic: 4 Time: 306.948 [TensorRT] VERBOSE: Tactic: 5 Time: 330.176 [TensorRT] VERBOSE: Tactic: 6 Time: 99.2419 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 1.10292 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(409600,25600:2,160,1) -> Half(409600,25600:2,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(819200,25600,160,1) -> Float(819200,1,5120,32) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(819200,25600,160,1) -> Half(819200,25600,160,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(819200,25600,160,1) -> Half(409600,25600:2,160,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(819200,1,5120,32) -> Float(819200,25600,160,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(819200,1,5120,32) -> Half(819200,25600,160,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(819200,1,5120,32) -> Half(409600,25600:2,160,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(819200,25600,160,1) -> Float(819200,25600,160,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(819200,25600,160,1) -> Float(819200,1,5120,32) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(819200,25600,160,1) -> Half(409600,25600:2,160,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(409600,25600:2,160,1) -> Float(819200,25600,160,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(409600,25600:2,160,1) -> Float(819200,1,5120,32) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(409600,25600:2,160,1) -> Half(819200,25600,160,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(819200,25600,160,1) -> Float(409600,25600,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 Time: 1.23412 [TensorRT] VERBOSE: Tactic: 655359 Time: 2.79958 [TensorRT] VERBOSE: Tactic: 786431 Time: 1.795 [TensorRT] VERBOSE: Tactic: 851967 Time: 4.7025 [TensorRT] VERBOSE: Tactic: 1179647 Time: 2.55792 [TensorRT] VERBOSE: Tactic: 1310719 Time: 2.27437 [TensorRT] VERBOSE: Tactic: 1376255 Time: 1.27599 [TensorRT] VERBOSE: Tactic: 1441791 Time: 3.08583 [TensorRT] VERBOSE: Tactic: 1507327 Time: 4.09844 [TensorRT] VERBOSE: Tactic: 1638399 Time: 1.91922 [TensorRT] VERBOSE: Tactic: 1835007 Time: 1.86099 [TensorRT] VERBOSE: Tactic: 1900543 Time: 3.31964 [TensorRT] VERBOSE: Tactic: 2097151 Time: 2.39479 [TensorRT] VERBOSE: Tactic: 2162687 Time: 1.34854 [TensorRT] VERBOSE: Tactic: 2293759 Time: 1.26521 [TensorRT] VERBOSE: Tactic: 2359295 Time: 2.00427 [TensorRT] VERBOSE: Tactic: 2686975 Time: 1.27146 [TensorRT] VERBOSE: Tactic: 3080191 Time: 4.00906 [TensorRT] VERBOSE: Tactic: 3342335 Time: 3.91979 [TensorRT] VERBOSE: Tactic: 3407871 Time: 1.8612 [TensorRT] VERBOSE: Tactic: 3538943 Time: 1.79536 [TensorRT] VERBOSE: Tactic: 3670015 Time: 2.13557 [TensorRT] VERBOSE: Tactic: 3932159 Time: 2.6449 [TensorRT] VERBOSE: Tactic: 3997695 Time: 1.90974 [TensorRT] VERBOSE: Tactic: 4063231 Time: 4.85057 [TensorRT] VERBOSE: Tactic: 4194303 Time: 1.75266 [TensorRT] VERBOSE: Tactic: 4259839 Time: 2.24818 [TensorRT] VERBOSE: Tactic: 4325375 Time: 1.59943 [TensorRT] VERBOSE: Tactic: 4521983 Time: 1.16463 [TensorRT] VERBOSE: Tactic: 4587519 Time: 1.85989 [TensorRT] VERBOSE: Tactic: 4653055 Time: 3.19073 [TensorRT] VERBOSE: Tactic: 4915199 Time: 1.82187 [TensorRT] VERBOSE: Tactic: 4980735 Time: 1.57609 [TensorRT] VERBOSE: Tactic: 5177343 Time: 2.5524 [TensorRT] VERBOSE: Tactic: 5242879 Time: 2.12667 [TensorRT] VERBOSE: Tactic: 5373951 Time: 2.74422 [TensorRT] VERBOSE: Tactic: 5439487 Time: 2.85052 [TensorRT] VERBOSE: Tactic: 5570559 Time: 3.55417 [TensorRT] VERBOSE: Tactic: 5636095 Time: 4.84323 [TensorRT] VERBOSE: Tactic: 5701631 Time: 1.4588 [TensorRT] VERBOSE: Tactic: 5767167 Time: 4.64354 [TensorRT] VERBOSE: Tactic: 5832703 Time: 1.83505 [TensorRT] VERBOSE: Tactic: 5898239 Time: 2.35172 [TensorRT] VERBOSE: Tactic: 6029311 Time: 1.41469 [TensorRT] VERBOSE: Tactic: 6225919 Time: 1.9149 [TensorRT] VERBOSE: Tactic: 6291455 Time: 2.55927 [TensorRT] VERBOSE: Tactic: 6422527 Time: 3.06448 [TensorRT] VERBOSE: Tactic: 6750207 Time: 1.84453 [TensorRT] VERBOSE: Tactic: 6815743 Time: 2.66333 [TensorRT] VERBOSE: Tactic: 6946815 Time: 2.72333 [TensorRT] VERBOSE: Tactic: 7012351 Time: 2.40448 [TensorRT] VERBOSE: Tactic: 7077887 Time: 1.79625 [TensorRT] VERBOSE: Tactic: 7143423 Time: 1.98474 [TensorRT] VERBOSE: Tactic: 7208959 Time: 2.10349 [TensorRT] VERBOSE: Tactic: 7340031 Time: 2.27604 [TensorRT] VERBOSE: Tactic: 7405567 Time: 2.42531 [TensorRT] VERBOSE: Tactic: 7536639 Time: 1.77463 [TensorRT] VERBOSE: Tactic: 7602175 Time: 1.76609 [TensorRT] VERBOSE: Tactic: 7733247 Time: 2.26281 [TensorRT] VERBOSE: Tactic: 7798783 Time: 1.79583 [TensorRT] VERBOSE: Tactic: 8191999 Time: 2.1424 [TensorRT] VERBOSE: Tactic: 8257535 Time: 1.85203 [TensorRT] VERBOSE: Tactic: 8323071 Time: 1.95792 [TensorRT] VERBOSE: Tactic: 8650751 Time: 1.98984 [TensorRT] VERBOSE: Tactic: 8716287 Time: 2.59088 [TensorRT] VERBOSE: Tactic: 9109503 Time: 2.4049 [TensorRT] VERBOSE: Tactic: 9568255 Time: 1.8175 [TensorRT] VERBOSE: Tactic: 9895935 Time: 1.7424 [TensorRT] VERBOSE: Tactic: 10223615 Time: 1.2725 [TensorRT] VERBOSE: Tactic: 10354687 Time: 1.85281 [TensorRT] VERBOSE: Tactic: 10551295 Time: 1.32536 [TensorRT] VERBOSE: Tactic: 10747903 Time: 2.20167 [TensorRT] VERBOSE: Tactic: 10944511 Time: 1.58224 [TensorRT] VERBOSE: Fastest Tactic: 4521983 Time: 1.16463 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 1.0651 [TensorRT] VERBOSE: Tactic: 1 Time: 0.892864 [TensorRT] VERBOSE: Tactic: 2 Time: 2.89677 [TensorRT] VERBOSE: Tactic: 4 Time: 92.1674 [TensorRT] VERBOSE: Tactic: 5 Time: 2.79573 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.892864 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 0.736979 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TensorRT] VERBOSE: Tactic: 1698681053543049347 Time: 0.647865 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 2.05984 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 1.05115 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 2.16026 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TensorRT] VERBOSE: Tactic: 5326823351883942011 Time: 2.00526 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TensorRT] VERBOSE: Tactic: 5500448035057547314 Time: 1.08386 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 1.03656 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 0.69901 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 2.21177 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TensorRT] VERBOSE: Tactic: -6576203419454146580 Time: 0.663281 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 0.725052 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 0.685989 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 1.12688 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 1.11635 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 2.05011 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TensorRT] VERBOSE: Tactic: -377491875521947884 Time: 2.15901 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TensorRT] VERBOSE: Tactic: -37215280111360163 Time: 1.00271 [TensorRT] VERBOSE: Fastest Tactic: 1698681053543049347 Time: 0.647865 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1698681053543049347 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(819200,1,5120,32) -> Float(409600,1,2560,16) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TensorRT] VERBOSE: Tactic: 3886731678879822788 Time: 1.29729 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TensorRT] VERBOSE: Tactic: 6629944304117643200 Time: 2.05307 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TensorRT] VERBOSE: Tactic: -9153228964338181824 Time: 2.07047 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TensorRT] VERBOSE: Tactic: -7394439838318485025 Time: 1.30818 [TensorRT] VERBOSE: Fastest Tactic: 3886731678879822788 Time: 1.29729 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(819200,25600,160,1) -> Half(409600,25600,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 1.08625 [TensorRT] VERBOSE: Tactic: 1 Time: 0.891146 [TensorRT] VERBOSE: Tactic: 2 Time: 3.00682 [TensorRT] VERBOSE: Tactic: 4 Time: 92.3918 [TensorRT] VERBOSE: Tactic: 5 Time: 2.64026 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.891146 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(409600,25600:2,160,1) -> Half(409600,25600,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(409600,25600:2,160,1) -> Half(204800,25600:2,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 Time: 0.624375 [TensorRT] VERBOSE: Tactic: 655359 Time: 2.0863 [TensorRT] VERBOSE: Tactic: 786431 Time: 1.33958 [TensorRT] VERBOSE: Tactic: 851967 Time: 4.10437 [TensorRT] VERBOSE: Tactic: 1179647 Time: 2.05771 [TensorRT] VERBOSE: Tactic: 1310719 Time: 1.17432 [TensorRT] VERBOSE: Tactic: 1376255 Time: 0.77625 [TensorRT] VERBOSE: Tactic: 1441791 Time: 2.49516 [TensorRT] VERBOSE: Tactic: 1507327 Time: 3.11594 [TensorRT] VERBOSE: Tactic: 1638399 Time: 1.3099 [TensorRT] VERBOSE: Tactic: 1835007 Time: 1.20312 [TensorRT] VERBOSE: Tactic: 1900543 Time: 2.45703 [TensorRT] VERBOSE: Tactic: 2162687 Time: 1.00984 [TensorRT] VERBOSE: Tactic: 2293759 Time: 0.879635 [TensorRT] VERBOSE: Tactic: 2359295 Time: 1.40984 [TensorRT] VERBOSE: Tactic: 2686975 Time: 1.17588 [TensorRT] VERBOSE: Tactic: 3080191 Time: 2.84562 [TensorRT] VERBOSE: Tactic: 3342335 Time: 3.09432 [TensorRT] VERBOSE: Tactic: 3407871 Time: 1.20615 [TensorRT] VERBOSE: Tactic: 3538943 Time: 1.48594 [TensorRT] VERBOSE: Tactic: 3670015 Time: 1.54469 [TensorRT] VERBOSE: Tactic: 3932159 Time: 1.94641 [TensorRT] VERBOSE: Tactic: 3997695 Time: 1.55531 [TensorRT] VERBOSE: Tactic: 4063231 Time: 4.11552 [TensorRT] VERBOSE: Tactic: 4194303 Time: 1.2538 [TensorRT] VERBOSE: Tactic: 4325375 Time: 1.0063 [TensorRT] VERBOSE: Tactic: 4521983 Time: 0.656302 [TensorRT] VERBOSE: Tactic: 4587519 Time: 1.50755 [TensorRT] VERBOSE: Tactic: 4653055 Time: 2.67641 [TensorRT] VERBOSE: Tactic: 4915199 Time: 1.44151 [TensorRT] VERBOSE: Tactic: 4980735 Time: 0.929166 [TensorRT] VERBOSE: Tactic: 5177343 Time: 2.04214 [TensorRT] VERBOSE: Tactic: 5242879 Time: 1.16766 [TensorRT] VERBOSE: Tactic: 5373951 Time: 2.07792 [TensorRT] VERBOSE: Tactic: 5439487 Time: 1.56651 [TensorRT] VERBOSE: Tactic: 5570559 Time: 3.19323 [TensorRT] VERBOSE: Tactic: 5636095 Time: 4.11328 [TensorRT] VERBOSE: Tactic: 5701631 Time: 0.842188 [TensorRT] VERBOSE: Tactic: 5767167 Time: 2.19307 [TensorRT] VERBOSE: Tactic: 5832703 Time: 1.16932 [TensorRT] VERBOSE: Tactic: 5898239 Time: 2.55177 [TensorRT] VERBOSE: Tactic: 6029311 Time: 0.963594 [TensorRT] VERBOSE: Tactic: 6225919 Time: 1.45026 [TensorRT] VERBOSE: Tactic: 6291455 Time: 2.05646 [TensorRT] VERBOSE: Tactic: 6422527 Time: 2.39474 [TensorRT] VERBOSE: Tactic: 6750207 Time: 1.23969 [TensorRT] VERBOSE: Tactic: 6815743 Time: 1.53271 [TensorRT] VERBOSE: Tactic: 6946815 Time: 1.42693 [TensorRT] VERBOSE: Tactic: 7077887 Time: 1.40167 [TensorRT] VERBOSE: Tactic: 7143423 Time: 1.07714 [TensorRT] VERBOSE: Tactic: 7208959 Time: 1.19667 [TensorRT] VERBOSE: Tactic: 7340031 Time: 2.4737 [TensorRT] VERBOSE: Tactic: 7405567 Time: 1.92938 [TensorRT] VERBOSE: Tactic: 7536639 Time: 1.07776 [TensorRT] VERBOSE: Tactic: 7602175 Time: 1.05854 [TensorRT] VERBOSE: Tactic: 7733247 Time: 1.73422 [TensorRT] VERBOSE: Tactic: 7798783 Time: 1.31156 [TensorRT] VERBOSE: Tactic: 8191999 Time: 1.18672 [TensorRT] VERBOSE: Tactic: 8257535 Time: 1.43193 [TensorRT] VERBOSE: Tactic: 8323071 Time: 1.13214 [TensorRT] VERBOSE: Tactic: 8650751 Time: 1.13463 [TensorRT] VERBOSE: Tactic: 8716287 Time: 1.45234 [TensorRT] VERBOSE: Tactic: 9568255 Time: 1.43797 [TensorRT] VERBOSE: Tactic: 9895935 Time: 1.25214 [TensorRT] VERBOSE: Tactic: 10223615 Time: 1.17495 [TensorRT] VERBOSE: Tactic: 10354687 Time: 1.86568 [TensorRT] VERBOSE: Tactic: 10551295 Time: 0.693385 [TensorRT] VERBOSE: Tactic: 10747903 Time: 1.71229 [TensorRT] VERBOSE: Tactic: 10944511 Time: 0.931666 [TensorRT] VERBOSE: Fastest Tactic: 589823 Time: 0.624375 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TensorRT] VERBOSE: Tactic: 3066127711859985668 Time: 0.422344 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TensorRT] VERBOSE: Tactic: 3564772625446233998 Time: 0.437708 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TensorRT] VERBOSE: Tactic: 5319956359050645452 Time: 0.43198 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TensorRT] VERBOSE: Tactic: 7205456024582378848 Time: 0.647083 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TensorRT] VERBOSE: Tactic: 8163473458334948789 Time: 0.634219 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TensorRT] VERBOSE: Tactic: -4212163711445252890 Time: 1.24479 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TensorRT] VERBOSE: Tactic: -3898373634979201110 Time: 1.26276 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TensorRT] VERBOSE: Tactic: -2409163523992614473 Time: 0.640469 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/expanded_conv_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TensorRT] VERBOSE: Tactic: -1716393687483585322 Time: 1.22031 [TensorRT] VERBOSE: Fastest Tactic: 3066127711859985668 Time: 0.422344 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3066127711859985668 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(409600,25600,160,1) -> Float(409600,1,2560,16) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.69438 [TensorRT] VERBOSE: Tactic: 0 Time: 0.601146 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.601146 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(409600,25600,160,1) -> Half(409600,25600,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.505833 [TensorRT] VERBOSE: Tactic: 0 Time: 0.420938 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.420938 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(409600,25600,160,1) -> Half(204800,25600:2,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.849271 [TensorRT] VERBOSE: Tactic: 0 Time: 0.335364 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.335364 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(409600,1,2560,16) -> Float(409600,25600,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.68396 [TensorRT] VERBOSE: Tactic: 0 Time: 0.686875 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.686875 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(409600,1,2560,16) -> Half(409600,25600,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.835729 [TensorRT] VERBOSE: Tactic: 0 Time: 0.664219 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.664219 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(409600,1,2560,16) -> Half(204800,25600:2,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.864792 [TensorRT] VERBOSE: Tactic: 0 Time: 0.75474 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.75474 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(409600,25600,160,1) -> Float(409600,25600,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.51125 [TensorRT] VERBOSE: Tactic: 0 Time: 0.356667 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.356667 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(409600,25600,160,1) -> Float(409600,1,2560,16) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.799167 [TensorRT] VERBOSE: Tactic: 0 Time: 0.610677 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.610677 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(409600,25600,160,1) -> Half(204800,25600:2,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.344115 [TensorRT] VERBOSE: Tactic: 0 Time: 0.331355 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.331355 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,25600:2,160,1) -> Float(409600,25600,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.806771 [TensorRT] VERBOSE: Tactic: 0 Time: 0.289687 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.289687 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,25600:2,160,1) -> Float(409600,1,2560,16) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.817188 [TensorRT] VERBOSE: Tactic: 0 Time: 0.713958 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.713958 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,25600:2,160,1) -> Half(409600,25600,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.21682 [TensorRT] VERBOSE: Tactic: 0 Time: 0.28349 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.28349 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(409600,25600,160,1) -> Float(2457600,25600,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 6.60745 [TensorRT] VERBOSE: Tactic: 1 Time: 3.97422 [TensorRT] VERBOSE: Tactic: 2 Time: 4.95052 [TensorRT] ERROR: Tactic Device request: 793MB Available: 498MB. Device memory is insufficient to use tactic. [TensorRT] WARNING: Skipping tactic 3 due to oom error on requested size of 793 detected for tactic 4. Try decreasing the workspace size with IBuilderConfig::setMaxWorkspaceSize(). [TensorRT] VERBOSE: Tactic: 5 Time: 6.68588 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 3.97422 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 1.6337 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TensorRT] VERBOSE: Tactic: 1698681053543049347 Time: 1.4238 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 1.6526 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 1.5824 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 1.74469 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TensorRT] VERBOSE: Tactic: 5326823351883942011 Time: 1.60417 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TensorRT] VERBOSE: Tactic: 5500448035057547314 Time: 1.71359 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 1.60557 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 1.57917 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 1.75693 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TensorRT] VERBOSE: Tactic: -6576203419454146580 Time: 1.56052 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 1.625 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 1.59292 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 1.7713 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 1.75703 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 1.65573 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TensorRT] VERBOSE: Tactic: -377491875521947884 Time: 1.71333 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TensorRT] VERBOSE: Tactic: -37215280111360163 Time: 1.57052 [TensorRT] VERBOSE: Fastest Tactic: 1698681053543049347 Time: 1.4238 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1698681053543049347 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(409600,1,2560,16) -> Float(2457600,1,15360,96) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TensorRT] VERBOSE: Tactic: 3886731678879822788 Time: 2.2999 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TensorRT] VERBOSE: Tactic: 6629944304117643200 Time: 5.92844 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TensorRT] VERBOSE: Tactic: -9153228964338181824 Time: 5.99068 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TensorRT] VERBOSE: Tactic: -7394439838318485025 Time: 2.3449 [TensorRT] VERBOSE: Fastest Tactic: 3886731678879822788 Time: 2.2999 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(409600,25600,160,1) -> Half(2457600,25600,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 3.97312 [TensorRT] VERBOSE: Tactic: 1 Time: 3.65563 [TensorRT] VERBOSE: Tactic: 2 Time: 4.05781 [TensorRT] ERROR: Tactic Device request: 787MB Available: 498MB. Device memory is insufficient to use tactic. [TensorRT] WARNING: Skipping tactic 3 due to oom error on requested size of 787 detected for tactic 4. Try decreasing the workspace size with IBuilderConfig::setMaxWorkspaceSize(). [TensorRT] VERBOSE: Tactic: 5 Time: 6.01318 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 3.65563 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(204800,25600:2,160,1) -> Half(2457600,25600,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(204800,25600:2,160,1) -> Half(1228800,25600:2,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TensorRT] VERBOSE: Tactic: 3066127711859985668 Time: 1.03255 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TensorRT] VERBOSE: Tactic: 3564772625446233998 Time: 1.06854 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TensorRT] VERBOSE: Tactic: 5319956359050645452 Time: 1.0401 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TensorRT] VERBOSE: Tactic: 7205456024582378848 Time: 1.05385 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TensorRT] VERBOSE: Tactic: 8163473458334948789 Time: 1.02042 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TensorRT] VERBOSE: Tactic: -4212163711445252890 Time: 1.06594 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TensorRT] VERBOSE: Tactic: -3898373634979201110 Time: 1.0863 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TensorRT] VERBOSE: Tactic: -2409163523992614473 Time: 1.04833 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TensorRT] VERBOSE: Tactic: -1716393687483585322 Time: 1.0488 [TensorRT] VERBOSE: Fastest Tactic: 8163473458334948789 Time: 1.02042 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8163473458334948789 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2457600,25600,160,1) -> Float(2457600,1,15360,96) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 3.37828 [TensorRT] VERBOSE: Tactic: 0 Time: 4.43708 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 3.37828 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2457600,25600,160,1) -> Half(2457600,25600,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.98302 [TensorRT] VERBOSE: Tactic: 0 Time: 2.46755 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 2.46755 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2457600,25600,160,1) -> Half(1228800,25600:2,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 3.65677 [TensorRT] VERBOSE: Tactic: 0 Time: 1.97359 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 1.97359 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2457600,1,15360,96) -> Float(2457600,25600,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 3.67094 [TensorRT] VERBOSE: Tactic: 0 Time: 8.6925 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 3.67094 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2457600,1,15360,96) -> Half(2457600,25600,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.26021 [TensorRT] VERBOSE: Tactic: 0 Time: 8.66995 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 2.26021 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2457600,1,15360,96) -> Half(1228800,25600:2,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 3.14599 [TensorRT] VERBOSE: Tactic: 0 Time: 8.96974 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 3.14599 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(2457600,25600,160,1) -> Float(2457600,25600,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 3.0126 [TensorRT] VERBOSE: Tactic: 0 Time: 2.10635 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 2.10635 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(2457600,25600,160,1) -> Float(2457600,1,15360,96) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.11583 [TensorRT] VERBOSE: Tactic: 0 Time: 3.81797 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 2.11583 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(2457600,25600,160,1) -> Half(1228800,25600:2,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.0362 [TensorRT] VERBOSE: Tactic: 0 Time: 1.95495 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 1.95495 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1228800,25600:2,160,1) -> Float(2457600,25600,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.94948 [TensorRT] VERBOSE: Tactic: 0 Time: 1.69349 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 1.69349 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1228800,25600:2,160,1) -> Float(2457600,1,15360,96) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.15266 [TensorRT] VERBOSE: Tactic: 0 Time: 4.2374 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 2.15266 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1228800,25600:2,160,1) -> Half(2457600,25600,160,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 4.55146 [TensorRT] VERBOSE: Tactic: 0 Time: 1.66036 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 1.66036 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(2457600,25600,160,1) -> Float(614400,6400,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: Tactic: -1 Time: 1.57943 [TensorRT] VERBOSE: Fastest Tactic: -1 Time: 1.57943 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 4.07344 [TensorRT] VERBOSE: Tactic: 1 Time: 4.08568 [TensorRT] VERBOSE: Tactic: 2 Time: 4.08187 [TensorRT] VERBOSE: Tactic: 5 Time: 989.024 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 4.07344 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 12.9897 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [TensorRT] VERBOSE: Tactic: 1754984623894446479 Time: 11.7352 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [TensorRT] VERBOSE: Tactic: 3611739942397549984 Time: 41.0885 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [TensorRT] VERBOSE: Tactic: 4337000649858996379 Time: 20.0884 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 38.3688 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 18.8142 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 42.1435 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 19.9283 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 11.2725 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [TensorRT] VERBOSE: Tactic: -9137461792520977713 Time: 38.7908 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 41.1137 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [TensorRT] VERBOSE: Tactic: -8133971918129952780 Time: 19.3087 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [TensorRT] VERBOSE: Tactic: -6092040395344634144 Time: 13.2615 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 11.7204 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 12.4734 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 19.2583 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 18.5464 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 39.2376 [TensorRT] VERBOSE: Fastest Tactic: 7144526460361122478 Time: 11.2725 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(2457600,1,15360,96) -> Float(614400,1,7680,96) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(2457600,25600,160,1) -> Half(614400,6400,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 3.56953 [TensorRT] VERBOSE: Tactic: 1 Time: 3.56234 [TensorRT] VERBOSE: Tactic: 2 Time: 4.06198 [TensorRT] VERBOSE: Tactic: 5 Time: 988.728 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 3.56234 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(1228800,25600:2,160,1) -> Half(307200,6400:2,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(614400,6400,80,1) -> Float(614400,1,7680,96) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.856563 [TensorRT] VERBOSE: Tactic: 0 Time: 1.09479 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.856563 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(614400,6400,80,1) -> Half(614400,6400,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.778489 [TensorRT] VERBOSE: Tactic: 0 Time: 0.625886 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.625886 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(614400,6400,80,1) -> Half(307200,6400:2,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.922396 [TensorRT] VERBOSE: Tactic: 0 Time: 0.498594 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.498594 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(614400,1,7680,96) -> Float(614400,6400,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.945157 [TensorRT] VERBOSE: Tactic: 0 Time: 2.17401 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.945157 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(614400,1,7680,96) -> Half(614400,6400,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.572292 [TensorRT] VERBOSE: Tactic: 0 Time: 2.17198 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.572292 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(614400,1,7680,96) -> Half(307200,6400:2,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.788229 [TensorRT] VERBOSE: Tactic: 0 Time: 2.24646 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.788229 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(614400,6400,80,1) -> Float(614400,6400,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.788281 [TensorRT] VERBOSE: Tactic: 0 Time: 0.531354 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.531354 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(614400,6400,80,1) -> Float(614400,1,7680,96) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.538229 [TensorRT] VERBOSE: Tactic: 0 Time: 0.930313 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.538229 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(614400,6400,80,1) -> Half(307200,6400:2,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.523593 [TensorRT] VERBOSE: Tactic: 0 Time: 0.494427 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.494427 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(307200,6400:2,80,1) -> Float(614400,6400,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.738958 [TensorRT] VERBOSE: Tactic: 0 Time: 0.428594 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.428594 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(307200,6400:2,80,1) -> Float(614400,1,7680,96) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.546146 [TensorRT] VERBOSE: Tactic: 0 Time: 1.06552 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.546146 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(307200,6400:2,80,1) -> Half(614400,6400,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.12656 [TensorRT] VERBOSE: Tactic: 0 Time: 0.420313 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.420313 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(614400,6400,80,1) -> Float(153600,6400,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 Time: 0.71 [TensorRT] VERBOSE: Tactic: 655359 Time: 1.33786 [TensorRT] VERBOSE: Tactic: 786431 Time: 0.847604 [TensorRT] VERBOSE: Tactic: 851967 Time: 2.11224 [TensorRT] VERBOSE: Tactic: 1179647 Time: 1.17349 [TensorRT] VERBOSE: Tactic: 1310719 Time: 1.30375 [TensorRT] VERBOSE: Tactic: 1376255 Time: 0.771614 [TensorRT] VERBOSE: Tactic: 1441791 Time: 1.35182 [TensorRT] VERBOSE: Tactic: 1507327 Time: 1.93412 [TensorRT] VERBOSE: Tactic: 1638399 Time: 0.891459 [TensorRT] VERBOSE: Tactic: 1835007 Time: 0.876719 [TensorRT] VERBOSE: Tactic: 1900543 Time: 1.85307 [TensorRT] VERBOSE: Tactic: 2097151 Time: 1.0274 [TensorRT] VERBOSE: Tactic: 2162687 Time: 0.809948 [TensorRT] VERBOSE: Tactic: 2293759 Time: 0.756927 [TensorRT] VERBOSE: Tactic: 2359295 Time: 0.932656 [TensorRT] VERBOSE: Tactic: 2686975 Time: 0.753177 [TensorRT] VERBOSE: Tactic: 3080191 Time: 1.83864 [TensorRT] VERBOSE: Tactic: 3342335 Time: 1.97083 [TensorRT] VERBOSE: Tactic: 3407871 Time: 0.859844 [TensorRT] VERBOSE: Tactic: 3538943 Time: 0.884635 [TensorRT] VERBOSE: Tactic: 3670015 Time: 1.18776 [TensorRT] VERBOSE: Tactic: 3932159 Time: 1.63266 [TensorRT] VERBOSE: Tactic: 3997695 Time: 0.851875 [TensorRT] VERBOSE: Tactic: 4063231 Time: 2.2249 [TensorRT] VERBOSE: Tactic: 4194303 Time: 0.823437 [TensorRT] VERBOSE: Tactic: 4259839 Time: 0.981406 [TensorRT] VERBOSE: Tactic: 4325375 Time: 0.780625 [TensorRT] VERBOSE: Tactic: 4521983 Time: 0.668697 [TensorRT] VERBOSE: Tactic: 4587519 Time: 0.819167 [TensorRT] VERBOSE: Tactic: 4653055 Time: 1.31349 [TensorRT] VERBOSE: Tactic: 4915199 Time: 0.857917 [TensorRT] VERBOSE: Tactic: 4980735 Time: 0.79375 [TensorRT] VERBOSE: Tactic: 5177343 Time: 1.18229 [TensorRT] VERBOSE: Tactic: 5242879 Time: 0.993958 [TensorRT] VERBOSE: Tactic: 5373951 Time: 1.60542 [TensorRT] VERBOSE: Tactic: 5439487 Time: 1.4275 [TensorRT] VERBOSE: Tactic: 5570559 Time: 1.58542 [TensorRT] VERBOSE: Tactic: 5636095 Time: 2.22536 [TensorRT] VERBOSE: Tactic: 5701631 Time: 0.915573 [TensorRT] VERBOSE: Tactic: 5767167 Time: 3.14203 [TensorRT] VERBOSE: Tactic: 5832703 Time: 0.887031 [TensorRT] VERBOSE: Tactic: 5898239 Time: 1.03823 [TensorRT] VERBOSE: Tactic: 6029311 Time: 0.895416 [TensorRT] VERBOSE: Tactic: 6225919 Time: 0.992396 [TensorRT] VERBOSE: Tactic: 6291455 Time: 1.1725 [TensorRT] VERBOSE: Tactic: 6422527 Time: 1.73693 [TensorRT] VERBOSE: Tactic: 6750207 Time: 0.902605 [TensorRT] VERBOSE: Tactic: 6815743 Time: 1.4424 [TensorRT] VERBOSE: Tactic: 6946815 Time: 1.34547 [TensorRT] VERBOSE: Tactic: 7012351 Time: 1.03271 [TensorRT] VERBOSE: Tactic: 7077887 Time: 0.915886 [TensorRT] VERBOSE: Tactic: 7143423 Time: 1.17036 [TensorRT] VERBOSE: Tactic: 7208959 Time: 0.97276 [TensorRT] VERBOSE: Tactic: 7340031 Time: 1.0187 [TensorRT] VERBOSE: Tactic: 7405567 Time: 1.20438 [TensorRT] VERBOSE: Tactic: 7536639 Time: 1.16359 [TensorRT] VERBOSE: Tactic: 7602175 Time: 0.861614 [TensorRT] VERBOSE: Tactic: 7733247 Time: 1.08776 [TensorRT] VERBOSE: Tactic: 7798783 Time: 0.843542 [TensorRT] VERBOSE: Tactic: 8191999 Time: 1.10812 [TensorRT] VERBOSE: Tactic: 8257535 Time: 0.871459 [TensorRT] VERBOSE: Tactic: 8323071 Time: 0.926042 [TensorRT] VERBOSE: Tactic: 8650751 Time: 0.979584 [TensorRT] VERBOSE: Tactic: 8716287 Time: 1.42927 [TensorRT] VERBOSE: Tactic: 9109503 Time: 1.06776 [TensorRT] VERBOSE: Tactic: 9568255 Time: 0.861823 [TensorRT] VERBOSE: Tactic: 9895935 Time: 0.828178 [TensorRT] VERBOSE: Tactic: 10223615 Time: 0.752447 [TensorRT] VERBOSE: Tactic: 10354687 Time: 0.895625 [TensorRT] VERBOSE: Tactic: 10551295 Time: 0.747344 [TensorRT] VERBOSE: Tactic: 10747903 Time: 1.06604 [TensorRT] VERBOSE: Tactic: 10944511 Time: 0.788437 [TensorRT] VERBOSE: Fastest Tactic: 4521983 Time: 0.668697 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.569688 [TensorRT] VERBOSE: Tactic: 1 Time: 0.474062 [TensorRT] VERBOSE: Tactic: 2 Time: 1.78578 [TensorRT] VERBOSE: Tactic: 4 Time: 86.7289 [TensorRT] VERBOSE: Tactic: 5 Time: 2.14479 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.474062 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 0.385104 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TensorRT] VERBOSE: Tactic: 1698681053543049347 Time: 0.351458 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 1.04073 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 0.533646 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 1.05896 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TensorRT] VERBOSE: Tactic: 5326823351883942011 Time: 1.02776 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TensorRT] VERBOSE: Tactic: 5500448035057547314 Time: 0.583229 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 0.541979 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 0.374322 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 1.07318 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TensorRT] VERBOSE: Tactic: -6576203419454146580 Time: 0.341719 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 0.382343 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 0.353125 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 0.581146 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 0.585833 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 1.03807 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TensorRT] VERBOSE: Tactic: -377491875521947884 Time: 1.05141 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TensorRT] VERBOSE: Tactic: -37215280111360163 Time: 0.511198 [TensorRT] VERBOSE: Fastest Tactic: -6576203419454146580 Time: 0.341719 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6576203419454146580 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(614400,1,7680,96) -> Float(153600,1,1920,24) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TensorRT] VERBOSE: Tactic: 3886731678879822788 Time: 0.591875 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TensorRT] VERBOSE: Tactic: 6629944304117643200 Time: 0.700677 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TensorRT] VERBOSE: Tactic: -9153228964338181824 Time: 0.710677 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TensorRT] VERBOSE: Tactic: -7394439838318485025 Time: 0.579688 [TensorRT] VERBOSE: Fastest Tactic: -7394439838318485025 Time: 0.579688 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(614400,6400,80,1) -> Half(153600,6400,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.572708 [TensorRT] VERBOSE: Tactic: 1 Time: 0.481041 [TensorRT] VERBOSE: Tactic: 2 Time: 1.77203 [TensorRT] VERBOSE: Tactic: 4 Time: 86.8465 [TensorRT] VERBOSE: Tactic: 5 Time: 2.07703 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.481041 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(307200,6400:2,80,1) -> Half(153600,6400,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(307200,6400:2,80,1) -> Half(76800,6400:2,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 Time: 0.351093 [TensorRT] VERBOSE: Tactic: 655359 Time: 1.00948 [TensorRT] VERBOSE: Tactic: 786431 Time: 0.551146 [TensorRT] VERBOSE: Tactic: 851967 Time: 1.49495 [TensorRT] VERBOSE: Tactic: 1179647 Time: 0.758333 [TensorRT] VERBOSE: Tactic: 1310719 Time: 0.675937 [TensorRT] VERBOSE: Tactic: 1376255 Time: 0.427396 [TensorRT] VERBOSE: Tactic: 1441791 Time: 0.904479 [TensorRT] VERBOSE: Tactic: 1507327 Time: 1.26844 [TensorRT] VERBOSE: Tactic: 1638399 Time: 0.509167 [TensorRT] VERBOSE: Tactic: 1835007 Time: 0.519948 [TensorRT] VERBOSE: Tactic: 1900543 Time: 1.13719 [TensorRT] VERBOSE: Tactic: 2162687 Time: 0.500417 [TensorRT] VERBOSE: Tactic: 2293759 Time: 0.453802 [TensorRT] VERBOSE: Tactic: 2359295 Time: 0.584219 [TensorRT] VERBOSE: Tactic: 2686975 Time: 0.72526 [TensorRT] VERBOSE: Tactic: 3080191 Time: 1.23563 [TensorRT] VERBOSE: Tactic: 3342335 Time: 1.28354 [TensorRT] VERBOSE: Tactic: 3407871 Time: 0.526093 [TensorRT] VERBOSE: Tactic: 3538943 Time: 0.59849 [TensorRT] VERBOSE: Tactic: 3670015 Time: 0.828959 [TensorRT] VERBOSE: Tactic: 3932159 Time: 0.875469 [TensorRT] VERBOSE: Tactic: 3997695 Time: 0.573125 [TensorRT] VERBOSE: Tactic: 4063231 Time: 1.58828 [TensorRT] VERBOSE: Tactic: 4194303 Time: 0.510052 [TensorRT] VERBOSE: Tactic: 4325375 Time: 0.416458 [TensorRT] VERBOSE: Tactic: 4521983 Time: 0.354479 [TensorRT] VERBOSE: Tactic: 4587519 Time: 0.533334 [TensorRT] VERBOSE: Tactic: 4653055 Time: 0.913646 [TensorRT] VERBOSE: Tactic: 4915199 Time: 0.538282 [TensorRT] VERBOSE: Tactic: 4980735 Time: 0.410104 [TensorRT] VERBOSE: Tactic: 5177343 Time: 0.73448 [TensorRT] VERBOSE: Tactic: 5242879 Time: 0.561562 [TensorRT] VERBOSE: Tactic: 5373951 Time: 0.785313 [TensorRT] VERBOSE: Tactic: 5439487 Time: 0.768125 [TensorRT] VERBOSE: Tactic: 5570559 Time: 1.37089 [TensorRT] VERBOSE: Tactic: 5636095 Time: 1.58583 [TensorRT] VERBOSE: Tactic: 5701631 Time: 0.447864 [TensorRT] VERBOSE: Tactic: 5767167 Time: 1.47104 [TensorRT] VERBOSE: Tactic: 5832703 Time: 0.524739 [TensorRT] VERBOSE: Tactic: 5898239 Time: 0.915938 [TensorRT] VERBOSE: Tactic: 6029311 Time: 0.521823 [TensorRT] VERBOSE: Tactic: 6225919 Time: 0.624323 [TensorRT] VERBOSE: Tactic: 6291455 Time: 0.743177 [TensorRT] VERBOSE: Tactic: 6422527 Time: 1.11557 [TensorRT] VERBOSE: Tactic: 6750207 Time: 0.534844 [TensorRT] VERBOSE: Tactic: 6815743 Time: 0.826042 [TensorRT] VERBOSE: Tactic: 6946815 Time: 0.698646 [TensorRT] VERBOSE: Tactic: 7077887 Time: 0.58125 [TensorRT] VERBOSE: Tactic: 7143423 Time: 0.61901 [TensorRT] VERBOSE: Tactic: 7208959 Time: 0.544427 [TensorRT] VERBOSE: Tactic: 7340031 Time: 0.90651 [TensorRT] VERBOSE: Tactic: 7405567 Time: 0.772188 [TensorRT] VERBOSE: Tactic: 7536639 Time: 0.648229 [TensorRT] VERBOSE: Tactic: 7602175 Time: 0.456302 [TensorRT] VERBOSE: Tactic: 7733247 Time: 0.700625 [TensorRT] VERBOSE: Tactic: 7798783 Time: 0.537396 [TensorRT] VERBOSE: Tactic: 8191999 Time: 0.577552 [TensorRT] VERBOSE: Tactic: 8257535 Time: 0.544479 [TensorRT] VERBOSE: Tactic: 8323071 Time: 0.531667 [TensorRT] VERBOSE: Tactic: 8650751 Time: 0.515105 [TensorRT] VERBOSE: Tactic: 8716287 Time: 0.777083 [TensorRT] VERBOSE: Tactic: 9568255 Time: 0.538386 [TensorRT] VERBOSE: Tactic: 9895935 Time: 0.508333 [TensorRT] VERBOSE: Tactic: 10223615 Time: 0.721615 [TensorRT] VERBOSE: Tactic: 10354687 Time: 0.653541 [TensorRT] VERBOSE: Tactic: 10551295 Time: 0.370052 [TensorRT] VERBOSE: Tactic: 10747903 Time: 0.687083 [TensorRT] VERBOSE: Tactic: 10944511 Time: 0.409479 [TensorRT] VERBOSE: Fastest Tactic: 589823 Time: 0.351093 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TensorRT] VERBOSE: Tactic: 3066127711859985668 Time: 0.194322 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TensorRT] VERBOSE: Tactic: 3564772625446233998 Time: 0.206979 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TensorRT] VERBOSE: Tactic: 5319956359050645452 Time: 0.201094 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TensorRT] VERBOSE: Tactic: 7205456024582378848 Time: 0.300104 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TensorRT] VERBOSE: Tactic: 8163473458334948789 Time: 0.291146 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TensorRT] VERBOSE: Tactic: -4212163711445252890 Time: 0.568958 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TensorRT] VERBOSE: Tactic: -3898373634979201110 Time: 0.58026 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TensorRT] VERBOSE: Tactic: -2409163523992614473 Time: 0.295417 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_1_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TensorRT] VERBOSE: Tactic: -1716393687483585322 Time: 0.560052 [TensorRT] VERBOSE: Fastest Tactic: 3066127711859985668 Time: 0.194322 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3066127711859985668 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,6400,80,1) -> Float(153600,1,1920,24) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.426927 [TensorRT] VERBOSE: Tactic: 0 Time: 0.230468 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.230468 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,6400,80,1) -> Half(153600,6400,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.200885 [TensorRT] VERBOSE: Tactic: 0 Time: 0.162135 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.162135 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,6400,80,1) -> Half(76800,6400:2,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.222344 [TensorRT] VERBOSE: Tactic: 0 Time: 0.129896 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.129896 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,1,1920,24) -> Float(153600,6400,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.430678 [TensorRT] VERBOSE: Tactic: 0 Time: 0.476666 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.430678 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,1,1920,24) -> Half(153600,6400,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.221198 [TensorRT] VERBOSE: Tactic: 0 Time: 0.464583 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.221198 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,1,1920,24) -> Half(76800,6400:2,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.223802 [TensorRT] VERBOSE: Tactic: 0 Time: 0.506563 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.223802 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,6400,80,1) -> Float(153600,6400,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.203437 [TensorRT] VERBOSE: Tactic: 0 Time: 0.138594 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.138594 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,6400,80,1) -> Float(153600,1,1920,24) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.207656 [TensorRT] VERBOSE: Tactic: 0 Time: 0.233959 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.207656 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,6400,80,1) -> Half(76800,6400:2,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.170885 [TensorRT] VERBOSE: Tactic: 0 Time: 0.129062 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.129062 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,6400:2,80,1) -> Float(153600,6400,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.216198 [TensorRT] VERBOSE: Tactic: 0 Time: 0.111927 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.111927 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,6400:2,80,1) -> Float(153600,1,1920,24) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.21125 [TensorRT] VERBOSE: Tactic: 0 Time: 0.27224 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.21125 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,6400:2,80,1) -> Half(153600,6400,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.572396 [TensorRT] VERBOSE: Tactic: 0 Time: 0.110781 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.110781 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,6400,80,1) -> Float(153600,1,1920,24) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.427604 [TensorRT] VERBOSE: Tactic: 0 Time: 0.230886 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.230886 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,6400,80,1) -> Half(153600,6400,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.201042 [TensorRT] VERBOSE: Tactic: 0 Time: 0.16224 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.16224 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,6400,80,1) -> Half(76800,6400:2,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.221406 [TensorRT] VERBOSE: Tactic: 0 Time: 0.129896 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.129896 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,1,1920,24) -> Float(153600,6400,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.429375 [TensorRT] VERBOSE: Tactic: 0 Time: 0.47625 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.429375 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,1,1920,24) -> Half(153600,6400,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.221615 [TensorRT] VERBOSE: Tactic: 0 Time: 0.462031 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.221615 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,1,1920,24) -> Half(76800,6400:2,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.224323 [TensorRT] VERBOSE: Tactic: 0 Time: 0.505834 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.224323 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,6400,80,1) -> Float(153600,6400,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.20375 [TensorRT] VERBOSE: Tactic: 0 Time: 0.137344 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.137344 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,6400,80,1) -> Float(153600,1,1920,24) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.207708 [TensorRT] VERBOSE: Tactic: 0 Time: 0.234531 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.207708 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,6400,80,1) -> Half(76800,6400:2,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.170208 [TensorRT] VERBOSE: Tactic: 0 Time: 0.128646 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.128646 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,6400:2,80,1) -> Float(153600,6400,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.216354 [TensorRT] VERBOSE: Tactic: 0 Time: 0.113489 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.113489 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,6400:2,80,1) -> Float(153600,1,1920,24) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.211615 [TensorRT] VERBOSE: Tactic: 0 Time: 0.2725 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.211615 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,6400:2,80,1) -> Half(153600,6400,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.571511 [TensorRT] VERBOSE: Tactic: 0 Time: 0.109844 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.109844 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(153600,6400,80,1) -> Float(921600,6400,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 1.92818 [TensorRT] VERBOSE: Tactic: 1 Time: 1.59724 [TensorRT] VERBOSE: Tactic: 2 Time: 2.33052 [TensorRT] VERBOSE: Tactic: 4 Time: 170.141 [TensorRT] VERBOSE: Tactic: 5 Time: 3.85875 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 1.59724 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 0.817812 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TensorRT] VERBOSE: Tactic: 1698681053543049347 Time: 0.727396 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 0.98349 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 0.697344 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 0.989166 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TensorRT] VERBOSE: Tactic: 5326823351883942011 Time: 0.964063 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TensorRT] VERBOSE: Tactic: 5500448035057547314 Time: 0.741979 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 0.70474 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 0.785885 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 1.01359 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TensorRT] VERBOSE: Tactic: -6576203419454146580 Time: 0.753437 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 0.805937 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 0.766615 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 0.779375 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 0.762344 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 0.979114 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TensorRT] VERBOSE: Tactic: -377491875521947884 Time: 0.964271 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TensorRT] VERBOSE: Tactic: -37215280111360163 Time: 0.700781 [TensorRT] VERBOSE: Fastest Tactic: 5137655947464784826 Time: 0.697344 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5137655947464784826 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(153600,1,1920,24) -> Float(921600,1,11520,144) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TensorRT] VERBOSE: Tactic: 3886731678879822788 Time: 1.06458 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TensorRT] VERBOSE: Tactic: 6629944304117643200 Time: 2.52734 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TensorRT] VERBOSE: Tactic: -9153228964338181824 Time: 2.55641 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TensorRT] VERBOSE: Tactic: -7394439838318485025 Time: 1.0476 [TensorRT] VERBOSE: Fastest Tactic: -7394439838318485025 Time: 1.0476 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(153600,6400,80,1) -> Half(921600,6400,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 1.68219 [TensorRT] VERBOSE: Tactic: 1 Time: 1.44057 [TensorRT] VERBOSE: Tactic: 2 Time: 1.90193 [TensorRT] VERBOSE: Tactic: 4 Time: 170.252 [TensorRT] VERBOSE: Tactic: 5 Time: 3.595 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 1.44057 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(76800,6400:2,80,1) -> Half(921600,6400,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(76800,6400:2,80,1) -> Half(460800,6400:2,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TensorRT] VERBOSE: Tactic: 3066127711859985668 Time: 0.551094 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TensorRT] VERBOSE: Tactic: 3564772625446233998 Time: 0.569114 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TensorRT] VERBOSE: Tactic: 5319956359050645452 Time: 0.555 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TensorRT] VERBOSE: Tactic: 7205456024582378848 Time: 0.504323 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TensorRT] VERBOSE: Tactic: 8163473458334948789 Time: 0.49198 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TensorRT] VERBOSE: Tactic: -4212163711445252890 Time: 0.672292 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TensorRT] VERBOSE: Tactic: -3898373634979201110 Time: 0.658906 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TensorRT] VERBOSE: Tactic: -2409163523992614473 Time: 0.492136 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TensorRT] VERBOSE: Tactic: -1716393687483585322 Time: 0.652552 [TensorRT] VERBOSE: Fastest Tactic: 8163473458334948789 Time: 0.49198 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8163473458334948789 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(921600,6400,80,1) -> Float(921600,1,11520,144) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.25042 [TensorRT] VERBOSE: Tactic: 0 Time: 1.69385 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 1.25042 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(921600,6400,80,1) -> Half(921600,6400,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.16521 [TensorRT] VERBOSE: Tactic: 0 Time: 0.931562 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.931562 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(921600,6400,80,1) -> Half(460800,6400:2,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.39141 [TensorRT] VERBOSE: Tactic: 0 Time: 0.744583 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.744583 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(921600,1,11520,144) -> Float(921600,6400,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.41135 [TensorRT] VERBOSE: Tactic: 0 Time: 3.36885 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 1.41135 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(921600,1,11520,144) -> Half(921600,6400,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.967709 [TensorRT] VERBOSE: Tactic: 0 Time: 3.3462 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.967709 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(921600,1,11520,144) -> Half(460800,6400:2,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.19422 [TensorRT] VERBOSE: Tactic: 0 Time: 3.49646 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 1.19422 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(921600,6400,80,1) -> Float(921600,6400,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.17708 [TensorRT] VERBOSE: Tactic: 0 Time: 0.794583 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.794583 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(921600,6400,80,1) -> Float(921600,1,11520,144) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.911719 [TensorRT] VERBOSE: Tactic: 0 Time: 1.46661 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.911719 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(921600,6400,80,1) -> Half(460800,6400:2,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.775156 [TensorRT] VERBOSE: Tactic: 0 Time: 0.738333 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.738333 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(460800,6400:2,80,1) -> Float(921600,6400,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.17818 [TensorRT] VERBOSE: Tactic: 0 Time: 0.639115 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.639115 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(460800,6400:2,80,1) -> Float(921600,1,11520,144) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.927969 [TensorRT] VERBOSE: Tactic: 0 Time: 1.5925 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.927969 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(460800,6400:2,80,1) -> Half(921600,6400,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.99854 [TensorRT] VERBOSE: Tactic: 0 Time: 0.626822 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.626822 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(921600,6400,80,1) -> Float(921600,6400,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: Tactic: -1 Time: 1.13266 [TensorRT] VERBOSE: Fastest Tactic: -1 Time: 1.13266 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 2.26062 [TensorRT] VERBOSE: Tactic: 1 Time: 2.25349 [TensorRT] VERBOSE: Tactic: 2 Time: 2.9312 [TensorRT] VERBOSE: Tactic: 4 Time: 346.16 [TensorRT] VERBOSE: Tactic: 5 Time: 374.853 [TensorRT] VERBOSE: Tactic: 6 Time: 36.2239 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 2.25349 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 19.4069 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [TensorRT] VERBOSE: Tactic: 1754984623894446479 Time: 17.557 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [TensorRT] VERBOSE: Tactic: 3611739942397549984 Time: 61.5642 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724 [TensorRT] VERBOSE: Tactic: 3827454225649558724 Time: 52.9993 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [TensorRT] VERBOSE: Tactic: 4337000649858996379 Time: 30.1677 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 57.6385 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 28.1481 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 60.8418 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896 [TensorRT] VERBOSE: Tactic: 5921334924264294896 Time: 36.2688 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 28.9144 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 16.7042 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038 [TensorRT] VERBOSE: Tactic: 7852627285308570038 Time: 56.7668 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [TensorRT] VERBOSE: Tactic: -9137461792520977713 Time: 58.2158 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509 [TensorRT] VERBOSE: Tactic: -8776506421218919509 Time: 51.6362 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 61.6279 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [TensorRT] VERBOSE: Tactic: -8133971918129952780 Time: 28.9778 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [TensorRT] VERBOSE: Tactic: -6092040395344634144 Time: 19.8101 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 17.1847 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 18.5248 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239 [TensorRT] VERBOSE: Tactic: -2318106587342035239 Time: 54.4053 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657 [TensorRT] VERBOSE: Tactic: -1343271414618805657 Time: 35.5997 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 28.0308 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 28.4904 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 57.0723 [TensorRT] VERBOSE: Fastest Tactic: 7144526460361122478 Time: 16.7042 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(921600,1,11520,144) -> Float(921600,1,11520,144) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(921600,6400,80,1) -> Half(921600,6400,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 1.16677 [TensorRT] VERBOSE: Tactic: 1 Time: 1.17802 [TensorRT] VERBOSE: Tactic: 2 Time: 53.1657 [TensorRT] VERBOSE: Tactic: 4 Time: 346.603 [TensorRT] VERBOSE: Tactic: 5 Time: 375.364 [TensorRT] VERBOSE: Tactic: 6 Time: 141.769 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 1.16677 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(460800,6400:2,80,1) -> Half(460800,6400:2,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(921600,6400,80,1) -> Float(921600,1,11520,144) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(921600,6400,80,1) -> Half(921600,6400,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(921600,6400,80,1) -> Half(460800,6400:2,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(921600,1,11520,144) -> Float(921600,6400,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(921600,1,11520,144) -> Half(921600,6400,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(921600,1,11520,144) -> Half(460800,6400:2,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(921600,6400,80,1) -> Float(921600,6400,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(921600,6400,80,1) -> Float(921600,1,11520,144) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(921600,6400,80,1) -> Half(460800,6400:2,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(460800,6400:2,80,1) -> Float(921600,6400,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(460800,6400:2,80,1) -> Float(921600,1,11520,144) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(460800,6400:2,80,1) -> Half(921600,6400,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,6400,80,1) -> Float(153600,1,1920,24) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,6400,80,1) -> Half(153600,6400,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,6400,80,1) -> Half(76800,6400:2,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,1,1920,24) -> Float(153600,6400,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,1,1920,24) -> Half(153600,6400,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,1,1920,24) -> Half(76800,6400:2,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,6400,80,1) -> Float(153600,6400,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,6400,80,1) -> Float(153600,1,1920,24) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,6400,80,1) -> Half(76800,6400:2,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,6400:2,80,1) -> Float(153600,6400,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,6400:2,80,1) -> Float(153600,1,1920,24) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,6400:2,80,1) -> Half(153600,6400,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(921600,6400,80,1), Float(153600,6400,80,1) -> Float(153600,6400,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.890261 [TensorRT] VERBOSE: Tactic: 1 Time: 0.738854 [TensorRT] VERBOSE: Tactic: 2 Time: 2.68411 [TensorRT] VERBOSE: Tactic: 4 Time: 127.155 [TensorRT] VERBOSE: Tactic: 5 Time: 3.03698 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.738854 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 0.531146 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TensorRT] VERBOSE: Tactic: 1698681053543049347 Time: 0.491666 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 1.47776 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 0.749896 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 1.48844 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TensorRT] VERBOSE: Tactic: 5326823351883942011 Time: 1.44318 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TensorRT] VERBOSE: Tactic: 5500448035057547314 Time: 0.818334 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 0.755468 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 0.537813 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 1.50245 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TensorRT] VERBOSE: Tactic: -6576203419454146580 Time: 0.479271 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 0.546302 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 0.504427 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 0.823021 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 0.808907 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 1.4362 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TensorRT] VERBOSE: Tactic: -377491875521947884 Time: 1.47354 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TensorRT] VERBOSE: Tactic: -37215280111360163 Time: 0.719323 [TensorRT] VERBOSE: Fastest Tactic: -6576203419454146580 Time: 0.479271 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6576203419454146580 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(921600,1,11520,144), Float(153600,1,1920,24) -> Float(153600,1,1920,24) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TensorRT] VERBOSE: Tactic: 3886731678879822788 Time: 0.837292 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TensorRT] VERBOSE: Tactic: 6629944304117643200 Time: 1.03417 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TensorRT] VERBOSE: Tactic: -9153228964338181824 Time: 1.04109 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TensorRT] VERBOSE: Tactic: -7394439838318485025 Time: 0.835938 [TensorRT] VERBOSE: Fastest Tactic: -7394439838318485025 Time: 0.835938 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(921600,6400,80,1), Half(153600,6400,80,1) -> Half(153600,6400,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.87 [TensorRT] VERBOSE: Tactic: 1 Time: 0.741719 [TensorRT] VERBOSE: Tactic: 2 Time: 2.59656 [TensorRT] VERBOSE: Tactic: 4 Time: 127.574 [TensorRT] VERBOSE: Tactic: 5 Time: 3.0224 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.741719 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(460800,6400:2,80,1), Half(76800,6400:2,80,1) -> Half(76800,6400:2,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TensorRT] VERBOSE: Tactic: 3066127711859985668 Time: 0.275364 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TensorRT] VERBOSE: Tactic: 3564772625446233998 Time: 0.298542 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TensorRT] VERBOSE: Tactic: 5319956359050645452 Time: 0.288906 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TensorRT] VERBOSE: Tactic: 7205456024582378848 Time: 0.415364 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TensorRT] VERBOSE: Tactic: 8163473458334948789 Time: 0.400468 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TensorRT] VERBOSE: Tactic: -4212163711445252890 Time: 0.778698 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TensorRT] VERBOSE: Tactic: -3898373634979201110 Time: 0.790052 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TensorRT] VERBOSE: Tactic: -2409163523992614473 Time: 0.402448 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_2_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TensorRT] VERBOSE: Tactic: -1716393687483585322 Time: 0.76625 [TensorRT] VERBOSE: Fastest Tactic: 3066127711859985668 Time: 0.275364 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3066127711859985668 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,6400,80,1) -> Float(153600,1,1920,24) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,6400,80,1) -> Half(153600,6400,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,6400,80,1) -> Half(76800,6400:2,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,1,1920,24) -> Float(153600,6400,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,1,1920,24) -> Half(153600,6400,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,1,1920,24) -> Half(76800,6400:2,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,6400,80,1) -> Float(153600,6400,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,6400,80,1) -> Float(153600,1,1920,24) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,6400,80,1) -> Half(76800,6400:2,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,6400:2,80,1) -> Float(153600,6400,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,6400:2,80,1) -> Float(153600,1,1920,24) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,6400:2,80,1) -> Half(153600,6400,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(153600,6400,80,1) -> Float(921600,6400,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(153600,1,1920,24) -> Float(921600,1,11520,144) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(153600,6400,80,1) -> Half(921600,6400,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(76800,6400:2,80,1) -> Half(921600,6400,80,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(76800,6400:2,80,1) -> Half(460800,6400:2,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(921600,6400,80,1) -> Float(921600,1,11520,144) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(921600,6400,80,1) -> Half(921600,6400,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(921600,6400,80,1) -> Half(460800,6400:2,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(921600,1,11520,144) -> Float(921600,6400,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(921600,1,11520,144) -> Half(921600,6400,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(921600,1,11520,144) -> Half(460800,6400:2,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(921600,6400,80,1) -> Float(921600,6400,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(921600,6400,80,1) -> Float(921600,1,11520,144) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(921600,6400,80,1) -> Half(460800,6400:2,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(460800,6400:2,80,1) -> Float(921600,6400,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(460800,6400:2,80,1) -> Float(921600,1,11520,144) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(460800,6400:2,80,1) -> Half(921600,6400,80,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(921600,6400,80,1) -> Float(230400,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: Tactic: -1 Time: 0.734635 [TensorRT] VERBOSE: Fastest Tactic: -1 Time: 0.734635 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 1.57469 [TensorRT] VERBOSE: Tactic: 1 Time: 1.56948 [TensorRT] VERBOSE: Tactic: 2 Time: 1.57656 [TensorRT] VERBOSE: Tactic: 5 Time: 375.306 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 1.56948 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 7.04479 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [TensorRT] VERBOSE: Tactic: 1754984623894446479 Time: 7.05677 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [TensorRT] VERBOSE: Tactic: 3611739942397549984 Time: 16.723 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [TensorRT] VERBOSE: Tactic: 4337000649858996379 Time: 8.50167 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 15.6656 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 8.21828 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 16.5699 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 8.68682 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 4.8699 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [TensorRT] VERBOSE: Tactic: -9137461792520977713 Time: 15.855 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 17.2565 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [TensorRT] VERBOSE: Tactic: -8133971918129952780 Time: 8.3251 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [TensorRT] VERBOSE: Tactic: -6092040395344634144 Time: 6.55797 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 5.00938 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 6.26104 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 8.05109 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 7.91104 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 15.5753 [TensorRT] VERBOSE: Fastest Tactic: 7144526460361122478 Time: 4.8699 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(921600,1,11520,144) -> Float(230400,1,5760,144) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(921600,6400,80,1) -> Half(230400,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 1.30839 [TensorRT] VERBOSE: Tactic: 1 Time: 1.31052 [TensorRT] VERBOSE: Tactic: 2 Time: 1.56078 [TensorRT] VERBOSE: Tactic: 5 Time: 374.303 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 1.30839 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(460800,6400:2,80,1) -> Half(115200,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(230400,1600,40,1) -> Float(230400,1,5760,144) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.315365 [TensorRT] VERBOSE: Tactic: 0 Time: 0.390208 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.315365 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(230400,1600,40,1) -> Half(230400,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.365312 [TensorRT] VERBOSE: Tactic: 0 Time: 0.240052 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.240052 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(230400,1600,40,1) -> Half(115200,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.349531 [TensorRT] VERBOSE: Tactic: 0 Time: 0.192083 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.192083 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(230400,1,5760,144) -> Float(230400,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.355833 [TensorRT] VERBOSE: Tactic: 0 Time: 0.376302 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.355833 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(230400,1,5760,144) -> Half(230400,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.248281 [TensorRT] VERBOSE: Tactic: 0 Time: 0.364167 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.248281 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(230400,1,5760,144) -> Half(115200,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.298906 [TensorRT] VERBOSE: Tactic: 0 Time: 0.419843 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.298906 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(230400,1600,40,1) -> Float(230400,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.369844 [TensorRT] VERBOSE: Tactic: 0 Time: 0.203802 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.203802 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(230400,1600,40,1) -> Float(230400,1,5760,144) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.235 [TensorRT] VERBOSE: Tactic: 0 Time: 0.357761 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.235 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(230400,1600,40,1) -> Half(115200,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.204427 [TensorRT] VERBOSE: Tactic: 0 Time: 0.19026 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.19026 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(115200,1600:2,40,1) -> Float(230400,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.297604 [TensorRT] VERBOSE: Tactic: 0 Time: 0.165521 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.165521 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(115200,1600:2,40,1) -> Float(230400,1,5760,144) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.23849 [TensorRT] VERBOSE: Tactic: 0 Time: 0.40474 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.23849 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(115200,1600:2,40,1) -> Half(230400,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.501875 [TensorRT] VERBOSE: Tactic: 0 Time: 0.161718 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.161718 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(230400,1600,40,1) -> Float(51200,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 Time: 0.3025 [TensorRT] VERBOSE: Tactic: 655359 Time: 0.475105 [TensorRT] VERBOSE: Tactic: 786431 Time: 0.304584 [TensorRT] VERBOSE: Tactic: 851967 Time: 0.716145 [TensorRT] VERBOSE: Tactic: 1179647 Time: 0.398907 [TensorRT] VERBOSE: Tactic: 1310719 Time: 0.465886 [TensorRT] VERBOSE: Tactic: 1376255 Time: 0.32375 [TensorRT] VERBOSE: Tactic: 1441791 Time: 0.455937 [TensorRT] VERBOSE: Tactic: 1507327 Time: 0.666614 [TensorRT] VERBOSE: Tactic: 1638399 Time: 0.313282 [TensorRT] VERBOSE: Tactic: 1835007 Time: 0.302969 [TensorRT] VERBOSE: Tactic: 1900543 Time: 0.666979 [TensorRT] VERBOSE: Tactic: 2162687 Time: 0.346719 [TensorRT] VERBOSE: Tactic: 2293759 Time: 0.324167 [TensorRT] VERBOSE: Tactic: 2359295 Time: 0.351093 [TensorRT] VERBOSE: Tactic: 2686975 Time: 0.304844 [TensorRT] VERBOSE: Tactic: 3080191 Time: 0.61625 [TensorRT] VERBOSE: Tactic: 3342335 Time: 0.680156 [TensorRT] VERBOSE: Tactic: 3407871 Time: 0.341823 [TensorRT] VERBOSE: Tactic: 3538943 Time: 0.340208 [TensorRT] VERBOSE: Tactic: 3670015 Time: 0.422031 [TensorRT] VERBOSE: Tactic: 3932159 Time: 0.592396 [TensorRT] VERBOSE: Tactic: 3997695 Time: 0.300052 [TensorRT] VERBOSE: Tactic: 4063231 Time: 0.761458 [TensorRT] VERBOSE: Tactic: 4194303 Time: 0.295625 [TensorRT] VERBOSE: Tactic: 4325375 Time: 0.292864 [TensorRT] VERBOSE: Tactic: 4521983 Time: 0.279271 [TensorRT] VERBOSE: Tactic: 4587519 Time: 0.326354 [TensorRT] VERBOSE: Tactic: 4653055 Time: 0.48026 [TensorRT] VERBOSE: Tactic: 4915199 Time: 0.293959 [TensorRT] VERBOSE: Tactic: 4980735 Time: 0.2975 [TensorRT] VERBOSE: Tactic: 5177343 Time: 0.414062 [TensorRT] VERBOSE: Tactic: 5242879 Time: 0.359011 [TensorRT] VERBOSE: Tactic: 5373951 Time: 0.625104 [TensorRT] VERBOSE: Tactic: 5439487 Time: 0.443281 [TensorRT] VERBOSE: Tactic: 5570559 Time: 0.525781 [TensorRT] VERBOSE: Tactic: 5636095 Time: 0.758802 [TensorRT] VERBOSE: Tactic: 5701631 Time: 0.359636 [TensorRT] VERBOSE: Tactic: 5767167 Time: 0.933177 [TensorRT] VERBOSE: Tactic: 5832703 Time: 0.327447 [TensorRT] VERBOSE: Tactic: 5898239 Time: 0.350729 [TensorRT] VERBOSE: Tactic: 6029311 Time: 0.347084 [TensorRT] VERBOSE: Tactic: 6225919 Time: 0.35151 [TensorRT] VERBOSE: Tactic: 6291455 Time: 0.396563 [TensorRT] VERBOSE: Tactic: 6422527 Time: 0.609427 [TensorRT] VERBOSE: Tactic: 6750207 Time: 0.315885 [TensorRT] VERBOSE: Tactic: 6815743 Time: 0.478907 [TensorRT] VERBOSE: Tactic: 6946815 Time: 0.445208 [TensorRT] VERBOSE: Tactic: 7077887 Time: 0.327604 [TensorRT] VERBOSE: Tactic: 7143423 Time: 0.433646 [TensorRT] VERBOSE: Tactic: 7208959 Time: 0.360364 [TensorRT] VERBOSE: Tactic: 7340031 Time: 0.355364 [TensorRT] VERBOSE: Tactic: 7405567 Time: 0.426146 [TensorRT] VERBOSE: Tactic: 7536639 Time: 0.434479 [TensorRT] VERBOSE: Tactic: 7602175 Time: 0.329687 [TensorRT] VERBOSE: Tactic: 7733247 Time: 0.36823 [TensorRT] VERBOSE: Tactic: 7798783 Time: 0.307917 [TensorRT] VERBOSE: Tactic: 8191999 Time: 0.398281 [TensorRT] VERBOSE: Tactic: 8257535 Time: 0.301198 [TensorRT] VERBOSE: Tactic: 8323071 Time: 0.314844 [TensorRT] VERBOSE: Tactic: 8650751 Time: 0.353958 [TensorRT] VERBOSE: Tactic: 8716287 Time: 0.4875 [TensorRT] VERBOSE: Tactic: 9568255 Time: 0.290521 [TensorRT] VERBOSE: Tactic: 9895935 Time: 0.295 [TensorRT] VERBOSE: Tactic: 10223615 Time: 0.304323 [TensorRT] VERBOSE: Tactic: 10354687 Time: 0.293646 [TensorRT] VERBOSE: Tactic: 10551295 Time: 0.289948 [TensorRT] VERBOSE: Tactic: 10747903 Time: 0.363229 [TensorRT] VERBOSE: Tactic: 10944511 Time: 0.298906 [TensorRT] VERBOSE: Fastest Tactic: 4521983 Time: 0.279271 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.220572 [TensorRT] VERBOSE: Tactic: 1 Time: 0.220573 [TensorRT] VERBOSE: Tactic: 2 Time: 0.739792 [TensorRT] VERBOSE: Tactic: 4 Time: 27.0791 [TensorRT] VERBOSE: Tactic: 5 Time: 1.26797 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.220572 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 0.15599 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TensorRT] VERBOSE: Tactic: 1698681053543049347 Time: 0.142187 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 0.379687 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 0.198229 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 0.383906 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TensorRT] VERBOSE: Tactic: 5326823351883942011 Time: 0.366407 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TensorRT] VERBOSE: Tactic: 5500448035057547314 Time: 0.213177 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 0.199271 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 0.141979 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 0.384844 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TensorRT] VERBOSE: Tactic: -6576203419454146580 Time: 0.135573 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 0.150209 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 0.14 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 0.221146 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 0.214792 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 0.375469 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TensorRT] VERBOSE: Tactic: -377491875521947884 Time: 0.374635 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TensorRT] VERBOSE: Tactic: -37215280111360163 Time: 0.192969 [TensorRT] VERBOSE: Fastest Tactic: -6576203419454146580 Time: 0.135573 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6576203419454146580 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(230400,1,5760,144) -> Float(51200,1,1280,32) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TensorRT] VERBOSE: Tactic: 3886731678879822788 Time: 0.20526 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TensorRT] VERBOSE: Tactic: 6629944304117643200 Time: 0.235416 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TensorRT] VERBOSE: Tactic: -9153228964338181824 Time: 0.239063 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TensorRT] VERBOSE: Tactic: -7394439838318485025 Time: 0.214271 [TensorRT] VERBOSE: Fastest Tactic: 3886731678879822788 Time: 0.20526 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(230400,1600,40,1) -> Half(51200,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.237396 [TensorRT] VERBOSE: Tactic: 1 Time: 0.19448 [TensorRT] VERBOSE: Tactic: 2 Time: 0.733959 [TensorRT] VERBOSE: Tactic: 4 Time: 27.1084 [TensorRT] VERBOSE: Tactic: 5 Time: 1.22974 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.19448 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(115200,1600:2,40,1) -> Half(51200,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(115200,1600:2,40,1) -> Half(25600,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 Time: 0.147604 [TensorRT] VERBOSE: Tactic: 655359 Time: 0.354063 [TensorRT] VERBOSE: Tactic: 786431 Time: 0.186198 [TensorRT] VERBOSE: Tactic: 851967 Time: 0.4725 [TensorRT] VERBOSE: Tactic: 1310719 Time: 0.248958 [TensorRT] VERBOSE: Tactic: 1376255 Time: 0.171875 [TensorRT] VERBOSE: Tactic: 1507327 Time: 0.426875 [TensorRT] VERBOSE: Tactic: 1638399 Time: 0.180729 [TensorRT] VERBOSE: Tactic: 1835007 Time: 0.183385 [TensorRT] VERBOSE: Tactic: 1900543 Time: 0.383333 [TensorRT] VERBOSE: Tactic: 2162687 Time: 0.182656 [TensorRT] VERBOSE: Tactic: 2293759 Time: 0.184792 [TensorRT] VERBOSE: Tactic: 2359295 Time: 0.201458 [TensorRT] VERBOSE: Tactic: 2686975 Time: 0.282396 [TensorRT] VERBOSE: Tactic: 3080191 Time: 0.413489 [TensorRT] VERBOSE: Tactic: 3342335 Time: 0.413906 [TensorRT] VERBOSE: Tactic: 3407871 Time: 0.198021 [TensorRT] VERBOSE: Tactic: 3538943 Time: 0.214636 [TensorRT] VERBOSE: Tactic: 3670015 Time: 0.298542 [TensorRT] VERBOSE: Tactic: 3932159 Time: 0.300416 [TensorRT] VERBOSE: Tactic: 4063231 Time: 0.506511 [TensorRT] VERBOSE: Tactic: 4194303 Time: 0.176823 [TensorRT] VERBOSE: Tactic: 4325375 Time: 0.155782 [TensorRT] VERBOSE: Tactic: 4521983 Time: 0.154427 [TensorRT] VERBOSE: Tactic: 4980735 Time: 0.158333 [TensorRT] VERBOSE: Tactic: 5242879 Time: 0.196459 [TensorRT] VERBOSE: Tactic: 5439487 Time: 0.242291 [TensorRT] VERBOSE: Tactic: 5570559 Time: 0.429531 [TensorRT] VERBOSE: Tactic: 5636095 Time: 0.506615 [TensorRT] VERBOSE: Tactic: 5701631 Time: 0.169114 [TensorRT] VERBOSE: Tactic: 5767167 Time: 0.447812 [TensorRT] VERBOSE: Tactic: 5832703 Time: 0.184375 [TensorRT] VERBOSE: Tactic: 6029311 Time: 0.19401 [TensorRT] VERBOSE: Tactic: 6225919 Time: 0.206979 [TensorRT] VERBOSE: Tactic: 6422527 Time: 0.376406 [TensorRT] VERBOSE: Tactic: 6815743 Time: 0.250729 [TensorRT] VERBOSE: Tactic: 6946815 Time: 0.223125 [TensorRT] VERBOSE: Tactic: 7077887 Time: 0.194531 [TensorRT] VERBOSE: Tactic: 7143423 Time: 0.224584 [TensorRT] VERBOSE: Tactic: 7208959 Time: 0.193906 [TensorRT] VERBOSE: Tactic: 7405567 Time: 0.255937 [TensorRT] VERBOSE: Tactic: 7536639 Time: 0.238959 [TensorRT] VERBOSE: Tactic: 7602175 Time: 0.165625 [TensorRT] VERBOSE: Tactic: 7733247 Time: 0.228594 [TensorRT] VERBOSE: Tactic: 7798783 Time: 0.181718 [TensorRT] VERBOSE: Tactic: 8191999 Time: 0.209739 [TensorRT] VERBOSE: Tactic: 8323071 Time: 0.182552 [TensorRT] VERBOSE: Tactic: 8650751 Time: 0.177916 [TensorRT] VERBOSE: Tactic: 8716287 Time: 0.251718 [TensorRT] VERBOSE: Tactic: 9895935 Time: 0.177239 [TensorRT] VERBOSE: Tactic: 10223615 Time: 0.285052 [TensorRT] VERBOSE: Tactic: 10551295 Time: 0.146667 [TensorRT] VERBOSE: Tactic: 10747903 Time: 0.225416 [TensorRT] VERBOSE: Tactic: 10944511 Time: 0.158594 [TensorRT] VERBOSE: Fastest Tactic: 10551295 Time: 0.146667 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TensorRT] VERBOSE: Tactic: 3066127711859985668 Time: 0.076146 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TensorRT] VERBOSE: Tactic: 3564772625446233998 Time: 0.083489 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TensorRT] VERBOSE: Tactic: 5319956359050645452 Time: 0.078282 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TensorRT] VERBOSE: Tactic: 7205456024582378848 Time: 0.114271 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TensorRT] VERBOSE: Tactic: 8163473458334948789 Time: 0.108906 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TensorRT] VERBOSE: Tactic: -4212163711445252890 Time: 0.201875 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TensorRT] VERBOSE: Tactic: -3898373634979201110 Time: 0.207187 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TensorRT] VERBOSE: Tactic: -2409163523992614473 Time: 0.110156 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_3_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TensorRT] VERBOSE: Tactic: -1716393687483585322 Time: 0.199635 [TensorRT] VERBOSE: Fastest Tactic: 3066127711859985668 Time: 0.076146 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3066127711859985668 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1600,40,1) -> Float(51200,1,1280,32) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.11474 [TensorRT] VERBOSE: Tactic: 0 Time: 0.088333 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.088333 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1600,40,1) -> Half(51200,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.08625 [TensorRT] VERBOSE: Tactic: 0 Time: 0.058281 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.058281 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1600,40,1) -> Half(25600,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.083906 [TensorRT] VERBOSE: Tactic: 0 Time: 0.046615 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.046615 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,1280,32) -> Float(51200,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.116094 [TensorRT] VERBOSE: Tactic: 0 Time: 0.075781 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.075781 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,1280,32) -> Half(51200,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.05375 [TensorRT] VERBOSE: Tactic: 0 Time: 0.076354 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.05375 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,1280,32) -> Half(25600,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.074063 [TensorRT] VERBOSE: Tactic: 0 Time: 0.090364 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.074063 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,1600,40,1) -> Float(51200,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.087917 [TensorRT] VERBOSE: Tactic: 0 Time: 0.049583 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.049583 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,1600,40,1) -> Float(51200,1,1280,32) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.051719 [TensorRT] VERBOSE: Tactic: 0 Time: 0.083073 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.051719 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,1600,40,1) -> Half(25600,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.048386 [TensorRT] VERBOSE: Tactic: 0 Time: 0.045104 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.045104 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1600:2,40,1) -> Float(51200,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.070104 [TensorRT] VERBOSE: Tactic: 0 Time: 0.040208 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.040208 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1600:2,40,1) -> Float(51200,1,1280,32) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.052448 [TensorRT] VERBOSE: Tactic: 0 Time: 0.094791 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.052448 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1600:2,40,1) -> Half(51200,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.144479 [TensorRT] VERBOSE: Tactic: 0 Time: 0.039739 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.039739 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1600,40,1) -> Float(51200,1,1280,32) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.115156 [TensorRT] VERBOSE: Tactic: 0 Time: 0.087083 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.087083 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1600,40,1) -> Half(51200,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.087395 [TensorRT] VERBOSE: Tactic: 0 Time: 0.059323 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.059323 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1600,40,1) -> Half(25600,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.084635 [TensorRT] VERBOSE: Tactic: 0 Time: 0.04599 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.04599 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,1280,32) -> Float(51200,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.116094 [TensorRT] VERBOSE: Tactic: 0 Time: 0.076354 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.076354 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,1280,32) -> Half(51200,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.05427 [TensorRT] VERBOSE: Tactic: 0 Time: 0.07651 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.05427 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,1280,32) -> Half(25600,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.074427 [TensorRT] VERBOSE: Tactic: 0 Time: 0.090261 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.074427 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,1600,40,1) -> Float(51200,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.087136 [TensorRT] VERBOSE: Tactic: 0 Time: 0.048646 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.048646 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,1600,40,1) -> Float(51200,1,1280,32) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.050833 [TensorRT] VERBOSE: Tactic: 0 Time: 0.08276 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.050833 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,1600,40,1) -> Half(25600,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.049896 [TensorRT] VERBOSE: Tactic: 0 Time: 0.045104 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.045104 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1600:2,40,1) -> Float(51200,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.070521 [TensorRT] VERBOSE: Tactic: 0 Time: 0.039843 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.039843 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1600:2,40,1) -> Float(51200,1,1280,32) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.052344 [TensorRT] VERBOSE: Tactic: 0 Time: 0.094844 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.052344 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1600:2,40,1) -> Half(51200,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.144635 [TensorRT] VERBOSE: Tactic: 0 Time: 0.040261 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.040261 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,1600,40,1) -> Float(307200,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.685886 [TensorRT] VERBOSE: Tactic: 1 Time: 0.588489 [TensorRT] VERBOSE: Tactic: 2 Time: 0.762865 [TensorRT] VERBOSE: Tactic: 4 Time: 45.3206 [TensorRT] VERBOSE: Tactic: 5 Time: 1.73323 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.588489 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 0.299792 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TensorRT] VERBOSE: Tactic: 1698681053543049347 Time: 0.264636 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 0.302291 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 0.21776 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 0.301198 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TensorRT] VERBOSE: Tactic: 5326823351883942011 Time: 0.290104 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TensorRT] VERBOSE: Tactic: 5500448035057547314 Time: 0.238125 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 0.227812 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 0.295573 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 0.30474 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TensorRT] VERBOSE: Tactic: -6576203419454146580 Time: 0.275469 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 0.29026 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 0.284792 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 0.243698 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 0.239844 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 0.281302 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TensorRT] VERBOSE: Tactic: -377491875521947884 Time: 0.292552 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TensorRT] VERBOSE: Tactic: -37215280111360163 Time: 0.217708 [TensorRT] VERBOSE: Fastest Tactic: -37215280111360163 Time: 0.217708 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,1,1280,32) -> Float(307200,1,7680,192) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TensorRT] VERBOSE: Tactic: 3886731678879822788 Time: 0.284427 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TensorRT] VERBOSE: Tactic: 6629944304117643200 Time: 0.795156 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TensorRT] VERBOSE: Tactic: -9153228964338181824 Time: 0.800104 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TensorRT] VERBOSE: Tactic: -7394439838318485025 Time: 0.289635 [TensorRT] VERBOSE: Fastest Tactic: 3886731678879822788 Time: 0.284427 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(51200,1600,40,1) -> Half(307200,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.595729 [TensorRT] VERBOSE: Tactic: 1 Time: 0.594323 [TensorRT] VERBOSE: Tactic: 2 Time: 0.641667 [TensorRT] VERBOSE: Tactic: 4 Time: 46.288 [TensorRT] VERBOSE: Tactic: 5 Time: 1.69062 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.594323 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(25600,1600:2,40,1) -> Half(307200,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(25600,1600:2,40,1) -> Half(153600,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TensorRT] VERBOSE: Tactic: 3066127711859985668 Time: 0.168646 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TensorRT] VERBOSE: Tactic: 3564772625446233998 Time: 0.176563 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TensorRT] VERBOSE: Tactic: 5319956359050645452 Time: 0.170469 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TensorRT] VERBOSE: Tactic: 7205456024582378848 Time: 0.137292 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TensorRT] VERBOSE: Tactic: 8163473458334948789 Time: 0.134479 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TensorRT] VERBOSE: Tactic: -4212163711445252890 Time: 0.17526 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TensorRT] VERBOSE: Tactic: -3898373634979201110 Time: 0.182344 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TensorRT] VERBOSE: Tactic: -2409163523992614473 Time: 0.137604 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TensorRT] VERBOSE: Tactic: -1716393687483585322 Time: 0.174584 [TensorRT] VERBOSE: Fastest Tactic: 8163473458334948789 Time: 0.134479 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8163473458334948789 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,1600,40,1) -> Float(307200,1,7680,192) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.325886 [TensorRT] VERBOSE: Tactic: 0 Time: 0.559323 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.325886 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,1600,40,1) -> Half(307200,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.485208 [TensorRT] VERBOSE: Tactic: 0 Time: 0.317656 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.317656 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,1600,40,1) -> Half(153600,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.461511 [TensorRT] VERBOSE: Tactic: 0 Time: 0.253177 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.253177 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,1,7680,192) -> Float(307200,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.387448 [TensorRT] VERBOSE: Tactic: 0 Time: 0.490469 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.387448 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,1,7680,192) -> Half(307200,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.290937 [TensorRT] VERBOSE: Tactic: 0 Time: 0.479791 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.290937 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,1,7680,192) -> Half(153600,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.391354 [TensorRT] VERBOSE: Tactic: 0 Time: 0.556458 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.391354 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(307200,1600,40,1) -> Float(307200,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.488906 [TensorRT] VERBOSE: Tactic: 0 Time: 0.26875 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.26875 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(307200,1600,40,1) -> Float(307200,1,7680,192) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.273594 [TensorRT] VERBOSE: Tactic: 0 Time: 0.48875 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.273594 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(307200,1600,40,1) -> Half(153600,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.268593 [TensorRT] VERBOSE: Tactic: 0 Time: 0.251875 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.251875 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,1600:2,40,1) -> Float(307200,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.367968 [TensorRT] VERBOSE: Tactic: 0 Time: 0.217709 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.217709 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,1600:2,40,1) -> Float(307200,1,7680,192) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.279062 [TensorRT] VERBOSE: Tactic: 0 Time: 0.537292 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.279062 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,1600:2,40,1) -> Half(307200,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.560521 [TensorRT] VERBOSE: Tactic: 0 Time: 0.214219 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.214219 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(307200,1600,40,1) -> Float(307200,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: Tactic: -1 Time: 0.350261 [TensorRT] VERBOSE: Fastest Tactic: -1 Time: 0.350261 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.719948 [TensorRT] VERBOSE: Tactic: 1 Time: 0.726354 [TensorRT] VERBOSE: Tactic: 2 Time: 1.00526 [TensorRT] VERBOSE: Tactic: 4 Time: 111.815 [TensorRT] VERBOSE: Tactic: 5 Time: 222.628 [TensorRT] VERBOSE: Tactic: 6 Time: 14.7424 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.719948 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 8.60073 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [TensorRT] VERBOSE: Tactic: 1754984623894446479 Time: 6.73662 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [TensorRT] VERBOSE: Tactic: 3611739942397549984 Time: 22.8034 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724 [TensorRT] VERBOSE: Tactic: 3827454225649558724 Time: 21.6359 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [TensorRT] VERBOSE: Tactic: 4337000649858996379 Time: 11.3962 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 21.7366 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 10.9346 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 21.9814 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896 [TensorRT] VERBOSE: Tactic: 5921334924264294896 Time: 15.2066 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 11.3297 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 6.44 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038 [TensorRT] VERBOSE: Tactic: 7852627285308570038 Time: 23.1663 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [TensorRT] VERBOSE: Tactic: -9137461792520977713 Time: 22.2315 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509 [TensorRT] VERBOSE: Tactic: -8776506421218919509 Time: 21.0604 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 22.5647 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [TensorRT] VERBOSE: Tactic: -8133971918129952780 Time: 10.7298 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [TensorRT] VERBOSE: Tactic: -6092040395344634144 Time: 8.69073 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 6.66135 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 8.14047 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239 [TensorRT] VERBOSE: Tactic: -2318106587342035239 Time: 22.1392 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657 [TensorRT] VERBOSE: Tactic: -1343271414618805657 Time: 14.9438 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 10.9774 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 10.4434 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 20.8053 [TensorRT] VERBOSE: Fastest Tactic: 7144526460361122478 Time: 6.44 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(307200,1,7680,192) -> Float(307200,1,7680,192) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(307200,1600,40,1) -> Half(307200,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.406666 [TensorRT] VERBOSE: Tactic: 1 Time: 0.40198 [TensorRT] VERBOSE: Tactic: 2 Time: 17.7484 [TensorRT] VERBOSE: Tactic: 4 Time: 112.059 [TensorRT] VERBOSE: Tactic: 5 Time: 222.701 [TensorRT] VERBOSE: Tactic: 6 Time: 90.1947 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.40198 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(153600,1600:2,40,1) -> Half(153600,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,1600,40,1) -> Float(307200,1,7680,192) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,1600,40,1) -> Half(307200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,1600,40,1) -> Half(153600,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,1,7680,192) -> Float(307200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,1,7680,192) -> Half(307200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,1,7680,192) -> Half(153600,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(307200,1600,40,1) -> Float(307200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(307200,1600,40,1) -> Float(307200,1,7680,192) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(307200,1600,40,1) -> Half(153600,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,1600:2,40,1) -> Float(307200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,1600:2,40,1) -> Float(307200,1,7680,192) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,1600:2,40,1) -> Half(307200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1600,40,1) -> Float(51200,1,1280,32) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1600,40,1) -> Half(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1600,40,1) -> Half(25600,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,1280,32) -> Float(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,1280,32) -> Half(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,1280,32) -> Half(25600,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,1600,40,1) -> Float(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,1600,40,1) -> Float(51200,1,1280,32) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,1600,40,1) -> Half(25600,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1600:2,40,1) -> Float(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1600:2,40,1) -> Float(51200,1,1280,32) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1600:2,40,1) -> Half(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(307200,1600,40,1), Float(51200,1600,40,1) -> Float(51200,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.314271 [TensorRT] VERBOSE: Tactic: 1 Time: 0.311198 [TensorRT] VERBOSE: Tactic: 2 Time: 1 [TensorRT] VERBOSE: Tactic: 4 Time: 33.6551 [TensorRT] VERBOSE: Tactic: 5 Time: 1.64667 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.311198 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 0.200365 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TensorRT] VERBOSE: Tactic: 1698681053543049347 Time: 0.190313 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 0.497656 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 0.258438 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 0.492657 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TensorRT] VERBOSE: Tactic: 5326823351883942011 Time: 0.485469 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TensorRT] VERBOSE: Tactic: 5500448035057547314 Time: 0.289948 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 0.262344 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 0.196667 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 0.493438 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TensorRT] VERBOSE: Tactic: -6576203419454146580 Time: 0.170834 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 0.191927 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 0.182084 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 0.287084 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 0.281145 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 0.489271 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TensorRT] VERBOSE: Tactic: -377491875521947884 Time: 0.493646 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TensorRT] VERBOSE: Tactic: -37215280111360163 Time: 0.247448 [TensorRT] VERBOSE: Fastest Tactic: -6576203419454146580 Time: 0.170834 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6576203419454146580 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(307200,1,7680,192), Float(51200,1,1280,32) -> Float(51200,1,1280,32) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TensorRT] VERBOSE: Tactic: 3886731678879822788 Time: 0.275261 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TensorRT] VERBOSE: Tactic: 6629944304117643200 Time: 0.302812 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TensorRT] VERBOSE: Tactic: -9153228964338181824 Time: 0.301823 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TensorRT] VERBOSE: Tactic: -7394439838318485025 Time: 0.278021 [TensorRT] VERBOSE: Fastest Tactic: 3886731678879822788 Time: 0.275261 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(307200,1600,40,1), Half(51200,1600,40,1) -> Half(51200,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.319219 [TensorRT] VERBOSE: Tactic: 1 Time: 0.263541 [TensorRT] VERBOSE: Tactic: 2 Time: 0.980313 [TensorRT] VERBOSE: Tactic: 4 Time: 34.7585 [TensorRT] VERBOSE: Tactic: 5 Time: 1.57677 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.263541 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(153600,1600:2,40,1), Half(25600,1600:2,40,1) -> Half(25600,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TensorRT] VERBOSE: Tactic: 3066127711859985668 Time: 0.099063 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TensorRT] VERBOSE: Tactic: 3564772625446233998 Time: 0.110261 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TensorRT] VERBOSE: Tactic: 5319956359050645452 Time: 0.103698 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TensorRT] VERBOSE: Tactic: 7205456024582378848 Time: 0.143385 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TensorRT] VERBOSE: Tactic: 8163473458334948789 Time: 0.138334 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TensorRT] VERBOSE: Tactic: -4212163711445252890 Time: 0.257448 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TensorRT] VERBOSE: Tactic: -3898373634979201110 Time: 0.260573 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TensorRT] VERBOSE: Tactic: -2409163523992614473 Time: 0.138906 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_4_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TensorRT] VERBOSE: Tactic: -1716393687483585322 Time: 0.256093 [TensorRT] VERBOSE: Fastest Tactic: 3066127711859985668 Time: 0.099063 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3066127711859985668 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1600,40,1) -> Float(51200,1,1280,32) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1600,40,1) -> Half(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1600,40,1) -> Half(25600,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,1280,32) -> Float(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,1280,32) -> Half(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,1280,32) -> Half(25600,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,1600,40,1) -> Float(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,1600,40,1) -> Float(51200,1,1280,32) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,1600,40,1) -> Half(25600,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1600:2,40,1) -> Float(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1600:2,40,1) -> Float(51200,1,1280,32) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1600:2,40,1) -> Half(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1600,40,1) -> Float(51200,1,1280,32) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1600,40,1) -> Half(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1600,40,1) -> Half(25600,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,1280,32) -> Float(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,1280,32) -> Half(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,1280,32) -> Half(25600,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,1600,40,1) -> Float(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,1600,40,1) -> Float(51200,1,1280,32) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,1600,40,1) -> Half(25600,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1600:2,40,1) -> Float(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1600:2,40,1) -> Float(51200,1,1280,32) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1600:2,40,1) -> Half(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,1600,40,1) -> Float(307200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,1,1280,32) -> Float(307200,1,7680,192) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(51200,1600,40,1) -> Half(307200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(25600,1600:2,40,1) -> Half(307200,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(25600,1600:2,40,1) -> Half(153600,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,1600,40,1) -> Float(307200,1,7680,192) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,1600,40,1) -> Half(307200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,1600,40,1) -> Half(153600,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,1,7680,192) -> Float(307200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,1,7680,192) -> Half(307200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,1,7680,192) -> Half(153600,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(307200,1600,40,1) -> Float(307200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(307200,1600,40,1) -> Float(307200,1,7680,192) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(307200,1600,40,1) -> Half(153600,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,1600:2,40,1) -> Float(307200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,1600:2,40,1) -> Float(307200,1,7680,192) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,1600:2,40,1) -> Half(307200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(307200,1600,40,1) -> Float(307200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(307200,1,7680,192) -> Float(307200,1,7680,192) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_depthwise_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(307200,1600,40,1) -> Half(307200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(153600,1600:2,40,1) -> Half(153600,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_5_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,1600,40,1) -> Float(307200,1,7680,192) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,1600,40,1) -> Half(307200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,1600,40,1) -> Half(153600,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,1,7680,192) -> Float(307200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,1,7680,192) -> Half(307200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,1,7680,192) -> Half(153600,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(307200,1600,40,1) -> Float(307200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(307200,1600,40,1) -> Float(307200,1,7680,192) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(307200,1600,40,1) -> Half(153600,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,1600:2,40,1) -> Float(307200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,1600:2,40,1) -> Float(307200,1,7680,192) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,1600:2,40,1) -> Half(307200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1600,40,1) -> Float(51200,1,1280,32) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1600,40,1) -> Half(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1600,40,1) -> Half(25600,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,1280,32) -> Float(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,1280,32) -> Half(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,1280,32) -> Half(25600,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,1600,40,1) -> Float(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,1600,40,1) -> Float(51200,1,1280,32) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,1600,40,1) -> Half(25600,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1600:2,40,1) -> Float(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1600:2,40,1) -> Float(51200,1,1280,32) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1600:2,40,1) -> Half(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(307200,1600,40,1), Float(51200,1600,40,1) -> Float(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(307200,1,7680,192), Float(51200,1,1280,32) -> Float(51200,1,1280,32) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(307200,1600,40,1), Half(51200,1600,40,1) -> Half(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(153600,1600:2,40,1), Half(25600,1600:2,40,1) -> Half(25600,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1600,40,1) -> Float(51200,1,1280,32) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1600,40,1) -> Half(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1600,40,1) -> Half(25600,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,1280,32) -> Float(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,1280,32) -> Half(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,1280,32) -> Half(25600,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,1600,40,1) -> Float(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,1600,40,1) -> Float(51200,1,1280,32) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,1600,40,1) -> Half(25600,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1600:2,40,1) -> Float(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1600:2,40,1) -> Float(51200,1,1280,32) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1600:2,40,1) -> Half(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1600,40,1) -> Float(51200,1,1280,32) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1600,40,1) -> Half(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1600,40,1) -> Half(25600,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,1280,32) -> Float(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,1280,32) -> Half(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,1280,32) -> Half(25600,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,1600,40,1) -> Float(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,1600,40,1) -> Float(51200,1,1280,32) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,1600,40,1) -> Half(25600,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1600:2,40,1) -> Float(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1600:2,40,1) -> Float(51200,1,1280,32) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1600:2,40,1) -> Half(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,1600,40,1) -> Float(307200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,1,1280,32) -> Float(307200,1,7680,192) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(51200,1600,40,1) -> Half(307200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(25600,1600:2,40,1) -> Half(307200,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(25600,1600:2,40,1) -> Half(153600,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,1600,40,1) -> Float(307200,1,7680,192) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,1600,40,1) -> Half(307200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,1600,40,1) -> Half(153600,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,1,7680,192) -> Float(307200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,1,7680,192) -> Half(307200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(307200,1,7680,192) -> Half(153600,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(307200,1600,40,1) -> Float(307200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(307200,1600,40,1) -> Float(307200,1,7680,192) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(307200,1600,40,1) -> Half(153600,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,1600:2,40,1) -> Float(307200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,1600:2,40,1) -> Float(307200,1,7680,192) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,1600:2,40,1) -> Half(307200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(307200,1600,40,1) -> Float(76800,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: Tactic: -1 Time: 0.201145 [TensorRT] VERBOSE: Fastest Tactic: -1 Time: 0.201145 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.586458 [TensorRT] VERBOSE: Tactic: 1 Time: 0.585521 [TensorRT] VERBOSE: Tactic: 2 Time: 0.589791 [TensorRT] VERBOSE: Tactic: 5 Time: 222.772 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.585521 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 6.61464 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [TensorRT] VERBOSE: Tactic: 1754984623894446479 Time: 6.83031 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [TensorRT] VERBOSE: Tactic: 3611739942397549984 Time: 7.33141 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [TensorRT] VERBOSE: Tactic: 4337000649858996379 Time: 7.10568 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 7.02307 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 6.44667 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 7.29792 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 6.84724 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 6.41302 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [TensorRT] VERBOSE: Tactic: -9137461792520977713 Time: 7.07031 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 7.36427 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [TensorRT] VERBOSE: Tactic: -8133971918129952780 Time: 7.08359 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [TensorRT] VERBOSE: Tactic: -6092040395344634144 Time: 6.91151 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 6.62937 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 6.5012 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 6.69849 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 6.36266 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 6.9987 [TensorRT] VERBOSE: Fastest Tactic: -836875257600482091 Time: 6.36266 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(307200,1,7680,192) -> Float(76800,1,3840,192) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(307200,1600,40,1) -> Half(76800,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.496511 [TensorRT] VERBOSE: Tactic: 1 Time: 0.503072 [TensorRT] VERBOSE: Tactic: 2 Time: 0.590208 [TensorRT] VERBOSE: Tactic: 5 Time: 221.918 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.496511 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(153600,1600:2,40,1) -> Half(38400,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(76800,400,20,1) -> Float(76800,1,3840,192) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.094375 [TensorRT] VERBOSE: Tactic: 0 Time: 0.125 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.094375 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(76800,400,20,1) -> Half(76800,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.88432 [TensorRT] VERBOSE: Tactic: 0 Time: 0.085208 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.085208 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(76800,400,20,1) -> Half(38400,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.119323 [TensorRT] VERBOSE: Tactic: 0 Time: 0.0675 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.0675 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(76800,1,3840,192) -> Float(76800,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.110157 [TensorRT] VERBOSE: Tactic: 0 Time: 0.124948 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.110157 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(76800,1,3840,192) -> Half(76800,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.081771 [TensorRT] VERBOSE: Tactic: 0 Time: 0.124011 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.081771 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(76800,1,3840,192) -> Half(38400,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.106094 [TensorRT] VERBOSE: Tactic: 0 Time: 0.138073 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.106094 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,400,20,1) -> Float(76800,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.9376 [TensorRT] VERBOSE: Tactic: 0 Time: 0.071146 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.071146 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,400,20,1) -> Float(76800,1,3840,192) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.076823 [TensorRT] VERBOSE: Tactic: 0 Time: 0.121354 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.076823 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,400,20,1) -> Half(38400,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.089271 [TensorRT] VERBOSE: Tactic: 0 Time: 0.067553 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.067553 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,400:2,20,1) -> Float(76800,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.100781 [TensorRT] VERBOSE: Tactic: 0 Time: 0.058438 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.058438 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,400:2,20,1) -> Float(76800,1,3840,192) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.077032 [TensorRT] VERBOSE: Tactic: 0 Time: 0.140521 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.077032 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,400:2,20,1) -> Half(76800,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.146927 [TensorRT] VERBOSE: Tactic: 0 Time: 0.057552 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.057552 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(76800,400,20,1) -> Float(25600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 Time: 0.216302 [TensorRT] VERBOSE: Tactic: 655359 Time: 0.205 [TensorRT] VERBOSE: Tactic: 786431 Time: 0.186771 [TensorRT] VERBOSE: Tactic: 851967 Time: 0.237396 [TensorRT] VERBOSE: Tactic: 1179647 Time: 0.171927 [TensorRT] VERBOSE: Tactic: 1310719 Time: 0.396771 [TensorRT] VERBOSE: Tactic: 1376255 Time: 0.187916 [TensorRT] VERBOSE: Tactic: 1441791 Time: 0.167135 [TensorRT] VERBOSE: Tactic: 1507327 Time: 0.239688 [TensorRT] VERBOSE: Tactic: 1638399 Time: 0.186927 [TensorRT] VERBOSE: Tactic: 1835007 Time: 0.175365 [TensorRT] VERBOSE: Tactic: 1900543 Time: 0.287708 [TensorRT] VERBOSE: Tactic: 2097151 Time: 0.201823 [TensorRT] VERBOSE: Tactic: 2162687 Time: 0.145625 [TensorRT] VERBOSE: Tactic: 2293759 Time: 0.179948 [TensorRT] VERBOSE: Tactic: 2359295 Time: 0.148385 [TensorRT] VERBOSE: Tactic: 2686975 Time: 0.141771 [TensorRT] VERBOSE: Tactic: 3080191 Time: 0.215104 [TensorRT] VERBOSE: Tactic: 3342335 Time: 0.277084 [TensorRT] VERBOSE: Tactic: 3407871 Time: 0.164635 [TensorRT] VERBOSE: Tactic: 3538943 Time: 0.155156 [TensorRT] VERBOSE: Tactic: 3670015 Time: 0.180937 [TensorRT] VERBOSE: Tactic: 3932159 Time: 0.237344 [TensorRT] VERBOSE: Tactic: 3997695 Time: 0.177864 [TensorRT] VERBOSE: Tactic: 4063231 Time: 0.251875 [TensorRT] VERBOSE: Tactic: 4194303 Time: 0.177188 [TensorRT] VERBOSE: Tactic: 4259839 Time: 0.211562 [TensorRT] VERBOSE: Tactic: 4325375 Time: 0.178854 [TensorRT] VERBOSE: Tactic: 4521983 Time: 0.169479 [TensorRT] VERBOSE: Tactic: 4587519 Time: 0.214636 [TensorRT] VERBOSE: Tactic: 4653055 Time: 0.197135 [TensorRT] VERBOSE: Tactic: 4915199 Time: 0.178021 [TensorRT] VERBOSE: Tactic: 4980735 Time: 0.178386 [TensorRT] VERBOSE: Tactic: 5177343 Time: 0.162135 [TensorRT] VERBOSE: Tactic: 5242879 Time: 0.147864 [TensorRT] VERBOSE: Tactic: 5373951 Time: 0.212083 [TensorRT] VERBOSE: Tactic: 5439487 Time: 0.216459 [TensorRT] VERBOSE: Tactic: 5570559 Time: 0.186979 [TensorRT] VERBOSE: Tactic: 5636095 Time: 0.250209 [TensorRT] VERBOSE: Tactic: 5701631 Time: 0.187917 [TensorRT] VERBOSE: Tactic: 5767167 Time: 0.280365 [TensorRT] VERBOSE: Tactic: 5832703 Time: 0.16 [TensorRT] VERBOSE: Tactic: 5898239 Time: 0.13323 [TensorRT] VERBOSE: Tactic: 6029311 Time: 0.173282 [TensorRT] VERBOSE: Tactic: 6225919 Time: 0.143125 [TensorRT] VERBOSE: Tactic: 6291455 Time: 0.172344 [TensorRT] VERBOSE: Tactic: 6422527 Time: 0.217708 [TensorRT] VERBOSE: Tactic: 6750207 Time: 0.180417 [TensorRT] VERBOSE: Tactic: 6815743 Time: 0.158542 [TensorRT] VERBOSE: Tactic: 6946815 Time: 0.238073 [TensorRT] VERBOSE: Tactic: 7012351 Time: 0.201197 [TensorRT] VERBOSE: Tactic: 7077887 Time: 0.15026 [TensorRT] VERBOSE: Tactic: 7143423 Time: 0.265625 [TensorRT] VERBOSE: Tactic: 7208959 Time: 0.152083 [TensorRT] VERBOSE: Tactic: 7340031 Time: 0.14151 [TensorRT] VERBOSE: Tactic: 7405567 Time: 0.163385 [TensorRT] VERBOSE: Tactic: 7536639 Time: 0.162188 [TensorRT] VERBOSE: Tactic: 7602175 Time: 0.218021 [TensorRT] VERBOSE: Tactic: 7733247 Time: 0.15099 [TensorRT] VERBOSE: Tactic: 7798783 Time: 0.188489 [TensorRT] VERBOSE: Tactic: 8191999 Time: 0.263906 [TensorRT] VERBOSE: Tactic: 8257535 Time: 0.179427 [TensorRT] VERBOSE: Tactic: 8323071 Time: 0.184114 [TensorRT] VERBOSE: Tactic: 8650751 Time: 0.216927 [TensorRT] VERBOSE: Tactic: 8716287 Time: 0.160885 [TensorRT] VERBOSE: Tactic: 9109503 Time: 0.206407 [TensorRT] VERBOSE: Tactic: 9568255 Time: 0.177396 [TensorRT] VERBOSE: Tactic: 9895935 Time: 0.177448 [TensorRT] VERBOSE: Tactic: 10223615 Time: 0.139636 [TensorRT] VERBOSE: Tactic: 10354687 Time: 0.196562 [TensorRT] VERBOSE: Tactic: 10551295 Time: 0.187968 [TensorRT] VERBOSE: Tactic: 10747903 Time: 0.143542 [TensorRT] VERBOSE: Tactic: 10944511 Time: 0.179323 [TensorRT] VERBOSE: Fastest Tactic: 5898239 Time: 0.13323 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.165833 [TensorRT] VERBOSE: Tactic: 1 Time: 0.142136 [TensorRT] VERBOSE: Tactic: 2 Time: 0.347291 [TensorRT] VERBOSE: Tactic: 4 Time: 16.9462 [TensorRT] VERBOSE: Tactic: 5 Time: 0.941771 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.142136 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 0.117917 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TensorRT] VERBOSE: Tactic: 1698681053543049347 Time: 0.116875 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 0.154427 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 0.084271 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 0.155937 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TensorRT] VERBOSE: Tactic: 5326823351883942011 Time: 0.149531 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TensorRT] VERBOSE: Tactic: 5500448035057547314 Time: 0.087553 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 0.086615 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 0.115 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 0.157604 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TensorRT] VERBOSE: Tactic: -6576203419454146580 Time: 0.104427 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 0.11875 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 0.108906 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 0.092604 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 0.088854 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 0.152605 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TensorRT] VERBOSE: Tactic: -377491875521947884 Time: 0.153542 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TensorRT] VERBOSE: Tactic: -37215280111360163 Time: 0.083906 [TensorRT] VERBOSE: Fastest Tactic: -37215280111360163 Time: 0.083906 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(76800,1,3840,192) -> Float(25600,1,1280,64) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TensorRT] VERBOSE: Tactic: 3886731678879822788 Time: 0.085521 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TensorRT] VERBOSE: Tactic: 6629944304117643200 Time: 0.150989 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TensorRT] VERBOSE: Tactic: -9153228964338181824 Time: 0.15276 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TensorRT] VERBOSE: Tactic: -7394439838318485025 Time: 0.085834 [TensorRT] VERBOSE: Fastest Tactic: 3886731678879822788 Time: 0.085521 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(76800,400,20,1) -> Half(25600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.169063 [TensorRT] VERBOSE: Tactic: 1 Time: 0.145365 [TensorRT] VERBOSE: Tactic: 2 Time: 0.339427 [TensorRT] VERBOSE: Tactic: 4 Time: 16.8658 [TensorRT] VERBOSE: Tactic: 5 Time: 0.901979 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.145365 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(38400,400:2,20,1) -> Half(25600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(38400,400:2,20,1) -> Half(12800,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 Time: 0.092552 [TensorRT] VERBOSE: Tactic: 655359 Time: 0.127239 [TensorRT] VERBOSE: Tactic: 786431 Time: 0.102708 [TensorRT] VERBOSE: Tactic: 851967 Time: 0.132083 [TensorRT] VERBOSE: Tactic: 1179647 Time: 0.086302 [TensorRT] VERBOSE: Tactic: 1310719 Time: 0.214896 [TensorRT] VERBOSE: Tactic: 1376255 Time: 0.087708 [TensorRT] VERBOSE: Tactic: 1441791 Time: 0.084167 [TensorRT] VERBOSE: Tactic: 1507327 Time: 0.116667 [TensorRT] VERBOSE: Tactic: 1638399 Time: 0.096406 [TensorRT] VERBOSE: Tactic: 1835007 Time: 0.100416 [TensorRT] VERBOSE: Tactic: 1900543 Time: 0.126093 [TensorRT] VERBOSE: Tactic: 2097151 Time: 0.12823 [TensorRT] VERBOSE: Tactic: 2162687 Time: 0.068907 [TensorRT] VERBOSE: Tactic: 2293759 Time: 0.081875 [TensorRT] VERBOSE: Tactic: 2359295 Time: 0.072917 [TensorRT] VERBOSE: Tactic: 2686975 Time: 0.100833 [TensorRT] VERBOSE: Tactic: 3080191 Time: 0.12375 [TensorRT] VERBOSE: Tactic: 3342335 Time: 0.133125 [TensorRT] VERBOSE: Tactic: 3407871 Time: 0.081302 [TensorRT] VERBOSE: Tactic: 3538943 Time: 0.080885 [TensorRT] VERBOSE: Tactic: 3670015 Time: 0.096198 [TensorRT] VERBOSE: Tactic: 3932159 Time: 0.096562 [TensorRT] VERBOSE: Tactic: 3997695 Time: 0.102916 [TensorRT] VERBOSE: Tactic: 4063231 Time: 0.1425 [TensorRT] VERBOSE: Tactic: 4194303 Time: 0.100469 [TensorRT] VERBOSE: Tactic: 4259839 Time: 0.127812 [TensorRT] VERBOSE: Tactic: 4325375 Time: 0.09276 [TensorRT] VERBOSE: Tactic: 4521983 Time: 0.09875 [TensorRT] VERBOSE: Tactic: 4587519 Time: 0.134062 [TensorRT] VERBOSE: Tactic: 4653055 Time: 0.106146 [TensorRT] VERBOSE: Tactic: 4915199 Time: 0.101771 [TensorRT] VERBOSE: Tactic: 4980735 Time: 0.095104 [TensorRT] VERBOSE: Tactic: 5177343 Time: 0.077864 [TensorRT] VERBOSE: Tactic: 5242879 Time: 0.076355 [TensorRT] VERBOSE: Tactic: 5373951 Time: 0.092552 [TensorRT] VERBOSE: Tactic: 5439487 Time: 0.115052 [TensorRT] VERBOSE: Tactic: 5570559 Time: 0.116771 [TensorRT] VERBOSE: Tactic: 5636095 Time: 0.142396 [TensorRT] VERBOSE: Tactic: 5701631 Time: 0.07375 [TensorRT] VERBOSE: Tactic: 5767167 Time: 0.139843 [TensorRT] VERBOSE: Tactic: 5832703 Time: 0.076667 [TensorRT] VERBOSE: Tactic: 5898239 Time: 0.082187 [TensorRT] VERBOSE: Tactic: 6029311 Time: 0.073959 [TensorRT] VERBOSE: Tactic: 6225919 Time: 0.071458 [TensorRT] VERBOSE: Tactic: 6291455 Time: 0.085312 [TensorRT] VERBOSE: Tactic: 6422527 Time: 0.117344 [TensorRT] VERBOSE: Tactic: 6750207 Time: 0.101614 [TensorRT] VERBOSE: Tactic: 6815743 Time: 0.084583 [TensorRT] VERBOSE: Tactic: 6946815 Time: 0.119271 [TensorRT] VERBOSE: Tactic: 7012351 Time: 0.128489 [TensorRT] VERBOSE: Tactic: 7077887 Time: 0.075782 [TensorRT] VERBOSE: Tactic: 7143423 Time: 0.135312 [TensorRT] VERBOSE: Tactic: 7208959 Time: 0.077292 [TensorRT] VERBOSE: Tactic: 7340031 Time: 0.082032 [TensorRT] VERBOSE: Tactic: 7405567 Time: 0.082031 [TensorRT] VERBOSE: Tactic: 7536639 Time: 0.085625 [TensorRT] VERBOSE: Tactic: 7602175 Time: 0.107395 [TensorRT] VERBOSE: Tactic: 7733247 Time: 0.075104 [TensorRT] VERBOSE: Tactic: 7798783 Time: 0.102657 [TensorRT] VERBOSE: Tactic: 8191999 Time: 0.139791 [TensorRT] VERBOSE: Tactic: 8257535 Time: 0.100677 [TensorRT] VERBOSE: Tactic: 8323071 Time: 0.101979 [TensorRT] VERBOSE: Tactic: 8650751 Time: 0.103542 [TensorRT] VERBOSE: Tactic: 8716287 Time: 0.082969 [TensorRT] VERBOSE: Tactic: 9109503 Time: 0.121511 [TensorRT] VERBOSE: Tactic: 9568255 Time: 0.102761 [TensorRT] VERBOSE: Tactic: 9895935 Time: 0.098281 [TensorRT] VERBOSE: Tactic: 10223615 Time: 0.097395 [TensorRT] VERBOSE: Tactic: 10354687 Time: 0.123594 [TensorRT] VERBOSE: Tactic: 10551295 Time: 0.09401 [TensorRT] VERBOSE: Tactic: 10747903 Time: 0.070521 [TensorRT] VERBOSE: Tactic: 10944511 Time: 0.09599 [TensorRT] VERBOSE: Fastest Tactic: 2162687 Time: 0.068907 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TensorRT] VERBOSE: Tactic: 3066127711859985668 Time: 0.054687 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TensorRT] VERBOSE: Tactic: 3564772625446233998 Time: 0.061146 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TensorRT] VERBOSE: Tactic: 5319956359050645452 Time: 0.056615 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TensorRT] VERBOSE: Tactic: 7205456024582378848 Time: 0.047605 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TensorRT] VERBOSE: Tactic: 8163473458334948789 Time: 0.047448 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TensorRT] VERBOSE: Tactic: -4212163711445252890 Time: 0.082708 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TensorRT] VERBOSE: Tactic: -3898373634979201110 Time: 0.084427 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TensorRT] VERBOSE: Tactic: -2409163523992614473 Time: 0.049791 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_6_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TensorRT] VERBOSE: Tactic: -1716393687483585322 Time: 0.080521 [TensorRT] VERBOSE: Fastest Tactic: 8163473458334948789 Time: 0.047448 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8163473458334948789 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,400,20,1) -> Float(25600,1,1280,64) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.033646 [TensorRT] VERBOSE: Tactic: 0 Time: 0.043021 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.033646 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,400,20,1) -> Half(25600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.633229 [TensorRT] VERBOSE: Tactic: 0 Time: 0.029323 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.029323 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,400,20,1) -> Half(12800,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.045105 [TensorRT] VERBOSE: Tactic: 0 Time: 0.024062 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.024062 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,1,1280,64) -> Float(25600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.044792 [TensorRT] VERBOSE: Tactic: 0 Time: 0.039531 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.039531 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,1,1280,64) -> Half(25600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.030937 [TensorRT] VERBOSE: Tactic: 0 Time: 0.039479 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.030937 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,1,1280,64) -> Half(12800,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.04026 [TensorRT] VERBOSE: Tactic: 0 Time: 0.04724 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.04026 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400,20,1) -> Float(25600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.651875 [TensorRT] VERBOSE: Tactic: 0 Time: 0.026302 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.026302 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400,20,1) -> Float(25600,1,1280,64) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.028646 [TensorRT] VERBOSE: Tactic: 0 Time: 0.043125 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.028646 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400,20,1) -> Half(12800,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.031198 [TensorRT] VERBOSE: Tactic: 0 Time: 0.023958 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.023958 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,400:2,20,1) -> Float(25600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.038177 [TensorRT] VERBOSE: Tactic: 0 Time: 0.021667 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.021667 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,400:2,20,1) -> Float(25600,1,1280,64) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.028594 [TensorRT] VERBOSE: Tactic: 0 Time: 0.049531 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.028594 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,400:2,20,1) -> Half(25600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.054167 [TensorRT] VERBOSE: Tactic: 0 Time: 0.021719 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.021719 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,400,20,1) -> Float(25600,1,1280,64) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.033282 [TensorRT] VERBOSE: Tactic: 0 Time: 0.042969 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.033282 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,400,20,1) -> Half(25600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.633333 [TensorRT] VERBOSE: Tactic: 0 Time: 0.029166 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.029166 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,400,20,1) -> Half(12800,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.04474 [TensorRT] VERBOSE: Tactic: 0 Time: 0.024062 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.024062 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,1,1280,64) -> Float(25600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.044688 [TensorRT] VERBOSE: Tactic: 0 Time: 0.039583 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.039583 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,1,1280,64) -> Half(25600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.031146 [TensorRT] VERBOSE: Tactic: 0 Time: 0.040313 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.031146 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,1,1280,64) -> Half(12800,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.040208 [TensorRT] VERBOSE: Tactic: 0 Time: 0.047396 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.040208 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400,20,1) -> Float(25600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.651719 [TensorRT] VERBOSE: Tactic: 0 Time: 0.026354 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.026354 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400,20,1) -> Float(25600,1,1280,64) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.02875 [TensorRT] VERBOSE: Tactic: 0 Time: 0.043177 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.02875 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400,20,1) -> Half(12800,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.033437 [TensorRT] VERBOSE: Tactic: 0 Time: 0.024062 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.024062 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,400:2,20,1) -> Float(25600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.038125 [TensorRT] VERBOSE: Tactic: 0 Time: 0.021771 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.021771 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,400:2,20,1) -> Float(25600,1,1280,64) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.028698 [TensorRT] VERBOSE: Tactic: 0 Time: 0.049584 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.028698 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,400:2,20,1) -> Half(25600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.054219 [TensorRT] VERBOSE: Tactic: 0 Time: 0.021719 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.021719 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(25600,400,20,1) -> Float(153600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.499427 [TensorRT] VERBOSE: Tactic: 1 Time: 0.504531 [TensorRT] VERBOSE: Tactic: 2 Time: 0.508177 [TensorRT] VERBOSE: Tactic: 4 Time: 38.9825 [TensorRT] VERBOSE: Tactic: 5 Time: 2.28953 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.499427 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 0.254062 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TensorRT] VERBOSE: Tactic: 1698681053543049347 Time: 0.223542 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 0.201458 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 0.195625 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 0.210573 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TensorRT] VERBOSE: Tactic: 5326823351883942011 Time: 0.200625 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TensorRT] VERBOSE: Tactic: 5500448035057547314 Time: 0.214792 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 0.199115 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 0.246615 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 0.208437 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TensorRT] VERBOSE: Tactic: -6576203419454146580 Time: 0.230834 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 0.255209 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 0.237656 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 0.211198 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 0.208125 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 0.204167 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TensorRT] VERBOSE: Tactic: -377491875521947884 Time: 0.201667 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TensorRT] VERBOSE: Tactic: -37215280111360163 Time: 0.190781 [TensorRT] VERBOSE: Fastest Tactic: -37215280111360163 Time: 0.190781 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(25600,1,1280,64) -> Float(153600,1,7680,384) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TensorRT] VERBOSE: Tactic: 3886731678879822788 Time: 0.232032 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TensorRT] VERBOSE: Tactic: 6629944304117643200 Time: 0.520834 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TensorRT] VERBOSE: Tactic: -9153228964338181824 Time: 0.524583 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TensorRT] VERBOSE: Tactic: -7394439838318485025 Time: 0.220885 [TensorRT] VERBOSE: Fastest Tactic: -7394439838318485025 Time: 0.220885 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(25600,400,20,1) -> Half(153600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.497239 [TensorRT] VERBOSE: Tactic: 1 Time: 0.429115 [TensorRT] VERBOSE: Tactic: 2 Time: 0.452187 [TensorRT] VERBOSE: Tactic: 4 Time: 37.9534 [TensorRT] VERBOSE: Tactic: 5 Time: 2.18443 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.429115 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(12800,400:2,20,1) -> Half(153600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(12800,400:2,20,1) -> Half(76800,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TensorRT] VERBOSE: Tactic: 3066127711859985668 Time: 0.137239 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TensorRT] VERBOSE: Tactic: 3564772625446233998 Time: 0.150208 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TensorRT] VERBOSE: Tactic: 5319956359050645452 Time: 0.141563 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TensorRT] VERBOSE: Tactic: 7205456024582378848 Time: 0.118594 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TensorRT] VERBOSE: Tactic: 8163473458334948789 Time: 0.113802 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TensorRT] VERBOSE: Tactic: -4212163711445252890 Time: 0.114896 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TensorRT] VERBOSE: Tactic: -3898373634979201110 Time: 0.117032 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TensorRT] VERBOSE: Tactic: -2409163523992614473 Time: 0.116146 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TensorRT] VERBOSE: Tactic: -1716393687483585322 Time: 0.111197 [TensorRT] VERBOSE: Fastest Tactic: -1716393687483585322 Time: 0.111197 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1716393687483585322 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,400,20,1) -> Float(153600,1,7680,384) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.181719 [TensorRT] VERBOSE: Tactic: 0 Time: 0.274739 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.181719 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,400,20,1) -> Half(153600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 3.7588 [TensorRT] VERBOSE: Tactic: 0 Time: 0.162864 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.162864 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,400,20,1) -> Half(76800,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.226198 [TensorRT] VERBOSE: Tactic: 0 Time: 0.129948 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.129948 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,1,7680,384) -> Float(153600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.206459 [TensorRT] VERBOSE: Tactic: 0 Time: 0.245364 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.206459 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,1,7680,384) -> Half(153600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.156458 [TensorRT] VERBOSE: Tactic: 0 Time: 0.241406 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.156458 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,1,7680,384) -> Half(76800,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.201927 [TensorRT] VERBOSE: Tactic: 0 Time: 0.270989 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.201927 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,400,20,1) -> Float(153600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 3.86531 [TensorRT] VERBOSE: Tactic: 0 Time: 0.138333 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.138333 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,400,20,1) -> Float(153600,1,7680,384) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.147656 [TensorRT] VERBOSE: Tactic: 0 Time: 0.236927 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.147656 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,400,20,1) -> Half(76800,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.165834 [TensorRT] VERBOSE: Tactic: 0 Time: 0.128698 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.128698 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,400:2,20,1) -> Float(153600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.190105 [TensorRT] VERBOSE: Tactic: 0 Time: 0.113385 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.113385 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,400:2,20,1) -> Float(153600,1,7680,384) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.147865 [TensorRT] VERBOSE: Tactic: 0 Time: 0.273021 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.147865 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,400:2,20,1) -> Half(153600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.271614 [TensorRT] VERBOSE: Tactic: 0 Time: 0.110573 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.110573 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(153600,400,20,1) -> Float(153600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: Tactic: -1 Time: 0.266094 [TensorRT] VERBOSE: Fastest Tactic: -1 Time: 0.266094 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.495885 [TensorRT] VERBOSE: Tactic: 1 Time: 0.496927 [TensorRT] VERBOSE: Tactic: 2 Time: 0.542656 [TensorRT] VERBOSE: Tactic: 4 Time: 55.3694 [TensorRT] VERBOSE: Tactic: 5 Time: 117.917 [TensorRT] VERBOSE: Tactic: 6 Time: 19.0096 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.495885 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 10.4954 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [TensorRT] VERBOSE: Tactic: 1754984623894446479 Time: 11.4307 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [TensorRT] VERBOSE: Tactic: 3611739942397549984 Time: 14.7035 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724 [TensorRT] VERBOSE: Tactic: 3827454225649558724 Time: 17.9322 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [TensorRT] VERBOSE: Tactic: 4337000649858996379 Time: 11.6474 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 14.2601 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 10.3102 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 14.5834 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896 [TensorRT] VERBOSE: Tactic: 5921334924264294896 Time: 12.8726 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 11.1173 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 10.5606 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038 [TensorRT] VERBOSE: Tactic: 7852627285308570038 Time: 19.1034 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [TensorRT] VERBOSE: Tactic: -9137461792520977713 Time: 14.3677 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509 [TensorRT] VERBOSE: Tactic: -8776506421218919509 Time: 17.3657 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 14.8472 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [TensorRT] VERBOSE: Tactic: -8133971918129952780 Time: 11.422 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [TensorRT] VERBOSE: Tactic: -6092040395344634144 Time: 11.1546 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 10.6656 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 10.3468 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239 [TensorRT] VERBOSE: Tactic: -2318106587342035239 Time: 18.2374 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657 [TensorRT] VERBOSE: Tactic: -1343271414618805657 Time: 12.7386 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 10.8202 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 10.3119 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 14.1634 [TensorRT] VERBOSE: Fastest Tactic: 5137655947464784826 Time: 10.3102 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(153600,1,7680,384) -> Float(153600,1,7680,384) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(153600,400,20,1) -> Half(153600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.266667 [TensorRT] VERBOSE: Tactic: 1 Time: 0.271354 [TensorRT] VERBOSE: Tactic: 2 Time: 18.5498 [TensorRT] VERBOSE: Tactic: 4 Time: 55.4833 [TensorRT] VERBOSE: Tactic: 5 Time: 117.657 [TensorRT] VERBOSE: Tactic: 6 Time: 132.439 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.266667 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(76800,400:2,20,1) -> Half(76800,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,400,20,1) -> Float(153600,1,7680,384) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,400,20,1) -> Half(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,400,20,1) -> Half(76800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,1,7680,384) -> Float(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,1,7680,384) -> Half(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,1,7680,384) -> Half(76800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,400,20,1) -> Float(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,400,20,1) -> Float(153600,1,7680,384) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,400,20,1) -> Half(76800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,400:2,20,1) -> Float(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,400:2,20,1) -> Float(153600,1,7680,384) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,400:2,20,1) -> Half(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,400,20,1) -> Float(25600,1,1280,64) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,400,20,1) -> Half(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,400,20,1) -> Half(12800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,1,1280,64) -> Float(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,1,1280,64) -> Half(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,1,1280,64) -> Half(12800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400,20,1) -> Float(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400,20,1) -> Float(25600,1,1280,64) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400,20,1) -> Half(12800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,400:2,20,1) -> Float(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,400:2,20,1) -> Float(25600,1,1280,64) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,400:2,20,1) -> Half(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(153600,400,20,1), Float(25600,400,20,1) -> Float(25600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.309531 [TensorRT] VERBOSE: Tactic: 1 Time: 0.26151 [TensorRT] VERBOSE: Tactic: 2 Time: 0.59724 [TensorRT] VERBOSE: Tactic: 4 Time: 32.7102 [TensorRT] VERBOSE: Tactic: 5 Time: 1.76375 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.26151 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 0.212292 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TensorRT] VERBOSE: Tactic: 1698681053543049347 Time: 0.215573 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 0.286615 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 0.151875 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 0.282344 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TensorRT] VERBOSE: Tactic: 5326823351883942011 Time: 0.274948 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TensorRT] VERBOSE: Tactic: 5500448035057547314 Time: 0.164427 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 0.160573 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 0.221823 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 0.286563 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TensorRT] VERBOSE: Tactic: -6576203419454146580 Time: 0.189375 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 0.229219 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 0.19151 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 0.165625 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 0.162396 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 0.278073 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TensorRT] VERBOSE: Tactic: -377491875521947884 Time: 0.280104 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TensorRT] VERBOSE: Tactic: -37215280111360163 Time: 0.151615 [TensorRT] VERBOSE: Fastest Tactic: -37215280111360163 Time: 0.151615 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(153600,1,7680,384), Float(25600,1,1280,64) -> Float(25600,1,1280,64) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TensorRT] VERBOSE: Tactic: 3886731678879822788 Time: 0.153906 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TensorRT] VERBOSE: Tactic: 6629944304117643200 Time: 0.271667 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TensorRT] VERBOSE: Tactic: -9153228964338181824 Time: 0.270885 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TensorRT] VERBOSE: Tactic: -7394439838318485025 Time: 0.153907 [TensorRT] VERBOSE: Fastest Tactic: 3886731678879822788 Time: 0.153906 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(153600,400,20,1), Half(25600,400,20,1) -> Half(25600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.31026 [TensorRT] VERBOSE: Tactic: 1 Time: 0.290834 [TensorRT] VERBOSE: Tactic: 2 Time: 0.585416 [TensorRT] VERBOSE: Tactic: 4 Time: 32.1004 [TensorRT] VERBOSE: Tactic: 5 Time: 1.69094 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.290834 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(76800,400:2,20,1), Half(12800,400:2,20,1) -> Half(12800,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TensorRT] VERBOSE: Tactic: 3066127711859985668 Time: 0.099688 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TensorRT] VERBOSE: Tactic: 3564772625446233998 Time: 0.114948 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TensorRT] VERBOSE: Tactic: 5319956359050645452 Time: 0.105052 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TensorRT] VERBOSE: Tactic: 7205456024582378848 Time: 0.087604 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TensorRT] VERBOSE: Tactic: 8163473458334948789 Time: 0.081927 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TensorRT] VERBOSE: Tactic: -4212163711445252890 Time: 0.147083 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TensorRT] VERBOSE: Tactic: -3898373634979201110 Time: 0.149479 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TensorRT] VERBOSE: Tactic: -2409163523992614473 Time: 0.080677 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_7_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TensorRT] VERBOSE: Tactic: -1716393687483585322 Time: 0.143907 [TensorRT] VERBOSE: Fastest Tactic: -2409163523992614473 Time: 0.080677 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2409163523992614473 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,400,20,1) -> Float(25600,1,1280,64) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,400,20,1) -> Half(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,400,20,1) -> Half(12800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,1,1280,64) -> Float(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,1,1280,64) -> Half(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,1,1280,64) -> Half(12800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400,20,1) -> Float(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400,20,1) -> Float(25600,1,1280,64) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400,20,1) -> Half(12800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,400:2,20,1) -> Float(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,400:2,20,1) -> Float(25600,1,1280,64) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,400:2,20,1) -> Half(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,400,20,1) -> Float(25600,1,1280,64) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,400,20,1) -> Half(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,400,20,1) -> Half(12800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,1,1280,64) -> Float(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,1,1280,64) -> Half(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,1,1280,64) -> Half(12800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400,20,1) -> Float(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400,20,1) -> Float(25600,1,1280,64) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400,20,1) -> Half(12800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,400:2,20,1) -> Float(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,400:2,20,1) -> Float(25600,1,1280,64) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,400:2,20,1) -> Half(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(25600,400,20,1) -> Float(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(25600,1,1280,64) -> Float(153600,1,7680,384) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(25600,400,20,1) -> Half(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(12800,400:2,20,1) -> Half(153600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(12800,400:2,20,1) -> Half(76800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,400,20,1) -> Float(153600,1,7680,384) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,400,20,1) -> Half(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,400,20,1) -> Half(76800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,1,7680,384) -> Float(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,1,7680,384) -> Half(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,1,7680,384) -> Half(76800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,400,20,1) -> Float(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,400,20,1) -> Float(153600,1,7680,384) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,400,20,1) -> Half(76800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,400:2,20,1) -> Float(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,400:2,20,1) -> Float(153600,1,7680,384) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,400:2,20,1) -> Half(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(153600,400,20,1) -> Float(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(153600,1,7680,384) -> Float(153600,1,7680,384) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_depthwise_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(153600,400,20,1) -> Half(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(76800,400:2,20,1) -> Half(76800,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_8_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,400,20,1) -> Float(153600,1,7680,384) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,400,20,1) -> Half(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,400,20,1) -> Half(76800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,1,7680,384) -> Float(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,1,7680,384) -> Half(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,1,7680,384) -> Half(76800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,400,20,1) -> Float(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,400,20,1) -> Float(153600,1,7680,384) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,400,20,1) -> Half(76800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,400:2,20,1) -> Float(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,400:2,20,1) -> Float(153600,1,7680,384) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,400:2,20,1) -> Half(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,400,20,1) -> Float(25600,1,1280,64) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,400,20,1) -> Half(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,400,20,1) -> Half(12800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,1,1280,64) -> Float(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,1,1280,64) -> Half(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,1,1280,64) -> Half(12800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400,20,1) -> Float(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400,20,1) -> Float(25600,1,1280,64) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400,20,1) -> Half(12800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,400:2,20,1) -> Float(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,400:2,20,1) -> Float(25600,1,1280,64) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,400:2,20,1) -> Half(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(153600,400,20,1), Float(25600,400,20,1) -> Float(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(153600,1,7680,384), Float(25600,1,1280,64) -> Float(25600,1,1280,64) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(153600,400,20,1), Half(25600,400,20,1) -> Half(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(76800,400:2,20,1), Half(12800,400:2,20,1) -> Half(12800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,400,20,1) -> Float(25600,1,1280,64) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,400,20,1) -> Half(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,400,20,1) -> Half(12800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,1,1280,64) -> Float(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,1,1280,64) -> Half(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,1,1280,64) -> Half(12800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400,20,1) -> Float(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400,20,1) -> Float(25600,1,1280,64) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400,20,1) -> Half(12800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,400:2,20,1) -> Float(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,400:2,20,1) -> Float(25600,1,1280,64) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,400:2,20,1) -> Half(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,400,20,1) -> Float(25600,1,1280,64) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,400,20,1) -> Half(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,400,20,1) -> Half(12800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,1,1280,64) -> Float(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,1,1280,64) -> Half(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,1,1280,64) -> Half(12800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400,20,1) -> Float(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400,20,1) -> Float(25600,1,1280,64) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400,20,1) -> Half(12800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,400:2,20,1) -> Float(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,400:2,20,1) -> Float(25600,1,1280,64) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,400:2,20,1) -> Half(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(25600,400,20,1) -> Float(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(25600,1,1280,64) -> Float(153600,1,7680,384) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(25600,400,20,1) -> Half(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(12800,400:2,20,1) -> Half(153600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(12800,400:2,20,1) -> Half(76800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,400,20,1) -> Float(153600,1,7680,384) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,400,20,1) -> Half(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,400,20,1) -> Half(76800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,1,7680,384) -> Float(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,1,7680,384) -> Half(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,1,7680,384) -> Half(76800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,400,20,1) -> Float(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,400,20,1) -> Float(153600,1,7680,384) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,400,20,1) -> Half(76800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,400:2,20,1) -> Float(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,400:2,20,1) -> Float(153600,1,7680,384) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,400:2,20,1) -> Half(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(153600,400,20,1) -> Float(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(153600,1,7680,384) -> Float(153600,1,7680,384) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_depthwise_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(153600,400,20,1) -> Half(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(76800,400:2,20,1) -> Half(76800,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_9_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,400,20,1) -> Float(153600,1,7680,384) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,400,20,1) -> Half(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,400,20,1) -> Half(76800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,1,7680,384) -> Float(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,1,7680,384) -> Half(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,1,7680,384) -> Half(76800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,400,20,1) -> Float(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,400,20,1) -> Float(153600,1,7680,384) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,400,20,1) -> Half(76800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,400:2,20,1) -> Float(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,400:2,20,1) -> Float(153600,1,7680,384) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,400:2,20,1) -> Half(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,400,20,1) -> Float(25600,1,1280,64) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,400,20,1) -> Half(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,400,20,1) -> Half(12800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,1,1280,64) -> Float(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,1,1280,64) -> Half(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,1,1280,64) -> Half(12800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400,20,1) -> Float(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400,20,1) -> Float(25600,1,1280,64) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400,20,1) -> Half(12800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,400:2,20,1) -> Float(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,400:2,20,1) -> Float(25600,1,1280,64) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,400:2,20,1) -> Half(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(153600,400,20,1), Float(25600,400,20,1) -> Float(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(153600,1,7680,384), Float(25600,1,1280,64) -> Float(25600,1,1280,64) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(153600,400,20,1), Half(25600,400,20,1) -> Half(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(76800,400:2,20,1), Half(12800,400:2,20,1) -> Half(12800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,400,20,1) -> Float(25600,1,1280,64) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,400,20,1) -> Half(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,400,20,1) -> Half(12800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,1,1280,64) -> Float(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,1,1280,64) -> Half(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,1,1280,64) -> Half(12800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400,20,1) -> Float(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400,20,1) -> Float(25600,1,1280,64) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400,20,1) -> Half(12800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,400:2,20,1) -> Float(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,400:2,20,1) -> Float(25600,1,1280,64) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,400:2,20,1) -> Half(25600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(25600,400,20,1) -> Float(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(25600,1,1280,64) -> Float(153600,1,7680,384) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(25600,400,20,1) -> Half(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(12800,400:2,20,1) -> Half(153600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(12800,400:2,20,1) -> Half(76800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,400,20,1) -> Float(153600,1,7680,384) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,400,20,1) -> Half(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,400,20,1) -> Half(76800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,1,7680,384) -> Float(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,1,7680,384) -> Half(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,1,7680,384) -> Half(76800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,400,20,1) -> Float(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,400,20,1) -> Float(153600,1,7680,384) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,400,20,1) -> Half(76800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,400:2,20,1) -> Float(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,400:2,20,1) -> Float(153600,1,7680,384) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,400:2,20,1) -> Half(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(153600,400,20,1) -> Float(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(153600,1,7680,384) -> Float(153600,1,7680,384) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_depthwise_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(153600,400,20,1) -> Half(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(76800,400:2,20,1) -> Half(76800,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,400,20,1) -> Float(153600,1,7680,384) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,400,20,1) -> Half(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,400,20,1) -> Half(76800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,1,7680,384) -> Float(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,1,7680,384) -> Half(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(153600,1,7680,384) -> Half(76800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,400,20,1) -> Float(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,400,20,1) -> Float(153600,1,7680,384) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(153600,400,20,1) -> Half(76800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,400:2,20,1) -> Float(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,400:2,20,1) -> Float(153600,1,7680,384) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(76800,400:2,20,1) -> Half(153600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(153600,400,20,1) -> Float(38400,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 Time: 0.418333 [TensorRT] VERBOSE: Tactic: 655359 Time: 0.385573 [TensorRT] VERBOSE: Tactic: 786431 Time: 0.41625 [TensorRT] VERBOSE: Tactic: 851967 Time: 0.486771 [TensorRT] VERBOSE: Tactic: 1179647 Time: 0.601354 [TensorRT] VERBOSE: Tactic: 1310719 Time: 0.902292 [TensorRT] VERBOSE: Tactic: 1376255 Time: 0.49651 [TensorRT] VERBOSE: Tactic: 1441791 Time: 0.542344 [TensorRT] VERBOSE: Tactic: 1507327 Time: 0.469948 [TensorRT] VERBOSE: Tactic: 1638399 Time: 0.479062 [TensorRT] VERBOSE: Tactic: 1835007 Time: 0.436145 [TensorRT] VERBOSE: Tactic: 1900543 Time: 0.542709 [TensorRT] VERBOSE: Tactic: 2097151 Time: 0.521563 [TensorRT] VERBOSE: Tactic: 2162687 Time: 0.408177 [TensorRT] VERBOSE: Tactic: 2293759 Time: 0.500782 [TensorRT] VERBOSE: Tactic: 2359295 Time: 0.417292 [TensorRT] VERBOSE: Tactic: 2686975 Time: 0.380573 [TensorRT] VERBOSE: Tactic: 3080191 Time: 0.425833 [TensorRT] VERBOSE: Tactic: 3342335 Time: 0.55401 [TensorRT] VERBOSE: Tactic: 3407871 Time: 0.485052 [TensorRT] VERBOSE: Tactic: 3538943 Time: 0.512343 [TensorRT] VERBOSE: Tactic: 3670015 Time: 0.347343 [TensorRT] VERBOSE: Tactic: 3932159 Time: 0.459844 [TensorRT] VERBOSE: Tactic: 3997695 Time: 0.434114 [TensorRT] VERBOSE: Tactic: 4063231 Time: 0.517761 [TensorRT] VERBOSE: Tactic: 4194303 Time: 0.431354 [TensorRT] VERBOSE: Tactic: 4259839 Time: 0.527239 [TensorRT] VERBOSE: Tactic: 4325375 Time: 0.442187 [TensorRT] VERBOSE: Tactic: 4521983 Time: 0.438021 [TensorRT] VERBOSE: Tactic: 4587519 Time: 0.539583 [TensorRT] VERBOSE: Tactic: 4653055 Time: 0.64974 [TensorRT] VERBOSE: Tactic: 4915199 Time: 0.421771 [TensorRT] VERBOSE: Tactic: 4980735 Time: 0.432448 [TensorRT] VERBOSE: Tactic: 5177343 Time: 0.627396 [TensorRT] VERBOSE: Tactic: 5242879 Time: 0.432031 [TensorRT] VERBOSE: Tactic: 5373951 Time: 0.708385 [TensorRT] VERBOSE: Tactic: 5439487 Time: 0.527344 [TensorRT] VERBOSE: Tactic: 5570559 Time: 0.34974 [TensorRT] VERBOSE: Tactic: 5636095 Time: 0.522656 [TensorRT] VERBOSE: Tactic: 5701631 Time: 0.501302 [TensorRT] VERBOSE: Tactic: 5767167 Time: 0.855677 [TensorRT] VERBOSE: Tactic: 5832703 Time: 0.476198 [TensorRT] VERBOSE: Tactic: 5898239 Time: 0.430052 [TensorRT] VERBOSE: Tactic: 6029311 Time: 0.474427 [TensorRT] VERBOSE: Tactic: 6225919 Time: 0.479687 [TensorRT] VERBOSE: Tactic: 6291455 Time: 0.593177 [TensorRT] VERBOSE: Tactic: 6422527 Time: 0.426302 [TensorRT] VERBOSE: Tactic: 6750207 Time: 0.436823 [TensorRT] VERBOSE: Tactic: 6815743 Time: 0.479427 [TensorRT] VERBOSE: Tactic: 6946815 Time: 0.62349 [TensorRT] VERBOSE: Tactic: 7012351 Time: 0.522084 [TensorRT] VERBOSE: Tactic: 7077887 Time: 0.516146 [TensorRT] VERBOSE: Tactic: 7143423 Time: 0.718281 [TensorRT] VERBOSE: Tactic: 7208959 Time: 0.447344 [TensorRT] VERBOSE: Tactic: 7340031 Time: 0.470833 [TensorRT] VERBOSE: Tactic: 7405567 Time: 0.545417 [TensorRT] VERBOSE: Tactic: 7536639 Time: 0.514688 [TensorRT] VERBOSE: Tactic: 7602175 Time: 0.573333 [TensorRT] VERBOSE: Tactic: 7733247 Time: 0.459636 [TensorRT] VERBOSE: Tactic: 7798783 Time: 0.414687 [TensorRT] VERBOSE: Tactic: 8191999 Time: 0.694844 [TensorRT] VERBOSE: Tactic: 8257535 Time: 0.430052 [TensorRT] VERBOSE: Tactic: 8323071 Time: 0.438437 [TensorRT] VERBOSE: Tactic: 8650751 Time: 0.538385 [TensorRT] VERBOSE: Tactic: 8716287 Time: 0.548072 [TensorRT] VERBOSE: Tactic: 9109503 Time: 0.56651 [TensorRT] VERBOSE: Tactic: 9568255 Time: 0.424532 [TensorRT] VERBOSE: Tactic: 9895935 Time: 0.435625 [TensorRT] VERBOSE: Tactic: 10223615 Time: 0.375573 [TensorRT] VERBOSE: Tactic: 10354687 Time: 0.505365 [TensorRT] VERBOSE: Tactic: 10551295 Time: 0.456719 [TensorRT] VERBOSE: Tactic: 10747903 Time: 0.433386 [TensorRT] VERBOSE: Tactic: 10944511 Time: 0.433541 [TensorRT] VERBOSE: Fastest Tactic: 3670015 Time: 0.347343 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.412812 [TensorRT] VERBOSE: Tactic: 1 Time: 0.350781 [TensorRT] VERBOSE: Tactic: 2 Time: 0.586927 [TensorRT] VERBOSE: Tactic: 4 Time: 49.6655 [TensorRT] VERBOSE: Tactic: 5 Time: 2.29859 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.350781 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 0.290104 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TensorRT] VERBOSE: Tactic: 1698681053543049347 Time: 0.268229 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 0.282083 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 0.276041 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 0.280208 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TensorRT] VERBOSE: Tactic: 5326823351883942011 Time: 0.272031 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TensorRT] VERBOSE: Tactic: 5500448035057547314 Time: 0.298854 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 0.294583 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 0.328958 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 0.283959 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TensorRT] VERBOSE: Tactic: -6576203419454146580 Time: 0.257761 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 0.32151 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 0.265729 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 0.305885 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 0.302292 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 0.275208 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TensorRT] VERBOSE: Tactic: -377491875521947884 Time: 0.275729 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TensorRT] VERBOSE: Tactic: -37215280111360163 Time: 0.276927 [TensorRT] VERBOSE: Fastest Tactic: -6576203419454146580 Time: 0.257761 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6576203419454146580 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(153600,1,7680,384) -> Float(38400,1,1920,96) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TensorRT] VERBOSE: Tactic: 3886731678879822788 Time: 0.282968 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TensorRT] VERBOSE: Tactic: 6629944304117643200 Time: 0.370157 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TensorRT] VERBOSE: Tactic: -9153228964338181824 Time: 0.37198 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TensorRT] VERBOSE: Tactic: -7394439838318485025 Time: 0.280313 [TensorRT] VERBOSE: Fastest Tactic: -7394439838318485025 Time: 0.280313 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(153600,400,20,1) -> Half(38400,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.422187 [TensorRT] VERBOSE: Tactic: 1 Time: 0.374479 [TensorRT] VERBOSE: Tactic: 2 Time: 0.57349 [TensorRT] VERBOSE: Tactic: 4 Time: 48.7377 [TensorRT] VERBOSE: Tactic: 5 Time: 2.19333 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.374479 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(76800,400:2,20,1) -> Half(38400,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(76800,400:2,20,1) -> Half(19200,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 Time: 0.209479 [TensorRT] VERBOSE: Tactic: 655359 Time: 0.281823 [TensorRT] VERBOSE: Tactic: 786431 Time: 0.259375 [TensorRT] VERBOSE: Tactic: 851967 Time: 0.250572 [TensorRT] VERBOSE: Tactic: 1179647 Time: 0.265938 [TensorRT] VERBOSE: Tactic: 1310719 Time: 0.461718 [TensorRT] VERBOSE: Tactic: 1376255 Time: 0.253698 [TensorRT] VERBOSE: Tactic: 1441791 Time: 0.262396 [TensorRT] VERBOSE: Tactic: 1507327 Time: 0.250157 [TensorRT] VERBOSE: Tactic: 1638399 Time: 0.246875 [TensorRT] VERBOSE: Tactic: 1835007 Time: 0.248021 [TensorRT] VERBOSE: Tactic: 1900543 Time: 0.280937 [TensorRT] VERBOSE: Tactic: 2097151 Time: 0.310834 [TensorRT] VERBOSE: Tactic: 2162687 Time: 0.211145 [TensorRT] VERBOSE: Tactic: 2293759 Time: 0.259687 [TensorRT] VERBOSE: Tactic: 2359295 Time: 0.217917 [TensorRT] VERBOSE: Tactic: 2686975 Time: 0.332343 [TensorRT] VERBOSE: Tactic: 3080191 Time: 0.249323 [TensorRT] VERBOSE: Tactic: 3342335 Time: 0.280834 [TensorRT] VERBOSE: Tactic: 3407871 Time: 0.252396 [TensorRT] VERBOSE: Tactic: 3538943 Time: 0.256615 [TensorRT] VERBOSE: Tactic: 3670015 Time: 0.201354 [TensorRT] VERBOSE: Tactic: 3932159 Time: 0.190104 [TensorRT] VERBOSE: Tactic: 3997695 Time: 0.254896 [TensorRT] VERBOSE: Tactic: 4063231 Time: 0.26125 [TensorRT] VERBOSE: Tactic: 4194303 Time: 0.239218 [TensorRT] VERBOSE: Tactic: 4259839 Time: 0.306927 [TensorRT] VERBOSE: Tactic: 4325375 Time: 0.212188 [TensorRT] VERBOSE: Tactic: 4521983 Time: 0.213229 [TensorRT] VERBOSE: Tactic: 4587519 Time: 0.313333 [TensorRT] VERBOSE: Tactic: 4653055 Time: 0.325677 [TensorRT] VERBOSE: Tactic: 4915199 Time: 0.241563 [TensorRT] VERBOSE: Tactic: 4980735 Time: 0.219375 [TensorRT] VERBOSE: Tactic: 5177343 Time: 0.238698 [TensorRT] VERBOSE: Tactic: 5242879 Time: 0.216459 [TensorRT] VERBOSE: Tactic: 5373951 Time: 0.342344 [TensorRT] VERBOSE: Tactic: 5439487 Time: 0.290052 [TensorRT] VERBOSE: Tactic: 5570559 Time: 0.245053 [TensorRT] VERBOSE: Tactic: 5636095 Time: 0.261667 [TensorRT] VERBOSE: Tactic: 5701631 Time: 0.222084 [TensorRT] VERBOSE: Tactic: 5767167 Time: 0.398073 [TensorRT] VERBOSE: Tactic: 5832703 Time: 0.237864 [TensorRT] VERBOSE: Tactic: 5898239 Time: 0.24974 [TensorRT] VERBOSE: Tactic: 6029311 Time: 0.23901 [TensorRT] VERBOSE: Tactic: 6225919 Time: 0.217656 [TensorRT] VERBOSE: Tactic: 6291455 Time: 0.259948 [TensorRT] VERBOSE: Tactic: 6422527 Time: 0.228177 [TensorRT] VERBOSE: Tactic: 6750207 Time: 0.248698 [TensorRT] VERBOSE: Tactic: 6815743 Time: 0.243333 [TensorRT] VERBOSE: Tactic: 6946815 Time: 0.302604 [TensorRT] VERBOSE: Tactic: 7012351 Time: 0.311041 [TensorRT] VERBOSE: Tactic: 7077887 Time: 0.23901 [TensorRT] VERBOSE: Tactic: 7143423 Time: 0.363125 [TensorRT] VERBOSE: Tactic: 7208959 Time: 0.217187 [TensorRT] VERBOSE: Tactic: 7340031 Time: 0.266771 [TensorRT] VERBOSE: Tactic: 7405567 Time: 0.258489 [TensorRT] VERBOSE: Tactic: 7536639 Time: 0.28901 [TensorRT] VERBOSE: Tactic: 7602175 Time: 0.262709 [TensorRT] VERBOSE: Tactic: 7733247 Time: 0.246198 [TensorRT] VERBOSE: Tactic: 7798783 Time: 0.254115 [TensorRT] VERBOSE: Tactic: 8191999 Time: 0.360834 [TensorRT] VERBOSE: Tactic: 8257535 Time: 0.250105 [TensorRT] VERBOSE: Tactic: 8323071 Time: 0.24651 [TensorRT] VERBOSE: Tactic: 8650751 Time: 0.246875 [TensorRT] VERBOSE: Tactic: 8716287 Time: 0.260312 [TensorRT] VERBOSE: Tactic: 9109503 Time: 0.318386 [TensorRT] VERBOSE: Tactic: 9568255 Time: 0.241354 [TensorRT] VERBOSE: Tactic: 9895935 Time: 0.23901 [TensorRT] VERBOSE: Tactic: 10223615 Time: 0.339219 [TensorRT] VERBOSE: Tactic: 10354687 Time: 0.300312 [TensorRT] VERBOSE: Tactic: 10551295 Time: 0.227084 [TensorRT] VERBOSE: Tactic: 10747903 Time: 0.225677 [TensorRT] VERBOSE: Tactic: 10944511 Time: 0.218646 [TensorRT] VERBOSE: Fastest Tactic: 3932159 Time: 0.190104 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TensorRT] VERBOSE: Tactic: 3066127711859985668 Time: 0.135 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TensorRT] VERBOSE: Tactic: 3564772625446233998 Time: 0.140104 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TensorRT] VERBOSE: Tactic: 5319956359050645452 Time: 0.140469 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TensorRT] VERBOSE: Tactic: 7205456024582378848 Time: 0.156823 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TensorRT] VERBOSE: Tactic: 8163473458334948789 Time: 0.149479 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TensorRT] VERBOSE: Tactic: -4212163711445252890 Time: 0.14474 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TensorRT] VERBOSE: Tactic: -3898373634979201110 Time: 0.147917 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TensorRT] VERBOSE: Tactic: -2409163523992614473 Time: 0.151563 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_10_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TensorRT] VERBOSE: Tactic: -1716393687483585322 Time: 0.145677 [TensorRT] VERBOSE: Fastest Tactic: 3066127711859985668 Time: 0.135 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3066127711859985668 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,400,20,1) -> Float(38400,1,1920,96) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.063698 [TensorRT] VERBOSE: Tactic: 0 Time: 0.065156 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.063698 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,400,20,1) -> Half(38400,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.946094 [TensorRT] VERBOSE: Tactic: 0 Time: 0.043594 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.043594 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,400,20,1) -> Half(19200,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.063542 [TensorRT] VERBOSE: Tactic: 0 Time: 0.035625 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.035625 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1,1920,96) -> Float(38400,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.073802 [TensorRT] VERBOSE: Tactic: 0 Time: 0.059896 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.059896 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1,1920,96) -> Half(38400,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.042604 [TensorRT] VERBOSE: Tactic: 0 Time: 0.058802 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.042604 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1,1920,96) -> Half(19200,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.056615 [TensorRT] VERBOSE: Tactic: 0 Time: 0.068281 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.056615 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,400,20,1) -> Float(38400,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.971718 [TensorRT] VERBOSE: Tactic: 0 Time: 0.037344 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.037344 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,400,20,1) -> Float(38400,1,1920,96) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.040469 [TensorRT] VERBOSE: Tactic: 0 Time: 0.062709 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.040469 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,400,20,1) -> Half(19200,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.044739 [TensorRT] VERBOSE: Tactic: 0 Time: 0.035625 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.035625 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(19200,400:2,20,1) -> Float(38400,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.053802 [TensorRT] VERBOSE: Tactic: 0 Time: 0.031354 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.031354 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(19200,400:2,20,1) -> Float(38400,1,1920,96) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.040781 [TensorRT] VERBOSE: Tactic: 0 Time: 0.072813 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.040781 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(19200,400:2,20,1) -> Half(38400,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.072812 [TensorRT] VERBOSE: Tactic: 0 Time: 0.030989 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.030989 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,400,20,1) -> Float(38400,1,1920,96) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.0625 [TensorRT] VERBOSE: Tactic: 0 Time: 0.064843 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.0625 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,400,20,1) -> Half(38400,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.945834 [TensorRT] VERBOSE: Tactic: 0 Time: 0.043489 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.043489 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,400,20,1) -> Half(19200,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.06349 [TensorRT] VERBOSE: Tactic: 0 Time: 0.035521 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.035521 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1,1920,96) -> Float(38400,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.074375 [TensorRT] VERBOSE: Tactic: 0 Time: 0.059427 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.059427 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1,1920,96) -> Half(38400,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.042761 [TensorRT] VERBOSE: Tactic: 0 Time: 0.059219 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.042761 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1,1920,96) -> Half(19200,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.056458 [TensorRT] VERBOSE: Tactic: 0 Time: 0.068229 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.056458 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,400,20,1) -> Float(38400,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.971667 [TensorRT] VERBOSE: Tactic: 0 Time: 0.036979 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.036979 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,400,20,1) -> Float(38400,1,1920,96) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.040781 [TensorRT] VERBOSE: Tactic: 0 Time: 0.063177 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.040781 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,400,20,1) -> Half(19200,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.044792 [TensorRT] VERBOSE: Tactic: 0 Time: 0.035573 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.035573 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(19200,400:2,20,1) -> Float(38400,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.054219 [TensorRT] VERBOSE: Tactic: 0 Time: 0.03125 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.03125 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(19200,400:2,20,1) -> Float(38400,1,1920,96) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.040625 [TensorRT] VERBOSE: Tactic: 0 Time: 0.072604 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.040625 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(19200,400:2,20,1) -> Half(38400,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.072865 [TensorRT] VERBOSE: Tactic: 0 Time: 0.030885 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.030885 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(38400,400,20,1) -> Float(230400,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.875313 [TensorRT] VERBOSE: Tactic: 1 Time: 0.740468 [TensorRT] VERBOSE: Tactic: 2 Time: 0.855364 [TensorRT] VERBOSE: Tactic: 4 Time: 82.2895 [TensorRT] VERBOSE: Tactic: 5 Time: 5.00094 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.740468 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 0.501875 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TensorRT] VERBOSE: Tactic: 1698681053543049347 Time: 0.436771 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 0.44 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 0.386354 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 0.438542 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TensorRT] VERBOSE: Tactic: 5326823351883942011 Time: 0.416718 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TensorRT] VERBOSE: Tactic: 5500448035057547314 Time: 0.40125 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 0.386666 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 0.480886 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 0.439688 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TensorRT] VERBOSE: Tactic: -6576203419454146580 Time: 0.437604 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 0.504062 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 0.458646 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 0.418698 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 0.415521 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 0.421042 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TensorRT] VERBOSE: Tactic: -377491875521947884 Time: 0.432448 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TensorRT] VERBOSE: Tactic: -37215280111360163 Time: 0.373541 [TensorRT] VERBOSE: Fastest Tactic: -37215280111360163 Time: 0.373541 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(38400,1,1920,96) -> Float(230400,1,11520,576) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TensorRT] VERBOSE: Tactic: 3886731678879822788 Time: 0.414479 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TensorRT] VERBOSE: Tactic: 6629944304117643200 Time: 0.905469 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TensorRT] VERBOSE: Tactic: -9153228964338181824 Time: 0.915364 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TensorRT] VERBOSE: Tactic: -7394439838318485025 Time: 0.422709 [TensorRT] VERBOSE: Fastest Tactic: 3886731678879822788 Time: 0.414479 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(38400,400,20,1) -> Half(230400,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.851822 [TensorRT] VERBOSE: Tactic: 1 Time: 0.737291 [TensorRT] VERBOSE: Tactic: 2 Time: 0.778229 [TensorRT] VERBOSE: Tactic: 4 Time: 81.2911 [TensorRT] VERBOSE: Tactic: 5 Time: 4.89333 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.737291 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(19200,400:2,20,1) -> Half(230400,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(19200,400:2,20,1) -> Half(115200,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TensorRT] VERBOSE: Tactic: 3066127711859985668 Time: 0.251771 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TensorRT] VERBOSE: Tactic: 3564772625446233998 Time: 0.277968 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TensorRT] VERBOSE: Tactic: 5319956359050645452 Time: 0.263438 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TensorRT] VERBOSE: Tactic: 7205456024582378848 Time: 0.219375 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TensorRT] VERBOSE: Tactic: 8163473458334948789 Time: 0.210521 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TensorRT] VERBOSE: Tactic: -4212163711445252890 Time: 0.233281 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TensorRT] VERBOSE: Tactic: -3898373634979201110 Time: 0.237917 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TensorRT] VERBOSE: Tactic: -2409163523992614473 Time: 0.214844 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TensorRT] VERBOSE: Tactic: -1716393687483585322 Time: 0.227135 [TensorRT] VERBOSE: Fastest Tactic: 8163473458334948789 Time: 0.210521 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8163473458334948789 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(230400,400,20,1) -> Float(230400,1,11520,576) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.263125 [TensorRT] VERBOSE: Tactic: 0 Time: 0.392135 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.263125 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(230400,400,20,1) -> Half(230400,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 5.62615 [TensorRT] VERBOSE: Tactic: 0 Time: 0.239791 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.239791 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(230400,400,20,1) -> Half(115200,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.335469 [TensorRT] VERBOSE: Tactic: 0 Time: 0.192708 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.192708 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(230400,1,11520,576) -> Float(230400,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.304583 [TensorRT] VERBOSE: Tactic: 0 Time: 0.380052 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.304583 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(230400,1,11520,576) -> Half(230400,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.22974 [TensorRT] VERBOSE: Tactic: 0 Time: 0.371302 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.22974 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(230400,1,11520,576) -> Half(115200,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.300208 [TensorRT] VERBOSE: Tactic: 0 Time: 0.408437 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.300208 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(230400,400,20,1) -> Float(230400,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 5.79078 [TensorRT] VERBOSE: Tactic: 0 Time: 0.202865 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.202865 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(230400,400,20,1) -> Float(230400,1,11520,576) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.215469 [TensorRT] VERBOSE: Tactic: 0 Time: 0.362656 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.215469 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(230400,400,20,1) -> Half(115200,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.242916 [TensorRT] VERBOSE: Tactic: 0 Time: 0.190104 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.190104 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(115200,400:2,20,1) -> Float(230400,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.279167 [TensorRT] VERBOSE: Tactic: 0 Time: 0.166198 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.166198 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(115200,400:2,20,1) -> Float(230400,1,11520,576) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.217917 [TensorRT] VERBOSE: Tactic: 0 Time: 0.404896 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.217917 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(115200,400:2,20,1) -> Half(230400,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.407343 [TensorRT] VERBOSE: Tactic: 0 Time: 0.161875 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.161875 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(230400,400,20,1) -> Float(230400,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: Tactic: -1 Time: 0.395573 [TensorRT] VERBOSE: Fastest Tactic: -1 Time: 0.395573 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.706927 [TensorRT] VERBOSE: Tactic: 1 Time: 0.718802 [TensorRT] VERBOSE: Tactic: 2 Time: 0.834844 [TensorRT] VERBOSE: Tactic: 4 Time: 82.8553 [TensorRT] VERBOSE: Tactic: 5 Time: 177.505 [TensorRT] VERBOSE: Tactic: 6 Time: 28.9942 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.706927 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 16.0854 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [TensorRT] VERBOSE: Tactic: 1754984623894446479 Time: 17.4763 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [TensorRT] VERBOSE: Tactic: 3611739942397549984 Time: 22.2135 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724 [TensorRT] VERBOSE: Tactic: 3827454225649558724 Time: 26.8695 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [TensorRT] VERBOSE: Tactic: 4337000649858996379 Time: 17.8669 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 21.407 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 16.1586 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 21.8672 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896 [TensorRT] VERBOSE: Tactic: 5921334924264294896 Time: 19.3135 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 16.5508 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 16.0243 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038 [TensorRT] VERBOSE: Tactic: 7852627285308570038 Time: 28.6891 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [TensorRT] VERBOSE: Tactic: -9137461792520977713 Time: 21.5561 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509 [TensorRT] VERBOSE: Tactic: -8776506421218919509 Time: 26.0722 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 22.2587 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [TensorRT] VERBOSE: Tactic: -8133971918129952780 Time: 17.8638 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [TensorRT] VERBOSE: Tactic: -6092040395344634144 Time: 17.3355 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 16.3873 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 15.8013 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239 [TensorRT] VERBOSE: Tactic: -2318106587342035239 Time: 27.3647 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657 [TensorRT] VERBOSE: Tactic: -1343271414618805657 Time: 19.0893 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 16.6302 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 15.6607 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 21.249 [TensorRT] VERBOSE: Fastest Tactic: -836875257600482091 Time: 15.6607 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(230400,1,11520,576) -> Float(230400,1,11520,576) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(230400,400,20,1) -> Half(230400,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.381406 [TensorRT] VERBOSE: Tactic: 1 Time: 0.376927 [TensorRT] VERBOSE: Tactic: 2 Time: 28.2296 [TensorRT] VERBOSE: Tactic: 4 Time: 82.9903 [TensorRT] VERBOSE: Tactic: 5 Time: 176.762 [TensorRT] VERBOSE: Tactic: 6 Time: 198.598 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.376927 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(115200,400:2,20,1) -> Half(115200,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(230400,400,20,1) -> Float(230400,1,11520,576) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(230400,400,20,1) -> Half(230400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(230400,400,20,1) -> Half(115200,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(230400,1,11520,576) -> Float(230400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(230400,1,11520,576) -> Half(230400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(230400,1,11520,576) -> Half(115200,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(230400,400,20,1) -> Float(230400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(230400,400,20,1) -> Float(230400,1,11520,576) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(230400,400,20,1) -> Half(115200,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(115200,400:2,20,1) -> Float(230400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(115200,400:2,20,1) -> Float(230400,1,11520,576) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(115200,400:2,20,1) -> Half(230400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,400,20,1) -> Float(38400,1,1920,96) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,400,20,1) -> Half(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,400,20,1) -> Half(19200,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1,1920,96) -> Float(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1,1920,96) -> Half(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1,1920,96) -> Half(19200,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,400,20,1) -> Float(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,400,20,1) -> Float(38400,1,1920,96) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,400,20,1) -> Half(19200,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(19200,400:2,20,1) -> Float(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(19200,400:2,20,1) -> Float(38400,1,1920,96) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(19200,400:2,20,1) -> Half(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(230400,400,20,1), Float(38400,400,20,1) -> Float(38400,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.623959 [TensorRT] VERBOSE: Tactic: 1 Time: 0.526875 [TensorRT] VERBOSE: Tactic: 2 Time: 0.815417 [TensorRT] VERBOSE: Tactic: 4 Time: 76.3039 [TensorRT] VERBOSE: Tactic: 5 Time: 3.4962 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.526875 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 0.390156 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TensorRT] VERBOSE: Tactic: 1698681053543049347 Time: 0.400365 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 0.412396 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 0.411927 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 0.41 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TensorRT] VERBOSE: Tactic: 5326823351883942011 Time: 0.394844 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TensorRT] VERBOSE: Tactic: 5500448035057547314 Time: 0.426302 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 0.420104 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 0.453802 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 0.415052 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TensorRT] VERBOSE: Tactic: -6576203419454146580 Time: 0.343489 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 0.479167 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 0.355625 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 0.4425 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 0.432708 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 0.40375 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TensorRT] VERBOSE: Tactic: -377491875521947884 Time: 0.402083 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TensorRT] VERBOSE: Tactic: -37215280111360163 Time: 0.397864 [TensorRT] VERBOSE: Fastest Tactic: -6576203419454146580 Time: 0.343489 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6576203419454146580 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(230400,1,11520,576), Float(38400,1,1920,96) -> Float(38400,1,1920,96) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TensorRT] VERBOSE: Tactic: 3886731678879822788 Time: 0.422344 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TensorRT] VERBOSE: Tactic: 6629944304117643200 Time: 0.570156 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TensorRT] VERBOSE: Tactic: -9153228964338181824 Time: 0.581875 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TensorRT] VERBOSE: Tactic: -7394439838318485025 Time: 0.422083 [TensorRT] VERBOSE: Fastest Tactic: -7394439838318485025 Time: 0.422083 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(230400,400,20,1), Half(38400,400,20,1) -> Half(38400,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.634844 [TensorRT] VERBOSE: Tactic: 1 Time: 0.570625 [TensorRT] VERBOSE: Tactic: 2 Time: 0.79375 [TensorRT] VERBOSE: Tactic: 4 Time: 75.4674 [TensorRT] VERBOSE: Tactic: 5 Time: 3.2863 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.570625 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(115200,400:2,20,1), Half(19200,400:2,20,1) -> Half(19200,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TensorRT] VERBOSE: Tactic: 3066127711859985668 Time: 0.182083 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TensorRT] VERBOSE: Tactic: 3564772625446233998 Time: 0.224844 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TensorRT] VERBOSE: Tactic: 5319956359050645452 Time: 0.198645 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TensorRT] VERBOSE: Tactic: 7205456024582378848 Time: 0.223073 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TensorRT] VERBOSE: Tactic: 8163473458334948789 Time: 0.209635 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TensorRT] VERBOSE: Tactic: -4212163711445252890 Time: 0.212396 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TensorRT] VERBOSE: Tactic: -3898373634979201110 Time: 0.210937 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TensorRT] VERBOSE: Tactic: -2409163523992614473 Time: 0.215678 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_11_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TensorRT] VERBOSE: Tactic: -1716393687483585322 Time: 0.207187 [TensorRT] VERBOSE: Fastest Tactic: 3066127711859985668 Time: 0.182083 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3066127711859985668 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,400,20,1) -> Float(38400,1,1920,96) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,400,20,1) -> Half(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,400,20,1) -> Half(19200,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1,1920,96) -> Float(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1,1920,96) -> Half(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1,1920,96) -> Half(19200,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,400,20,1) -> Float(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,400,20,1) -> Float(38400,1,1920,96) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,400,20,1) -> Half(19200,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(19200,400:2,20,1) -> Float(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(19200,400:2,20,1) -> Float(38400,1,1920,96) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(19200,400:2,20,1) -> Half(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,400,20,1) -> Float(38400,1,1920,96) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,400,20,1) -> Half(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,400,20,1) -> Half(19200,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1,1920,96) -> Float(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1,1920,96) -> Half(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1,1920,96) -> Half(19200,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,400,20,1) -> Float(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,400,20,1) -> Float(38400,1,1920,96) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,400,20,1) -> Half(19200,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(19200,400:2,20,1) -> Float(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(19200,400:2,20,1) -> Float(38400,1,1920,96) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(19200,400:2,20,1) -> Half(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(38400,400,20,1) -> Float(230400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(38400,1,1920,96) -> Float(230400,1,11520,576) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(38400,400,20,1) -> Half(230400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(19200,400:2,20,1) -> Half(230400,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(19200,400:2,20,1) -> Half(115200,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(230400,400,20,1) -> Float(230400,1,11520,576) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(230400,400,20,1) -> Half(230400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(230400,400,20,1) -> Half(115200,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(230400,1,11520,576) -> Float(230400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(230400,1,11520,576) -> Half(230400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(230400,1,11520,576) -> Half(115200,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(230400,400,20,1) -> Float(230400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(230400,400,20,1) -> Float(230400,1,11520,576) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(230400,400,20,1) -> Half(115200,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(115200,400:2,20,1) -> Float(230400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(115200,400:2,20,1) -> Float(230400,1,11520,576) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(115200,400:2,20,1) -> Half(230400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(230400,400,20,1) -> Float(230400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(230400,1,11520,576) -> Float(230400,1,11520,576) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_depthwise_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(230400,400,20,1) -> Half(230400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(115200,400:2,20,1) -> Half(115200,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_12_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(230400,400,20,1) -> Float(230400,1,11520,576) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(230400,400,20,1) -> Half(230400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(230400,400,20,1) -> Half(115200,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(230400,1,11520,576) -> Float(230400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(230400,1,11520,576) -> Half(230400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(230400,1,11520,576) -> Half(115200,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(230400,400,20,1) -> Float(230400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(230400,400,20,1) -> Float(230400,1,11520,576) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(230400,400,20,1) -> Half(115200,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(115200,400:2,20,1) -> Float(230400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(115200,400:2,20,1) -> Float(230400,1,11520,576) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(115200,400:2,20,1) -> Half(230400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,400,20,1) -> Float(38400,1,1920,96) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,400,20,1) -> Half(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,400,20,1) -> Half(19200,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1,1920,96) -> Float(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1,1920,96) -> Half(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1,1920,96) -> Half(19200,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,400,20,1) -> Float(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,400,20,1) -> Float(38400,1,1920,96) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,400,20,1) -> Half(19200,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(19200,400:2,20,1) -> Float(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(19200,400:2,20,1) -> Float(38400,1,1920,96) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(19200,400:2,20,1) -> Half(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(230400,400,20,1), Float(38400,400,20,1) -> Float(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(230400,1,11520,576), Float(38400,1,1920,96) -> Float(38400,1,1920,96) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(230400,400,20,1), Half(38400,400,20,1) -> Half(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(115200,400:2,20,1), Half(19200,400:2,20,1) -> Half(19200,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,400,20,1) -> Float(38400,1,1920,96) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,400,20,1) -> Half(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,400,20,1) -> Half(19200,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1,1920,96) -> Float(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1,1920,96) -> Half(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1,1920,96) -> Half(19200,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,400,20,1) -> Float(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,400,20,1) -> Float(38400,1,1920,96) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,400,20,1) -> Half(19200,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(19200,400:2,20,1) -> Float(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(19200,400:2,20,1) -> Float(38400,1,1920,96) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(19200,400:2,20,1) -> Half(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,400,20,1) -> Float(38400,1,1920,96) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,400,20,1) -> Half(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,400,20,1) -> Half(19200,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1,1920,96) -> Float(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1,1920,96) -> Half(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1,1920,96) -> Half(19200,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,400,20,1) -> Float(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,400,20,1) -> Float(38400,1,1920,96) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,400,20,1) -> Half(19200,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(19200,400:2,20,1) -> Float(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(19200,400:2,20,1) -> Float(38400,1,1920,96) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(19200,400:2,20,1) -> Half(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(38400,400,20,1) -> Float(230400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(38400,1,1920,96) -> Float(230400,1,11520,576) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(38400,400,20,1) -> Half(230400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(19200,400:2,20,1) -> Half(230400,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(19200,400:2,20,1) -> Half(115200,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(230400,400,20,1) -> Float(230400,1,11520,576) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(230400,400,20,1) -> Half(230400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(230400,400,20,1) -> Half(115200,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(230400,1,11520,576) -> Float(230400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(230400,1,11520,576) -> Half(230400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(230400,1,11520,576) -> Half(115200,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(230400,400,20,1) -> Float(230400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(230400,400,20,1) -> Float(230400,1,11520,576) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(230400,400,20,1) -> Half(115200,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(115200,400:2,20,1) -> Float(230400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(115200,400:2,20,1) -> Float(230400,1,11520,576) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(115200,400:2,20,1) -> Half(230400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(230400,400,20,1) -> Float(57600,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: Tactic: -1 Time: 0.282812 [TensorRT] VERBOSE: Fastest Tactic: -1 Time: 0.282812 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.55375 [TensorRT] VERBOSE: Tactic: 1 Time: 0.55052 [TensorRT] VERBOSE: Tactic: 2 Time: 0.551927 [TensorRT] VERBOSE: Tactic: 5 Time: 176.068 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.55052 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 22.5392 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [TensorRT] VERBOSE: Tactic: 1754984623894446479 Time: 17.2656 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [TensorRT] VERBOSE: Tactic: 3611739942397549984 Time: 18.466 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [TensorRT] VERBOSE: Tactic: 4337000649858996379 Time: 17.628 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 16.2097 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 15.8248 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 15.8895 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 16.6182 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 15.877 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [TensorRT] VERBOSE: Tactic: -9137461792520977713 Time: 18.4029 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 16.1029 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [TensorRT] VERBOSE: Tactic: -8133971918129952780 Time: 17.6627 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [TensorRT] VERBOSE: Tactic: -6092040395344634144 Time: 17.4176 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 16.1956 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 15.7888 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 16.8574 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 15.3015 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 15.69 [TensorRT] VERBOSE: Fastest Tactic: -836875257600482091 Time: 15.3015 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(230400,1,11520,576) -> Float(57600,1,5760,576) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(230400,400,20,1) -> Half(57600,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.506719 [TensorRT] VERBOSE: Tactic: 1 Time: 0.506302 [TensorRT] VERBOSE: Tactic: 2 Time: 28.2267 [TensorRT] VERBOSE: Tactic: 5 Time: 176.052 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.506302 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(115200,400:2,20,1) -> Half(28800,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(57600,100,10,1) -> Float(57600,1,5760,576) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.077136 [TensorRT] VERBOSE: Tactic: 0 Time: 0.092552 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.077136 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(57600,100,10,1) -> Half(57600,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.73844 [TensorRT] VERBOSE: Tactic: 0 Time: 0.065313 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.065313 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(57600,100,10,1) -> Half(28800,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.103281 [TensorRT] VERBOSE: Tactic: 0 Time: 0.052657 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.052657 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(57600,1,5760,576) -> Float(57600,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.104948 [TensorRT] VERBOSE: Tactic: 0 Time: 0.083645 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.083645 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(57600,1,5760,576) -> Half(57600,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.078229 [TensorRT] VERBOSE: Tactic: 0 Time: 0.084791 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.078229 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(57600,1,5760,576) -> Half(28800,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.091563 [TensorRT] VERBOSE: Tactic: 0 Time: 0.099792 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.091563 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(57600,100,10,1) -> Float(57600,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.78943 [TensorRT] VERBOSE: Tactic: 0 Time: 0.054531 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.054531 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(57600,100,10,1) -> Float(57600,1,5760,576) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.072084 [TensorRT] VERBOSE: Tactic: 0 Time: 0.091823 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.072084 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(57600,100,10,1) -> Half(28800,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.066875 [TensorRT] VERBOSE: Tactic: 0 Time: 0.051042 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.051042 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(28800,100:2,10,1) -> Float(57600,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.094636 [TensorRT] VERBOSE: Tactic: 0 Time: 0.045416 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.045416 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(28800,100:2,10,1) -> Float(57600,1,5760,576) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.071719 [TensorRT] VERBOSE: Tactic: 0 Time: 0.106407 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.071719 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(28800,100:2,10,1) -> Half(57600,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.126198 [TensorRT] VERBOSE: Tactic: 0 Time: 0.045156 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.045156 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(57600,100,10,1) -> Float(16000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 Time: 0.496979 [TensorRT] VERBOSE: Tactic: 655359 Time: 0.395312 [TensorRT] VERBOSE: Tactic: 786431 Time: 0.240625 [TensorRT] VERBOSE: Tactic: 851967 Time: 0.404531 [TensorRT] VERBOSE: Tactic: 1179647 Time: 0.445937 [TensorRT] VERBOSE: Tactic: 1310719 Time: 1.00563 [TensorRT] VERBOSE: Tactic: 1376255 Time: 0.46125 [TensorRT] VERBOSE: Tactic: 1441791 Time: 0.327812 [TensorRT] VERBOSE: Tactic: 1507327 Time: 0.379427 [TensorRT] VERBOSE: Tactic: 1638399 Time: 0.323177 [TensorRT] VERBOSE: Tactic: 1835007 Time: 0.323386 [TensorRT] VERBOSE: Tactic: 1900543 Time: 0.470885 [TensorRT] VERBOSE: Tactic: 2097151 Time: 0.434375 [TensorRT] VERBOSE: Tactic: 2162687 Time: 0.265209 [TensorRT] VERBOSE: Tactic: 2293759 Time: 0.467604 [TensorRT] VERBOSE: Tactic: 2359295 Time: 0.285625 [TensorRT] VERBOSE: Tactic: 2686975 Time: 0.245521 [TensorRT] VERBOSE: Tactic: 3080191 Time: 0.468386 [TensorRT] VERBOSE: Tactic: 3342335 Time: 0.381093 [TensorRT] VERBOSE: Tactic: 3407871 Time: 0.400781 [TensorRT] VERBOSE: Tactic: 3538943 Time: 0.382083 [TensorRT] VERBOSE: Tactic: 3670015 Time: 0.235573 [TensorRT] VERBOSE: Tactic: 3932159 Time: 0.412917 [TensorRT] VERBOSE: Tactic: 3997695 Time: 0.247604 [TensorRT] VERBOSE: Tactic: 4063231 Time: 0.548802 [TensorRT] VERBOSE: Tactic: 4194303 Time: 0.372864 [TensorRT] VERBOSE: Tactic: 4259839 Time: 0.459532 [TensorRT] VERBOSE: Tactic: 4325375 Time: 0.2925 [TensorRT] VERBOSE: Tactic: 4521983 Time: 0.282552 [TensorRT] VERBOSE: Tactic: 4587519 Time: 0.477187 [TensorRT] VERBOSE: Tactic: 4653055 Time: 0.529427 [TensorRT] VERBOSE: Tactic: 4915199 Time: 0.372395 [TensorRT] VERBOSE: Tactic: 4980735 Time: 0.348021 [TensorRT] VERBOSE: Tactic: 5177343 Time: 0.421719 [TensorRT] VERBOSE: Tactic: 5242879 Time: 0.313959 [TensorRT] VERBOSE: Tactic: 5373951 Time: 0.476927 [TensorRT] VERBOSE: Tactic: 5439487 Time: 0.331198 [TensorRT] VERBOSE: Tactic: 5570559 Time: 0.377396 [TensorRT] VERBOSE: Tactic: 5636095 Time: 0.549323 [TensorRT] VERBOSE: Tactic: 5701631 Time: 0.448803 [TensorRT] VERBOSE: Tactic: 5767167 Time: 0.56776 [TensorRT] VERBOSE: Tactic: 5832703 Time: 0.391875 [TensorRT] VERBOSE: Tactic: 5898239 Time: 0.352709 [TensorRT] VERBOSE: Tactic: 6029311 Time: 0.434219 [TensorRT] VERBOSE: Tactic: 6225919 Time: 0.328646 [TensorRT] VERBOSE: Tactic: 6291455 Time: 0.463959 [TensorRT] VERBOSE: Tactic: 6422527 Time: 0.434792 [TensorRT] VERBOSE: Tactic: 6750207 Time: 0.336823 [TensorRT] VERBOSE: Tactic: 6815743 Time: 0.308854 [TensorRT] VERBOSE: Tactic: 6946815 Time: 0.496406 [TensorRT] VERBOSE: Tactic: 7012351 Time: 0.43526 [TensorRT] VERBOSE: Tactic: 7077887 Time: 0.378958 [TensorRT] VERBOSE: Tactic: 7143423 Time: 0.640937 [TensorRT] VERBOSE: Tactic: 7208959 Time: 0.32448 [TensorRT] VERBOSE: Tactic: 7340031 Time: 0.369114 [TensorRT] VERBOSE: Tactic: 7405567 Time: 0.416093 [TensorRT] VERBOSE: Tactic: 7536639 Time: 0.371875 [TensorRT] VERBOSE: Tactic: 7602175 Time: 0.481719 [TensorRT] VERBOSE: Tactic: 7733247 Time: 0.375156 [TensorRT] VERBOSE: Tactic: 7798783 Time: 0.239896 [TensorRT] VERBOSE: Tactic: 8191999 Time: 0.5225 [TensorRT] VERBOSE: Tactic: 8257535 Time: 0.377604 [TensorRT] VERBOSE: Tactic: 8323071 Time: 0.330833 [TensorRT] VERBOSE: Tactic: 8650751 Time: 0.414688 [TensorRT] VERBOSE: Tactic: 8716287 Time: 0.334584 [TensorRT] VERBOSE: Tactic: 9109503 Time: 0.447656 [TensorRT] VERBOSE: Tactic: 9568255 Time: 0.373594 [TensorRT] VERBOSE: Tactic: 9895935 Time: 0.374479 [TensorRT] VERBOSE: Tactic: 10223615 Time: 0.248646 [TensorRT] VERBOSE: Tactic: 10354687 Time: 0.469739 [TensorRT] VERBOSE: Tactic: 10551295 Time: 0.336719 [TensorRT] VERBOSE: Tactic: 10747903 Time: 0.368385 [TensorRT] VERBOSE: Tactic: 10944511 Time: 0.349948 [TensorRT] VERBOSE: Fastest Tactic: 3670015 Time: 0.235573 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.346875 [TensorRT] VERBOSE: Tactic: 1 Time: 0.288698 [TensorRT] VERBOSE: Tactic: 2 Time: 0.525313 [TensorRT] VERBOSE: Tactic: 4 Time: 20.7959 [TensorRT] VERBOSE: Tactic: 5 Time: 6.40667 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.288698 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 0.209479 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TensorRT] VERBOSE: Tactic: 1698681053543049347 Time: 0.169844 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 0.207552 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 0.172812 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 0.20625 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TensorRT] VERBOSE: Tactic: 5326823351883942011 Time: 0.199896 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TensorRT] VERBOSE: Tactic: 5500448035057547314 Time: 0.180885 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 0.175677 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 0.172552 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 0.209011 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TensorRT] VERBOSE: Tactic: -6576203419454146580 Time: 0.177291 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 0.184115 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 0.197812 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 0.191875 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 0.184531 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 0.203489 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TensorRT] VERBOSE: Tactic: -377491875521947884 Time: 0.201823 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TensorRT] VERBOSE: Tactic: -37215280111360163 Time: 0.164896 [TensorRT] VERBOSE: Fastest Tactic: -37215280111360163 Time: 0.164896 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(57600,1,5760,576) -> Float(16000,1,1600,160) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TensorRT] VERBOSE: Tactic: 3886731678879822788 Time: 0.155469 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TensorRT] VERBOSE: Tactic: 6629944304117643200 Time: 0.226197 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TensorRT] VERBOSE: Tactic: -9153228964338181824 Time: 0.227656 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TensorRT] VERBOSE: Tactic: -7394439838318485025 Time: 0.173021 [TensorRT] VERBOSE: Fastest Tactic: 3886731678879822788 Time: 0.155469 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(57600,100,10,1) -> Half(16000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.362708 [TensorRT] VERBOSE: Tactic: 1 Time: 0.294219 [TensorRT] VERBOSE: Tactic: 2 Time: 0.498021 [TensorRT] VERBOSE: Tactic: 4 Time: 21.1096 [TensorRT] VERBOSE: Tactic: 5 Time: 6.30688 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.294219 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(28800,100:2,10,1) -> Half(16000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(28800,100:2,10,1) -> Half(8000,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 Time: 0.239219 [TensorRT] VERBOSE: Tactic: 655359 Time: 0.26599 [TensorRT] VERBOSE: Tactic: 786431 Time: 0.170052 [TensorRT] VERBOSE: Tactic: 851967 Time: 0.226563 [TensorRT] VERBOSE: Tactic: 1179647 Time: 0.202396 [TensorRT] VERBOSE: Tactic: 1310719 Time: 0.534375 [TensorRT] VERBOSE: Tactic: 1376255 Time: 0.234219 [TensorRT] VERBOSE: Tactic: 1441791 Time: 0.158333 [TensorRT] VERBOSE: Tactic: 1507327 Time: 0.203854 [TensorRT] VERBOSE: Tactic: 1638399 Time: 0.163281 [TensorRT] VERBOSE: Tactic: 1835007 Time: 0.171458 [TensorRT] VERBOSE: Tactic: 1900543 Time: 0.250052 [TensorRT] VERBOSE: Tactic: 2097151 Time: 0.296771 [TensorRT] VERBOSE: Tactic: 2162687 Time: 0.133229 [TensorRT] VERBOSE: Tactic: 2293759 Time: 0.226354 [TensorRT] VERBOSE: Tactic: 2359295 Time: 0.148854 [TensorRT] VERBOSE: Tactic: 2686975 Time: 0.208021 [TensorRT] VERBOSE: Tactic: 3080191 Time: 0.255937 [TensorRT] VERBOSE: Tactic: 3342335 Time: 0.20599 [TensorRT] VERBOSE: Tactic: 3407871 Time: 0.188489 [TensorRT] VERBOSE: Tactic: 3538943 Time: 0.188646 [TensorRT] VERBOSE: Tactic: 3670015 Time: 0.26276 [TensorRT] VERBOSE: Tactic: 3932159 Time: 0.144739 [TensorRT] VERBOSE: Tactic: 3997695 Time: 0.151094 [TensorRT] VERBOSE: Tactic: 4063231 Time: 0.285209 [TensorRT] VERBOSE: Tactic: 4194303 Time: 0.216093 [TensorRT] VERBOSE: Tactic: 4259839 Time: 0.305 [TensorRT] VERBOSE: Tactic: 4325375 Time: 0.144895 [TensorRT] VERBOSE: Tactic: 4521983 Time: 0.147656 [TensorRT] VERBOSE: Tactic: 4587519 Time: 0.275209 [TensorRT] VERBOSE: Tactic: 4653055 Time: 0.267917 [TensorRT] VERBOSE: Tactic: 4915199 Time: 0.21974 [TensorRT] VERBOSE: Tactic: 4980735 Time: 0.163958 [TensorRT] VERBOSE: Tactic: 5177343 Time: 0.184166 [TensorRT] VERBOSE: Tactic: 5242879 Time: 0.165312 [TensorRT] VERBOSE: Tactic: 5373951 Time: 0.205833 [TensorRT] VERBOSE: Tactic: 5439487 Time: 0.198333 [TensorRT] VERBOSE: Tactic: 5570559 Time: 0.26974 [TensorRT] VERBOSE: Tactic: 5636095 Time: 0.284583 [TensorRT] VERBOSE: Tactic: 5701631 Time: 0.20573 [TensorRT] VERBOSE: Tactic: 5767167 Time: 0.283854 [TensorRT] VERBOSE: Tactic: 5832703 Time: 0.178177 [TensorRT] VERBOSE: Tactic: 5898239 Time: 0.211562 [TensorRT] VERBOSE: Tactic: 6029311 Time: 0.210469 [TensorRT] VERBOSE: Tactic: 6225919 Time: 0.162032 [TensorRT] VERBOSE: Tactic: 6291455 Time: 0.193645 [TensorRT] VERBOSE: Tactic: 6422527 Time: 0.23 [TensorRT] VERBOSE: Tactic: 6750207 Time: 0.204687 [TensorRT] VERBOSE: Tactic: 6815743 Time: 0.171614 [TensorRT] VERBOSE: Tactic: 6946815 Time: 0.225729 [TensorRT] VERBOSE: Tactic: 7012351 Time: 0.299323 [TensorRT] VERBOSE: Tactic: 7077887 Time: 0.178385 [TensorRT] VERBOSE: Tactic: 7143423 Time: 0.318125 [TensorRT] VERBOSE: Tactic: 7208959 Time: 0.17349 [TensorRT] VERBOSE: Tactic: 7340031 Time: 0.226302 [TensorRT] VERBOSE: Tactic: 7405567 Time: 0.220729 [TensorRT] VERBOSE: Tactic: 7536639 Time: 0.217395 [TensorRT] VERBOSE: Tactic: 7602175 Time: 0.221979 [TensorRT] VERBOSE: Tactic: 7733247 Time: 0.217344 [TensorRT] VERBOSE: Tactic: 7798783 Time: 0.166146 [TensorRT] VERBOSE: Tactic: 8191999 Time: 0.277448 [TensorRT] VERBOSE: Tactic: 8257535 Time: 0.219895 [TensorRT] VERBOSE: Tactic: 8323071 Time: 0.196927 [TensorRT] VERBOSE: Tactic: 8650751 Time: 0.19974 [TensorRT] VERBOSE: Tactic: 8716287 Time: 0.167968 [TensorRT] VERBOSE: Tactic: 9109503 Time: 0.305625 [TensorRT] VERBOSE: Tactic: 9568255 Time: 0.218907 [TensorRT] VERBOSE: Tactic: 9895935 Time: 0.215261 [TensorRT] VERBOSE: Tactic: 10223615 Time: 0.223593 [TensorRT] VERBOSE: Tactic: 10354687 Time: 0.2925 [TensorRT] VERBOSE: Tactic: 10551295 Time: 0.177656 [TensorRT] VERBOSE: Tactic: 10747903 Time: 0.191146 [TensorRT] VERBOSE: Tactic: 10944511 Time: 0.164323 [TensorRT] VERBOSE: Fastest Tactic: 2162687 Time: 0.133229 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TensorRT] VERBOSE: Tactic: 3066127711859985668 Time: 0.096927 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TensorRT] VERBOSE: Tactic: 3564772625446233998 Time: 0.108854 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TensorRT] VERBOSE: Tactic: 5319956359050645452 Time: 0.099896 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TensorRT] VERBOSE: Tactic: 7205456024582378848 Time: 0.096563 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TensorRT] VERBOSE: Tactic: 8163473458334948789 Time: 0.087448 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TensorRT] VERBOSE: Tactic: -4212163711445252890 Time: 0.108385 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TensorRT] VERBOSE: Tactic: -3898373634979201110 Time: 0.108854 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TensorRT] VERBOSE: Tactic: -2409163523992614473 Time: 0.089323 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_13_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TensorRT] VERBOSE: Tactic: -1716393687483585322 Time: 0.107136 [TensorRT] VERBOSE: Fastest Tactic: 8163473458334948789 Time: 0.087448 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8163473458334948789 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,100,10,1) -> Float(16000,1,1600,160) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.028645 [TensorRT] VERBOSE: Tactic: 0 Time: 0.028698 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.028645 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,100,10,1) -> Half(16000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.487396 [TensorRT] VERBOSE: Tactic: 0 Time: 0.019739 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.019739 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,100,10,1) -> Half(8000,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.033177 [TensorRT] VERBOSE: Tactic: 0 Time: 0.017084 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.017084 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,1,1600,160) -> Float(16000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.035521 [TensorRT] VERBOSE: Tactic: 0 Time: 0.02625 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.02625 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,1,1600,160) -> Half(16000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.024323 [TensorRT] VERBOSE: Tactic: 0 Time: 0.02625 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.024323 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,1,1600,160) -> Half(8000,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.028645 [TensorRT] VERBOSE: Tactic: 0 Time: 0.030938 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.028645 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(16000,100,10,1) -> Float(16000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.50151 [TensorRT] VERBOSE: Tactic: 0 Time: 0.017031 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.017031 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(16000,100,10,1) -> Float(16000,1,1600,160) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.023958 [TensorRT] VERBOSE: Tactic: 0 Time: 0.028698 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.023958 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(16000,100,10,1) -> Half(8000,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.02401 [TensorRT] VERBOSE: Tactic: 0 Time: 0.017083 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.017083 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(8000,100:2,10,1) -> Float(16000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.030886 [TensorRT] VERBOSE: Tactic: 0 Time: 0.014739 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.014739 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(8000,100:2,10,1) -> Float(16000,1,1600,160) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.023958 [TensorRT] VERBOSE: Tactic: 0 Time: 0.033177 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.023958 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(8000,100:2,10,1) -> Half(16000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.042604 [TensorRT] VERBOSE: Tactic: 0 Time: 0.014792 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.014792 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,100,10,1) -> Float(16000,1,1600,160) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.028645 [TensorRT] VERBOSE: Tactic: 0 Time: 0.028542 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.028542 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,100,10,1) -> Half(16000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.489583 [TensorRT] VERBOSE: Tactic: 0 Time: 0.019531 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.019531 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,100,10,1) -> Half(8000,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.033177 [TensorRT] VERBOSE: Tactic: 0 Time: 0.016979 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.016979 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,1,1600,160) -> Float(16000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.035729 [TensorRT] VERBOSE: Tactic: 0 Time: 0.026406 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.026406 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,1,1600,160) -> Half(16000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.024323 [TensorRT] VERBOSE: Tactic: 0 Time: 0.02625 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.024323 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,1,1600,160) -> Half(8000,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.028646 [TensorRT] VERBOSE: Tactic: 0 Time: 0.030937 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.028646 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(16000,100,10,1) -> Float(16000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.503437 [TensorRT] VERBOSE: Tactic: 0 Time: 0.017031 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.017031 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(16000,100,10,1) -> Float(16000,1,1600,160) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.023958 [TensorRT] VERBOSE: Tactic: 0 Time: 0.028698 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.023958 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(16000,100,10,1) -> Half(8000,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.024271 [TensorRT] VERBOSE: Tactic: 0 Time: 0.016927 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.016927 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(8000,100:2,10,1) -> Float(16000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.031146 [TensorRT] VERBOSE: Tactic: 0 Time: 0.014688 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.014688 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(8000,100:2,10,1) -> Float(16000,1,1600,160) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.023906 [TensorRT] VERBOSE: Tactic: 0 Time: 0.033281 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.023906 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(8000,100:2,10,1) -> Half(16000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.042552 [TensorRT] VERBOSE: Tactic: 0 Time: 0.014792 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.014792 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(16000,100,10,1) -> Float(96000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.718542 [TensorRT] VERBOSE: Tactic: 1 Time: 0.62651 [TensorRT] VERBOSE: Tactic: 2 Time: 0.70099 [TensorRT] VERBOSE: Tactic: 4 Time: 37.9978 [TensorRT] VERBOSE: Tactic: 5 Time: 13.1087 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.62651 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 0.322708 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TensorRT] VERBOSE: Tactic: 1698681053543049347 Time: 0.287447 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 0.264063 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 0.245261 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 0.266615 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TensorRT] VERBOSE: Tactic: 5326823351883942011 Time: 0.254427 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TensorRT] VERBOSE: Tactic: 5500448035057547314 Time: 0.258854 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 0.251354 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 0.305313 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 0.270886 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TensorRT] VERBOSE: Tactic: -6576203419454146580 Time: 0.283906 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 0.321875 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 0.291823 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 0.270573 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 0.271146 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 0.256875 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TensorRT] VERBOSE: Tactic: -377491875521947884 Time: 0.266302 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TensorRT] VERBOSE: Tactic: -37215280111360163 Time: 0.240052 [TensorRT] VERBOSE: Fastest Tactic: -37215280111360163 Time: 0.240052 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(16000,1,1600,160) -> Float(96000,1,9600,960) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TensorRT] VERBOSE: Tactic: 3886731678879822788 Time: 0.251979 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TensorRT] VERBOSE: Tactic: 6629944304117643200 Time: 0.461459 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TensorRT] VERBOSE: Tactic: -9153228964338181824 Time: 0.466042 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TensorRT] VERBOSE: Tactic: -7394439838318485025 Time: 0.253281 [TensorRT] VERBOSE: Fastest Tactic: 3886731678879822788 Time: 0.251979 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(16000,100,10,1) -> Half(96000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.765678 [TensorRT] VERBOSE: Tactic: 1 Time: 0.648333 [TensorRT] VERBOSE: Tactic: 2 Time: 0.693021 [TensorRT] VERBOSE: Tactic: 4 Time: 38.7364 [TensorRT] VERBOSE: Tactic: 5 Time: 13.1918 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.648333 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(8000,100:2,10,1) -> Half(96000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(8000,100:2,10,1) -> Half(48000,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TensorRT] VERBOSE: Tactic: 3066127711859985668 Time: 0.157396 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TensorRT] VERBOSE: Tactic: 3564772625446233998 Time: 0.176511 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TensorRT] VERBOSE: Tactic: 5319956359050645452 Time: 0.164948 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TensorRT] VERBOSE: Tactic: 7205456024582378848 Time: 0.138489 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TensorRT] VERBOSE: Tactic: 8163473458334948789 Time: 0.133229 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TensorRT] VERBOSE: Tactic: -4212163711445252890 Time: 0.140834 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TensorRT] VERBOSE: Tactic: -3898373634979201110 Time: 0.140521 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TensorRT] VERBOSE: Tactic: -2409163523992614473 Time: 0.135156 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_expand_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TensorRT] VERBOSE: Tactic: -1716393687483585322 Time: 0.137396 [TensorRT] VERBOSE: Fastest Tactic: 8163473458334948789 Time: 0.133229 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8163473458334948789 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(96000,100,10,1) -> Float(96000,1,9600,960) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.127761 [TensorRT] VERBOSE: Tactic: 0 Time: 0.149948 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.127761 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(96000,100,10,1) -> Half(96000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.89219 [TensorRT] VERBOSE: Tactic: 0 Time: 0.104687 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.104687 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(96000,100,10,1) -> Half(48000,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.168802 [TensorRT] VERBOSE: Tactic: 0 Time: 0.084479 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.084479 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(96000,1,9600,960) -> Float(96000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.159011 [TensorRT] VERBOSE: Tactic: 0 Time: 0.135261 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.135261 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(96000,1,9600,960) -> Half(96000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.125 [TensorRT] VERBOSE: Tactic: 0 Time: 0.137761 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.125 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(96000,1,9600,960) -> Half(48000,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.148229 [TensorRT] VERBOSE: Tactic: 0 Time: 0.162865 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.148229 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(96000,100,10,1) -> Float(96000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.97339 [TensorRT] VERBOSE: Tactic: 0 Time: 0.088646 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.088646 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(96000,100,10,1) -> Float(96000,1,9600,960) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.115677 [TensorRT] VERBOSE: Tactic: 0 Time: 0.149375 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.115677 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(96000,100,10,1) -> Half(48000,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.111875 [TensorRT] VERBOSE: Tactic: 0 Time: 0.083646 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.083646 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(48000,100:2,10,1) -> Float(96000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.150989 [TensorRT] VERBOSE: Tactic: 0 Time: 0.07224 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.07224 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(48000,100:2,10,1) -> Float(96000,1,9600,960) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.115834 [TensorRT] VERBOSE: Tactic: 0 Time: 0.173125 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.115834 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(48000,100:2,10,1) -> Half(96000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.207708 [TensorRT] VERBOSE: Tactic: 0 Time: 0.071094 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.071094 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(96000,100,10,1) -> Float(96000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: Tactic: -1 Time: 0.396562 [TensorRT] VERBOSE: Fastest Tactic: -1 Time: 0.396562 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.461511 [TensorRT] VERBOSE: Tactic: 1 Time: 0.458594 [TensorRT] VERBOSE: Tactic: 2 Time: 0.460468 [TensorRT] VERBOSE: Tactic: 4 Time: 133.34 [TensorRT] VERBOSE: Tactic: 5 Time: 298.159 [TensorRT] VERBOSE: Tactic: 6 Time: 48.4232 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.458594 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 27.5429 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [TensorRT] VERBOSE: Tactic: 1754984623894446479 Time: 29.3408 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [TensorRT] VERBOSE: Tactic: 3611739942397549984 Time: 30.5519 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724 [TensorRT] VERBOSE: Tactic: 3827454225649558724 Time: 23.5008 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [TensorRT] VERBOSE: Tactic: 4337000649858996379 Time: 29.7626 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 27.5115 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 26.69 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 27.0099 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896 [TensorRT] VERBOSE: Tactic: 5921334924264294896 Time: 23.2741 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 28.0916 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 27.3009 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038 [TensorRT] VERBOSE: Tactic: 7852627285308570038 Time: 23.4745 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [TensorRT] VERBOSE: Tactic: -9137461792520977713 Time: 30.6588 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509 [TensorRT] VERBOSE: Tactic: -8776506421218919509 Time: 23.2965 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 26.7384 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [TensorRT] VERBOSE: Tactic: -8133971918129952780 Time: 29.5504 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [TensorRT] VERBOSE: Tactic: -6092040395344634144 Time: 29.2084 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 27.5287 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 26.3259 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239 [TensorRT] VERBOSE: Tactic: -2318106587342035239 Time: 23.3003 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657 [TensorRT] VERBOSE: Tactic: -1343271414618805657 Time: 23.3216 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 28.0457 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 26.5205 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 26.9027 [TensorRT] VERBOSE: Fastest Tactic: 5921334924264294896 Time: 23.2741 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(96000,1,9600,960) -> Float(96000,1,9600,960) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(96000,100,10,1) -> Half(96000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.324479 [TensorRT] VERBOSE: Tactic: 1 Time: 0.324167 [TensorRT] VERBOSE: Tactic: 2 Time: 0.477292 [TensorRT] VERBOSE: Tactic: 4 Time: 133.349 [TensorRT] VERBOSE: Tactic: 5 Time: 296.33 [TensorRT] VERBOSE: Tactic: 6 Time: 293.044 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.324167 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(48000,100:2,10,1) -> Half(48000,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(96000,100,10,1) -> Float(96000,1,9600,960) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(96000,100,10,1) -> Half(96000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(96000,100,10,1) -> Half(48000,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(96000,1,9600,960) -> Float(96000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(96000,1,9600,960) -> Half(96000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(96000,1,9600,960) -> Half(48000,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(96000,100,10,1) -> Float(96000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(96000,100,10,1) -> Float(96000,1,9600,960) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(96000,100,10,1) -> Half(48000,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(48000,100:2,10,1) -> Float(96000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(48000,100:2,10,1) -> Float(96000,1,9600,960) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(48000,100:2,10,1) -> Half(96000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,100,10,1) -> Float(16000,1,1600,160) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,100,10,1) -> Half(16000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,100,10,1) -> Half(8000,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,1,1600,160) -> Float(16000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,1,1600,160) -> Half(16000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,1,1600,160) -> Half(8000,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(16000,100,10,1) -> Float(16000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(16000,100,10,1) -> Float(16000,1,1600,160) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(16000,100,10,1) -> Half(8000,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(8000,100:2,10,1) -> Float(16000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(8000,100:2,10,1) -> Float(16000,1,1600,160) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(8000,100:2,10,1) -> Half(16000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(96000,100,10,1), Float(16000,100,10,1) -> Float(16000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.587239 [TensorRT] VERBOSE: Tactic: 1 Time: 0.475573 [TensorRT] VERBOSE: Tactic: 2 Time: 0.887292 [TensorRT] VERBOSE: Tactic: 4 Time: 33.2959 [TensorRT] VERBOSE: Tactic: 5 Time: 10.643 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.475573 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 0.313385 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TensorRT] VERBOSE: Tactic: 1698681053543049347 Time: 0.270052 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 0.339427 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 0.25625 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 0.33401 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TensorRT] VERBOSE: Tactic: 5326823351883942011 Time: 0.324011 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TensorRT] VERBOSE: Tactic: 5500448035057547314 Time: 0.290209 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 0.267292 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 0.274219 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 0.342187 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TensorRT] VERBOSE: Tactic: -6576203419454146580 Time: 0.278229 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 0.288281 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 0.288698 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 0.318855 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 0.293907 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 0.326041 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TensorRT] VERBOSE: Tactic: -377491875521947884 Time: 0.330833 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TensorRT] VERBOSE: Tactic: -37215280111360163 Time: 0.251198 [TensorRT] VERBOSE: Fastest Tactic: -37215280111360163 Time: 0.251198 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(96000,1,9600,960), Float(16000,1,1600,160) -> Float(16000,1,1600,160) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TensorRT] VERBOSE: Tactic: 3886731678879822788 Time: 0.277136 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TensorRT] VERBOSE: Tactic: 6629944304117643200 Time: 0.353073 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TensorRT] VERBOSE: Tactic: -9153228964338181824 Time: 0.356667 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TensorRT] VERBOSE: Tactic: -7394439838318485025 Time: 0.279375 [TensorRT] VERBOSE: Fastest Tactic: 3886731678879822788 Time: 0.277136 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(96000,100,10,1), Half(16000,100,10,1) -> Half(16000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.605364 [TensorRT] VERBOSE: Tactic: 1 Time: 0.491563 [TensorRT] VERBOSE: Tactic: 2 Time: 0.893125 [TensorRT] VERBOSE: Tactic: 4 Time: 34.5234 [TensorRT] VERBOSE: Tactic: 5 Time: 10.5522 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.491563 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(48000,100:2,10,1), Half(8000,100:2,10,1) -> Half(8000,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TensorRT] VERBOSE: Tactic: 3066127711859985668 Time: 0.151927 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TensorRT] VERBOSE: Tactic: 3564772625446233998 Time: 0.172136 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TensorRT] VERBOSE: Tactic: 5319956359050645452 Time: 0.157552 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TensorRT] VERBOSE: Tactic: 7205456024582378848 Time: 0.143073 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TensorRT] VERBOSE: Tactic: 8163473458334948789 Time: 0.137083 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TensorRT] VERBOSE: Tactic: -4212163711445252890 Time: 0.168125 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TensorRT] VERBOSE: Tactic: -3898373634979201110 Time: 0.171562 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TensorRT] VERBOSE: Tactic: -2409163523992614473 Time: 0.139844 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_project/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_14_add/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TensorRT] VERBOSE: Tactic: -1716393687483585322 Time: 0.166094 [TensorRT] VERBOSE: Fastest Tactic: 8163473458334948789 Time: 0.137083 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8163473458334948789 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,100,10,1) -> Float(16000,1,1600,160) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,100,10,1) -> Half(16000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,100,10,1) -> Half(8000,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,1,1600,160) -> Float(16000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,1,1600,160) -> Half(16000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,1,1600,160) -> Half(8000,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(16000,100,10,1) -> Float(16000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(16000,100,10,1) -> Float(16000,1,1600,160) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(16000,100,10,1) -> Half(8000,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(8000,100:2,10,1) -> Float(16000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(8000,100:2,10,1) -> Float(16000,1,1600,160) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(8000,100:2,10,1) -> Half(16000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,100,10,1) -> Float(16000,1,1600,160) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,100,10,1) -> Half(16000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,100,10,1) -> Half(8000,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,1,1600,160) -> Float(16000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,1,1600,160) -> Half(16000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,1,1600,160) -> Half(8000,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(16000,100,10,1) -> Float(16000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(16000,100,10,1) -> Float(16000,1,1600,160) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(16000,100,10,1) -> Half(8000,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(8000,100:2,10,1) -> Float(16000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(8000,100:2,10,1) -> Float(16000,1,1600,160) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(8000,100:2,10,1) -> Half(16000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(16000,100,10,1) -> Float(96000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(16000,1,1600,160) -> Float(96000,1,9600,960) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(16000,100,10,1) -> Half(96000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(8000,100:2,10,1) -> Half(96000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(8000,100:2,10,1) -> Half(48000,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(96000,100,10,1) -> Float(96000,1,9600,960) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(96000,100,10,1) -> Half(96000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(96000,100,10,1) -> Half(48000,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(96000,1,9600,960) -> Float(96000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(96000,1,9600,960) -> Half(96000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(96000,1,9600,960) -> Half(48000,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(96000,100,10,1) -> Float(96000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(96000,100,10,1) -> Float(96000,1,9600,960) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(96000,100,10,1) -> Half(48000,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(48000,100:2,10,1) -> Float(96000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(48000,100:2,10,1) -> Float(96000,1,9600,960) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(48000,100:2,10,1) -> Half(96000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(96000,100,10,1) -> Float(96000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(96000,1,9600,960) -> Float(96000,1,9600,960) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_depthwise_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(96000,100,10,1) -> Half(96000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(48000,100:2,10,1) -> Half(48000,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_15_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(96000,100,10,1) -> Float(96000,1,9600,960) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(96000,100,10,1) -> Half(96000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(96000,100,10,1) -> Half(48000,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(96000,1,9600,960) -> Float(96000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(96000,1,9600,960) -> Half(96000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(96000,1,9600,960) -> Half(48000,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(96000,100,10,1) -> Float(96000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(96000,100,10,1) -> Float(96000,1,9600,960) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(96000,100,10,1) -> Half(48000,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(48000,100:2,10,1) -> Float(96000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(48000,100:2,10,1) -> Float(96000,1,9600,960) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(48000,100:2,10,1) -> Half(96000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,100,10,1) -> Float(16000,1,1600,160) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,100,10,1) -> Half(16000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,100,10,1) -> Half(8000,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,1,1600,160) -> Float(16000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,1,1600,160) -> Half(16000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,1,1600,160) -> Half(8000,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(16000,100,10,1) -> Float(16000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(16000,100,10,1) -> Float(16000,1,1600,160) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(16000,100,10,1) -> Half(8000,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(8000,100:2,10,1) -> Float(16000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(8000,100:2,10,1) -> Float(16000,1,1600,160) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(8000,100:2,10,1) -> Half(16000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(96000,100,10,1), Float(16000,100,10,1) -> Float(16000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(96000,1,9600,960), Float(16000,1,1600,160) -> Float(16000,1,1600,160) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(96000,100,10,1), Half(16000,100,10,1) -> Half(16000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(48000,100:2,10,1), Half(8000,100:2,10,1) -> Half(8000,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,100,10,1) -> Float(16000,1,1600,160) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,100,10,1) -> Half(16000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,100,10,1) -> Half(8000,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,1,1600,160) -> Float(16000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,1,1600,160) -> Half(16000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(16000,1,1600,160) -> Half(8000,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(16000,100,10,1) -> Float(16000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(16000,100,10,1) -> Float(16000,1,1600,160) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(16000,100,10,1) -> Half(8000,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(8000,100:2,10,1) -> Float(16000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(8000,100:2,10,1) -> Float(16000,1,1600,160) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(8000,100:2,10,1) -> Half(16000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(16000,100,10,1) -> Float(96000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(16000,1,1600,160) -> Float(96000,1,9600,960) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(16000,100,10,1) -> Half(96000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(8000,100:2,10,1) -> Half(96000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_expand/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_expand_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(8000,100:2,10,1) -> Half(48000,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(96000,100,10,1) -> Float(96000,1,9600,960) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(96000,100,10,1) -> Half(96000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(96000,100,10,1) -> Half(48000,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(96000,1,9600,960) -> Float(96000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(96000,1,9600,960) -> Half(96000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(96000,1,9600,960) -> Half(48000,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(96000,100,10,1) -> Float(96000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(96000,100,10,1) -> Float(96000,1,9600,960) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(96000,100,10,1) -> Half(48000,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(48000,100:2,10,1) -> Float(96000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(48000,100:2,10,1) -> Float(96000,1,9600,960) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(48000,100:2,10,1) -> Half(96000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(96000,100,10,1) -> Float(96000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(96000,1,9600,960) -> Float(96000,1,9600,960) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_depthwise_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(96000,100,10,1) -> Half(96000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(48000,100:2,10,1) -> Half(48000,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_depthwise/depthwise + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_depthwise_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(96000,100,10,1) -> Float(96000,1,9600,960) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(96000,100,10,1) -> Half(96000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(96000,100,10,1) -> Half(48000,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(96000,1,9600,960) -> Float(96000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(96000,1,9600,960) -> Half(96000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(96000,1,9600,960) -> Half(48000,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(96000,100,10,1) -> Float(96000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(96000,100,10,1) -> Float(96000,1,9600,960) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(96000,100,10,1) -> Half(48000,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(48000,100:2,10,1) -> Float(96000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(48000,100:2,10,1) -> Float(96000,1,9600,960) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(48000,100:2,10,1) -> Half(96000,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(96000,100,10,1) -> Float(32000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 Time: 1.34089 [TensorRT] VERBOSE: Tactic: 655359 Time: 1.06849 [TensorRT] VERBOSE: Tactic: 786431 Time: 0.741615 [TensorRT] VERBOSE: Tactic: 851967 Time: 0.990521 [TensorRT] VERBOSE: Tactic: 1179647 Time: 1.20516 [TensorRT] VERBOSE: Tactic: 1310719 Time: 2.87995 [TensorRT] VERBOSE: Tactic: 1376255 Time: 0.951562 [TensorRT] VERBOSE: Tactic: 1441791 Time: 0.864063 [TensorRT] VERBOSE: Tactic: 1507327 Time: 0.868229 [TensorRT] VERBOSE: Tactic: 1638399 Time: 1.00193 [TensorRT] VERBOSE: Tactic: 1835007 Time: 0.910833 [TensorRT] VERBOSE: Tactic: 1900543 Time: 0.811823 [TensorRT] VERBOSE: Tactic: 2097151 Time: 1.34807 [TensorRT] VERBOSE: Tactic: 2162687 Time: 0.522136 [TensorRT] VERBOSE: Tactic: 2293759 Time: 0.994636 [TensorRT] VERBOSE: Tactic: 2359295 Time: 0.715157 [TensorRT] VERBOSE: Tactic: 2686975 Time: 0.775468 [TensorRT] VERBOSE: Tactic: 3080191 Time: 1.14698 [TensorRT] VERBOSE: Tactic: 3342335 Time: 0.87901 [TensorRT] VERBOSE: Tactic: 3407871 Time: 0.998645 [TensorRT] VERBOSE: Tactic: 3538943 Time: 1.15536 [TensorRT] VERBOSE: Tactic: 3670015 Time: 0.493281 [TensorRT] VERBOSE: Tactic: 3932159 Time: 0.749218 [TensorRT] VERBOSE: Tactic: 3997695 Time: 0.740833 [TensorRT] VERBOSE: Tactic: 4063231 Time: 1.33391 [TensorRT] VERBOSE: Tactic: 4194303 Time: 1.16969 [TensorRT] VERBOSE: Tactic: 4259839 Time: 1.43323 [TensorRT] VERBOSE: Tactic: 4325375 Time: 0.861666 [TensorRT] VERBOSE: Tactic: 4521983 Time: 0.94875 [TensorRT] VERBOSE: Tactic: 4587519 Time: 1.50844 [TensorRT] VERBOSE: Tactic: 4653055 Time: 1.41859 [TensorRT] VERBOSE: Tactic: 4915199 Time: 1.16552 [TensorRT] VERBOSE: Tactic: 4980735 Time: 0.911667 [TensorRT] VERBOSE: Tactic: 5177343 Time: 1.20073 [TensorRT] VERBOSE: Tactic: 5242879 Time: 1.04479 [TensorRT] VERBOSE: Tactic: 5373951 Time: 1.27839 [TensorRT] VERBOSE: Tactic: 5439487 Time: 1.07849 [TensorRT] VERBOSE: Tactic: 5570559 Time: 0.951406 [TensorRT] VERBOSE: Tactic: 5636095 Time: 1.33896 [TensorRT] VERBOSE: Tactic: 5701631 Time: 0.916875 [TensorRT] VERBOSE: Tactic: 5767167 Time: 1.74073 [TensorRT] VERBOSE: Tactic: 5832703 Time: 0.9975 [TensorRT] VERBOSE: Tactic: 5898239 Time: 0.950469 [TensorRT] VERBOSE: Tactic: 6029311 Time: 0.942604 [TensorRT] VERBOSE: Tactic: 6225919 Time: 1.05708 [TensorRT] VERBOSE: Tactic: 6291455 Time: 1.20365 [TensorRT] VERBOSE: Tactic: 6422527 Time: 1.00922 [TensorRT] VERBOSE: Tactic: 6750207 Time: 1.13318 [TensorRT] VERBOSE: Tactic: 6815743 Time: 0.992605 [TensorRT] VERBOSE: Tactic: 6946815 Time: 1.51266 [TensorRT] VERBOSE: Tactic: 7012351 Time: 1.345 [TensorRT] VERBOSE: Tactic: 7077887 Time: 1.14995 [TensorRT] VERBOSE: Tactic: 7143423 Time: 1.91797 [TensorRT] VERBOSE: Tactic: 7208959 Time: 0.985625 [TensorRT] VERBOSE: Tactic: 7340031 Time: 0.959531 [TensorRT] VERBOSE: Tactic: 7405567 Time: 1.21812 [TensorRT] VERBOSE: Tactic: 7536639 Time: 1.31693 [TensorRT] VERBOSE: Tactic: 7602175 Time: 1.47312 [TensorRT] VERBOSE: Tactic: 7733247 Time: 1.00229 [TensorRT] VERBOSE: Tactic: 7798783 Time: 0.745678 [TensorRT] VERBOSE: Tactic: 8191999 Time: 1.72781 [TensorRT] VERBOSE: Tactic: 8257535 Time: 1.17328 [TensorRT] VERBOSE: Tactic: 8323071 Time: 1.05281 [TensorRT] VERBOSE: Tactic: 8650751 Time: 1.33729 [TensorRT] VERBOSE: Tactic: 8716287 Time: 1.09609 [TensorRT] VERBOSE: Tactic: 9109503 Time: 1.37625 [TensorRT] VERBOSE: Tactic: 9568255 Time: 1.16615 [TensorRT] VERBOSE: Tactic: 9895935 Time: 1.16771 [TensorRT] VERBOSE: Tactic: 10223615 Time: 0.778021 [TensorRT] VERBOSE: Tactic: 10354687 Time: 1.48229 [TensorRT] VERBOSE: Tactic: 10551295 Time: 1.07766 [TensorRT] VERBOSE: Tactic: 10747903 Time: 0.984218 [TensorRT] VERBOSE: Tactic: 10944511 Time: 0.907656 [TensorRT] VERBOSE: Fastest Tactic: 3670015 Time: 0.493281 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.987552 [TensorRT] VERBOSE: Tactic: 1 Time: 0.810678 [TensorRT] VERBOSE: Tactic: 2 Time: 1.05708 [TensorRT] ERROR: Tactic Device request: 678MB Available: 494MB. Device memory is insufficient to use tactic. [TensorRT] WARNING: Skipping tactic 3 due to oom error on requested size of 678 detected for tactic 4. Try decreasing the workspace size with IBuilderConfig::setMaxWorkspaceSize(). [TensorRT] VERBOSE: Tactic: 5 Time: 20.6918 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.810678 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 0.552708 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TensorRT] VERBOSE: Tactic: 1698681053543049347 Time: 0.507604 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 0.511979 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 0.475313 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 0.516719 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TensorRT] VERBOSE: Tactic: 5326823351883942011 Time: 0.496823 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TensorRT] VERBOSE: Tactic: 5500448035057547314 Time: 0.578125 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 0.49651 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 0.530261 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 0.53125 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TensorRT] VERBOSE: Tactic: -6576203419454146580 Time: 0.489271 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 0.556771 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 0.506823 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 0.613489 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 0.593802 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 0.499636 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TensorRT] VERBOSE: Tactic: -377491875521947884 Time: 0.513021 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TensorRT] VERBOSE: Tactic: -37215280111360163 Time: 0.466667 [TensorRT] VERBOSE: Fastest Tactic: -37215280111360163 Time: 0.466667 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(96000,1,9600,960) -> Float(32000,1,3200,320) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TensorRT] VERBOSE: Tactic: 3886731678879822788 Time: 0.437291 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TensorRT] VERBOSE: Tactic: 6629944304117643200 Time: 0.681354 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TensorRT] VERBOSE: Tactic: -9153228964338181824 Time: 0.684323 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TensorRT] VERBOSE: Tactic: -7394439838318485025 Time: 0.428333 [TensorRT] VERBOSE: Fastest Tactic: -7394439838318485025 Time: 0.428333 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(96000,100,10,1) -> Half(32000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 1.05917 [TensorRT] VERBOSE: Tactic: 1 Time: 0.884532 [TensorRT] VERBOSE: Tactic: 2 Time: 1.03974 [TensorRT] ERROR: Tactic Device request: 678MB Available: 494MB. Device memory is insufficient to use tactic. [TensorRT] WARNING: Skipping tactic 3 due to oom error on requested size of 678 detected for tactic 4. Try decreasing the workspace size with IBuilderConfig::setMaxWorkspaceSize(). [TensorRT] VERBOSE: Tactic: 5 Time: 20.6311 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.884532 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(48000,100:2,10,1) -> Half(32000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(48000,100:2,10,1) -> Half(16000,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 Time: 0.612864 [TensorRT] VERBOSE: Tactic: 655359 Time: 0.640468 [TensorRT] VERBOSE: Tactic: 786431 Time: 0.46151 [TensorRT] VERBOSE: Tactic: 851967 Time: 0.54625 [TensorRT] VERBOSE: Tactic: 1179647 Time: 0.584218 [TensorRT] VERBOSE: Tactic: 1310719 Time: 1.49688 [TensorRT] VERBOSE: Tactic: 1376255 Time: 0.491459 [TensorRT] VERBOSE: Tactic: 1441791 Time: 0.421354 [TensorRT] VERBOSE: Tactic: 1507327 Time: 0.458385 [TensorRT] VERBOSE: Tactic: 1638399 Time: 0.531198 [TensorRT] VERBOSE: Tactic: 1835007 Time: 0.548906 [TensorRT] VERBOSE: Tactic: 1900543 Time: 0.434844 [TensorRT] VERBOSE: Tactic: 2097151 Time: 0.939791 [TensorRT] VERBOSE: Tactic: 2162687 Time: 0.409532 [TensorRT] VERBOSE: Tactic: 2293759 Time: 0.606719 [TensorRT] VERBOSE: Tactic: 2359295 Time: 0.359583 [TensorRT] VERBOSE: Tactic: 2686975 Time: 0.665 [TensorRT] VERBOSE: Tactic: 3080191 Time: 0.649843 [TensorRT] VERBOSE: Tactic: 3342335 Time: 0.458958 [TensorRT] VERBOSE: Tactic: 3407871 Time: 0.552135 [TensorRT] VERBOSE: Tactic: 3538943 Time: 0.562343 [TensorRT] VERBOSE: Tactic: 3670015 Time: 0.420833 [TensorRT] VERBOSE: Tactic: 3932159 Time: 0.383698 [TensorRT] VERBOSE: Tactic: 3997695 Time: 0.476979 [TensorRT] VERBOSE: Tactic: 4063231 Time: 0.731406 [TensorRT] VERBOSE: Tactic: 4194303 Time: 0.66401 [TensorRT] VERBOSE: Tactic: 4259839 Time: 0.952188 [TensorRT] VERBOSE: Tactic: 4325375 Time: 0.437239 [TensorRT] VERBOSE: Tactic: 4521983 Time: 0.451302 [TensorRT] VERBOSE: Tactic: 4587519 Time: 0.863125 [TensorRT] VERBOSE: Tactic: 4653055 Time: 0.72823 [TensorRT] VERBOSE: Tactic: 4915199 Time: 0.668073 [TensorRT] VERBOSE: Tactic: 4980735 Time: 0.433334 [TensorRT] VERBOSE: Tactic: 5177343 Time: 0.558125 [TensorRT] VERBOSE: Tactic: 5242879 Time: 0.491615 [TensorRT] VERBOSE: Tactic: 5373951 Time: 0.620312 [TensorRT] VERBOSE: Tactic: 5439487 Time: 0.651302 [TensorRT] VERBOSE: Tactic: 5570559 Time: 0.676406 [TensorRT] VERBOSE: Tactic: 5636095 Time: 0.736875 [TensorRT] VERBOSE: Tactic: 5701631 Time: 0.452708 [TensorRT] VERBOSE: Tactic: 5767167 Time: 0.858594 [TensorRT] VERBOSE: Tactic: 5832703 Time: 0.537031 [TensorRT] VERBOSE: Tactic: 5898239 Time: 0.572135 [TensorRT] VERBOSE: Tactic: 6029311 Time: 0.547344 [TensorRT] VERBOSE: Tactic: 6225919 Time: 0.513125 [TensorRT] VERBOSE: Tactic: 6291455 Time: 0.581719 [TensorRT] VERBOSE: Tactic: 6422527 Time: 0.551615 [TensorRT] VERBOSE: Tactic: 6750207 Time: 0.660729 [TensorRT] VERBOSE: Tactic: 6815743 Time: 0.48901 [TensorRT] VERBOSE: Tactic: 6946815 Time: 0.739427 [TensorRT] VERBOSE: Tactic: 7012351 Time: 0.944271 [TensorRT] VERBOSE: Tactic: 7077887 Time: 0.54875 [TensorRT] VERBOSE: Tactic: 7143423 Time: 0.965261 [TensorRT] VERBOSE: Tactic: 7208959 Time: 0.485729 [TensorRT] VERBOSE: Tactic: 7340031 Time: 0.609531 [TensorRT] VERBOSE: Tactic: 7405567 Time: 0.63901 [TensorRT] VERBOSE: Tactic: 7536639 Time: 0.688489 [TensorRT] VERBOSE: Tactic: 7602175 Time: 0.713594 [TensorRT] VERBOSE: Tactic: 7733247 Time: 0.576458 [TensorRT] VERBOSE: Tactic: 7798783 Time: 0.45875 [TensorRT] VERBOSE: Tactic: 8191999 Time: 0.882761 [TensorRT] VERBOSE: Tactic: 8257535 Time: 0.675 [TensorRT] VERBOSE: Tactic: 8323071 Time: 0.633959 [TensorRT] VERBOSE: Tactic: 8650751 Time: 0.647865 [TensorRT] VERBOSE: Tactic: 8716287 Time: 0.521563 [TensorRT] VERBOSE: Tactic: 9109503 Time: 0.973386 [TensorRT] VERBOSE: Tactic: 9568255 Time: 0.665156 [TensorRT] VERBOSE: Tactic: 9895935 Time: 0.66198 [TensorRT] VERBOSE: Tactic: 10223615 Time: 0.662344 [TensorRT] VERBOSE: Tactic: 10354687 Time: 0.933386 [TensorRT] VERBOSE: Tactic: 10551295 Time: 0.552396 [TensorRT] VERBOSE: Tactic: 10747903 Time: 0.511822 [TensorRT] VERBOSE: Tactic: 10944511 Time: 0.432344 [TensorRT] VERBOSE: Fastest Tactic: 2359295 Time: 0.359583 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TensorRT] VERBOSE: Tactic: 3066127711859985668 Time: 0.257812 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TensorRT] VERBOSE: Tactic: 3564772625446233998 Time: 0.285573 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TensorRT] VERBOSE: Tactic: 5319956359050645452 Time: 0.271354 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TensorRT] VERBOSE: Tactic: 7205456024582378848 Time: 0.241979 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TensorRT] VERBOSE: Tactic: 8163473458334948789 Time: 0.227969 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TensorRT] VERBOSE: Tactic: -4212163711445252890 Time: 0.259635 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TensorRT] VERBOSE: Tactic: -3898373634979201110 Time: 0.266302 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TensorRT] VERBOSE: Tactic: -2409163523992614473 Time: 0.235469 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/block_16_project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TensorRT] VERBOSE: Tactic: -1716393687483585322 Time: 0.256666 [TensorRT] VERBOSE: Fastest Tactic: 8163473458334948789 Time: 0.227969 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8163473458334948789 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(32000,100,10,1) -> Float(32000,1,3200,320) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.046042 [TensorRT] VERBOSE: Tactic: 0 Time: 0.053438 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.046042 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(32000,100,10,1) -> Half(32000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.969218 [TensorRT] VERBOSE: Tactic: 0 Time: 0.03599 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.03599 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(32000,100,10,1) -> Half(16000,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.058698 [TensorRT] VERBOSE: Tactic: 0 Time: 0.030937 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.030937 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(32000,1,3200,320) -> Float(32000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.060156 [TensorRT] VERBOSE: Tactic: 0 Time: 0.048802 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.048802 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(32000,1,3200,320) -> Half(32000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.044844 [TensorRT] VERBOSE: Tactic: 0 Time: 0.049479 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.044844 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(32000,1,3200,320) -> Half(16000,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.051875 [TensorRT] VERBOSE: Tactic: 0 Time: 0.05875 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.051875 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(32000,100,10,1) -> Float(32000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.996979 [TensorRT] VERBOSE: Tactic: 0 Time: 0.030885 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.030885 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(32000,100,10,1) -> Float(32000,1,3200,320) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.042552 [TensorRT] VERBOSE: Tactic: 0 Time: 0.052969 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.042552 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(32000,100,10,1) -> Half(16000,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.040573 [TensorRT] VERBOSE: Tactic: 0 Time: 0.030989 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.030989 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(16000,100:2,10,1) -> Float(32000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.056458 [TensorRT] VERBOSE: Tactic: 0 Time: 0.026458 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.026458 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(16000,100:2,10,1) -> Float(32000,1,3200,320) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.04276 [TensorRT] VERBOSE: Tactic: 0 Time: 0.061302 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.04276 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(16000,100:2,10,1) -> Half(32000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.072708 [TensorRT] VERBOSE: Tactic: 0 Time: 0.026198 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.026198 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(32000,100,10,1) -> Float(128000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 1.49344 [TensorRT] VERBOSE: Tactic: 1 Time: 1.28297 [TensorRT] VERBOSE: Tactic: 2 Time: 1.3001 [TensorRT] ERROR: Tactic Device request: 902MB Available: 494MB. Device memory is insufficient to use tactic. [TensorRT] WARNING: Skipping tactic 3 due to oom error on requested size of 902 detected for tactic 4. Try decreasing the workspace size with IBuilderConfig::setMaxWorkspaceSize(). [TensorRT] VERBOSE: Tactic: 5 Time: 32.9027 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 1.28297 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 0.765209 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TensorRT] VERBOSE: Tactic: 1698681053543049347 Time: 0.674687 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 0.587396 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 0.578959 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 0.591041 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TensorRT] VERBOSE: Tactic: 5326823351883942011 Time: 0.566198 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TensorRT] VERBOSE: Tactic: 5500448035057547314 Time: 0.636979 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 0.598333 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 0.767188 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 0.597083 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TensorRT] VERBOSE: Tactic: -6576203419454146580 Time: 0.663906 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 0.799791 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 0.704166 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 0.666094 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 0.642031 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 0.583178 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TensorRT] VERBOSE: Tactic: -377491875521947884 Time: 0.585521 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TensorRT] VERBOSE: Tactic: -37215280111360163 Time: 0.567344 [TensorRT] VERBOSE: Fastest Tactic: 5326823351883942011 Time: 0.566198 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5326823351883942011 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(32000,1,3200,320) -> Float(128000,1,12800,1280) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TensorRT] VERBOSE: Tactic: 3886731678879822788 Time: 0.589271 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TensorRT] VERBOSE: Tactic: 6629944304117643200 Time: 0.898386 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TensorRT] VERBOSE: Tactic: -9153228964338181824 Time: 0.904219 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TensorRT] VERBOSE: Tactic: -7394439838318485025 Time: 0.590313 [TensorRT] VERBOSE: Fastest Tactic: 3886731678879822788 Time: 0.589271 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(32000,100,10,1) -> Half(128000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 1.62786 [TensorRT] VERBOSE: Tactic: 1 Time: 1.32385 [TensorRT] VERBOSE: Tactic: 2 Time: 1.28651 [TensorRT] ERROR: Tactic Device request: 902MB Available: 494MB. Device memory is insufficient to use tactic. [TensorRT] WARNING: Skipping tactic 3 due to oom error on requested size of 902 detected for tactic 4. Try decreasing the workspace size with IBuilderConfig::setMaxWorkspaceSize(). [TensorRT] VERBOSE: Tactic: 5 Time: 33.1169 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 1.28651 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 2 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(16000,100:2,10,1) -> Half(128000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(16000,100:2,10,1) -> Half(64000,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TensorRT] VERBOSE: Tactic: 3066127711859985668 Time: 0.345 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TensorRT] VERBOSE: Tactic: 3564772625446233998 Time: 0.39448 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TensorRT] VERBOSE: Tactic: 5319956359050645452 Time: 0.362084 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TensorRT] VERBOSE: Tactic: 7205456024582378848 Time: 0.314532 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TensorRT] VERBOSE: Tactic: 8163473458334948789 Time: 0.297396 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TensorRT] VERBOSE: Tactic: -4212163711445252890 Time: 0.300834 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TensorRT] VERBOSE: Tactic: -3898373634979201110 Time: 0.309896 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TensorRT] VERBOSE: Tactic: -2409163523992614473 Time: 0.305782 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/Conv_1/Conv2D + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/model/out_relu/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TensorRT] VERBOSE: Tactic: -1716393687483585322 Time: 0.298854 [TensorRT] VERBOSE: Fastest Tactic: 8163473458334948789 Time: 0.297396 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8163473458334948789 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(128000,100,10,1) -> Float(128000,1,12800,1280) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.168802 [TensorRT] VERBOSE: Tactic: 0 Time: 0.2 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.168802 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(128000,100,10,1) -> Half(128000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 3.85385 [TensorRT] VERBOSE: Tactic: 0 Time: 0.13724 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.13724 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(128000,100,10,1) -> Half(64000,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.224011 [TensorRT] VERBOSE: Tactic: 0 Time: 0.109688 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.109688 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(128000,1,12800,1280) -> Float(128000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.213958 [TensorRT] VERBOSE: Tactic: 0 Time: 0.17901 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.17901 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(128000,1,12800,1280) -> Half(128000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.164323 [TensorRT] VERBOSE: Tactic: 0 Time: 0.18099 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.164323 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(128000,1,12800,1280) -> Half(64000,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.197656 [TensorRT] VERBOSE: Tactic: 0 Time: 0.214792 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.197656 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(128000,100,10,1) -> Float(128000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 3.965 [TensorRT] VERBOSE: Tactic: 0 Time: 0.115521 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.115521 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(128000,100,10,1) -> Float(128000,1,12800,1280) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.152031 [TensorRT] VERBOSE: Tactic: 0 Time: 0.197917 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.152031 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(128000,100,10,1) -> Half(64000,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.145469 [TensorRT] VERBOSE: Tactic: 0 Time: 0.108229 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.108229 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(64000,100:2,10,1) -> Float(128000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.197708 [TensorRT] VERBOSE: Tactic: 0 Time: 0.094636 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.094636 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(64000,100:2,10,1) -> Float(128000,1,12800,1280) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.152083 [TensorRT] VERBOSE: Tactic: 0 Time: 0.22776 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.152083 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(64000,100:2,10,1) -> Half(128000,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.273385 [TensorRT] VERBOSE: Tactic: 0 Time: 0.092812 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.092812 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(128000,100,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 Time: 0.607552 [TensorRT] VERBOSE: Tactic: 655359 Time: 0.507604 [TensorRT] VERBOSE: Tactic: 786431 Time: 0.412969 [TensorRT] VERBOSE: Tactic: 851967 Time: 0.40401 [TensorRT] VERBOSE: Tactic: 1179647 Time: 0.608125 [TensorRT] VERBOSE: Tactic: 1310719 Time: 1.40682 [TensorRT] VERBOSE: Tactic: 1376255 Time: 0.539635 [TensorRT] VERBOSE: Tactic: 1441791 Time: 0.446406 [TensorRT] VERBOSE: Tactic: 1507327 Time: 0.522396 [TensorRT] VERBOSE: Tactic: 1638399 Time: 0.521823 [TensorRT] VERBOSE: Tactic: 1835007 Time: 0.462031 [TensorRT] VERBOSE: Tactic: 1900543 Time: 0.532239 [TensorRT] VERBOSE: Tactic: 2097151 Time: 0.701094 [TensorRT] VERBOSE: Tactic: 2162687 Time: 0.522552 [TensorRT] VERBOSE: Tactic: 2293759 Time: 0.532239 [TensorRT] VERBOSE: Tactic: 2359295 Time: 0.343073 [TensorRT] VERBOSE: Tactic: 2686975 Time: 0.461875 [TensorRT] VERBOSE: Tactic: 3080191 Time: 0.492187 [TensorRT] VERBOSE: Tactic: 3342335 Time: 0.522708 [TensorRT] VERBOSE: Tactic: 3407871 Time: 0.570782 [TensorRT] VERBOSE: Tactic: 3538943 Time: 0.558958 [TensorRT] VERBOSE: Tactic: 3670015 Time: 0.445781 [TensorRT] VERBOSE: Tactic: 3932159 Time: 0.446563 [TensorRT] VERBOSE: Tactic: 3997695 Time: 0.436927 [TensorRT] VERBOSE: Tactic: 4063231 Time: 0.551771 [TensorRT] VERBOSE: Tactic: 4194303 Time: 0.66849 [TensorRT] VERBOSE: Tactic: 4259839 Time: 0.749062 [TensorRT] VERBOSE: Tactic: 4325375 Time: 0.451198 [TensorRT] VERBOSE: Tactic: 4521983 Time: 0.509687 [TensorRT] VERBOSE: Tactic: 4587519 Time: 0.812917 [TensorRT] VERBOSE: Tactic: 4653055 Time: 0.721667 [TensorRT] VERBOSE: Tactic: 4915199 Time: 0.615886 [TensorRT] VERBOSE: Tactic: 4980735 Time: 0.451615 [TensorRT] VERBOSE: Tactic: 5177343 Time: 0.551771 [TensorRT] VERBOSE: Tactic: 5242879 Time: 0.538177 [TensorRT] VERBOSE: Tactic: 5373951 Time: 0.646459 [TensorRT] VERBOSE: Tactic: 5439487 Time: 0.615157 [TensorRT] VERBOSE: Tactic: 5570559 Time: 0.386667 [TensorRT] VERBOSE: Tactic: 5636095 Time: 0.548958 [TensorRT] VERBOSE: Tactic: 5701631 Time: 0.504219 [TensorRT] VERBOSE: Tactic: 5767167 Time: 0.907969 [TensorRT] VERBOSE: Tactic: 5832703 Time: 0.560938 [TensorRT] VERBOSE: Tactic: 5898239 Time: 0.458125 [TensorRT] VERBOSE: Tactic: 6029311 Time: 0.491771 [TensorRT] VERBOSE: Tactic: 6225919 Time: 0.504479 [TensorRT] VERBOSE: Tactic: 6291455 Time: 0.599739 [TensorRT] VERBOSE: Tactic: 6422527 Time: 0.470989 [TensorRT] VERBOSE: Tactic: 6750207 Time: 0.561771 [TensorRT] VERBOSE: Tactic: 6815743 Time: 0.538698 [TensorRT] VERBOSE: Tactic: 6946815 Time: 0.828958 [TensorRT] VERBOSE: Tactic: 7012351 Time: 0.701771 [TensorRT] VERBOSE: Tactic: 7077887 Time: 0.553958 [TensorRT] VERBOSE: Tactic: 7143423 Time: 1.02151 [TensorRT] VERBOSE: Tactic: 7208959 Time: 0.554271 [TensorRT] VERBOSE: Tactic: 7340031 Time: 0.475677 [TensorRT] VERBOSE: Tactic: 7405567 Time: 0.560729 [TensorRT] VERBOSE: Tactic: 7536639 Time: 0.617135 [TensorRT] VERBOSE: Tactic: 7602175 Time: 0.81651 [TensorRT] VERBOSE: Tactic: 7733247 Time: 0.489115 [TensorRT] VERBOSE: Tactic: 7798783 Time: 0.414219 [TensorRT] VERBOSE: Tactic: 8191999 Time: 0.885052 [TensorRT] VERBOSE: Tactic: 8257535 Time: 0.614688 [TensorRT] VERBOSE: Tactic: 8323071 Time: 0.614479 [TensorRT] VERBOSE: Tactic: 8650751 Time: 0.652084 [TensorRT] VERBOSE: Tactic: 8716287 Time: 0.501042 [TensorRT] VERBOSE: Tactic: 9109503 Time: 0.712812 [TensorRT] VERBOSE: Tactic: 9568255 Time: 0.615468 [TensorRT] VERBOSE: Tactic: 9895935 Time: 0.667604 [TensorRT] VERBOSE: Tactic: 10223615 Time: 0.464218 [TensorRT] VERBOSE: Tactic: 10354687 Time: 0.760573 [TensorRT] VERBOSE: Tactic: 10551295 Time: 0.631093 [TensorRT] VERBOSE: Tactic: 10747903 Time: 0.487396 [TensorRT] VERBOSE: Tactic: 10944511 Time: 0.452761 [TensorRT] VERBOSE: Fastest Tactic: 2359295 Time: 0.343073 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.490729 [TensorRT] VERBOSE: Tactic: 1 Time: 0.50349 [TensorRT] VERBOSE: Tactic: 2 Time: 0.730937 [TensorRT] VERBOSE: Tactic: 4 Time: 35.9437 [TensorRT] VERBOSE: Tactic: 5 Time: 11.3402 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.490729 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 0.332448 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TensorRT] VERBOSE: Tactic: 1698681053543049347 Time: 0.315678 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 0.272552 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 0.261562 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 0.277135 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TensorRT] VERBOSE: Tactic: 5326823351883942011 Time: 0.26599 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TensorRT] VERBOSE: Tactic: 5500448035057547314 Time: 0.333021 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 0.280782 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 0.310782 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 0.284063 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TensorRT] VERBOSE: Tactic: -6576203419454146580 Time: 0.272187 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 0.334166 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 0.286718 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 0.362031 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 0.342135 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 0.260417 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TensorRT] VERBOSE: Tactic: -377491875521947884 Time: 0.271927 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TensorRT] VERBOSE: Tactic: -37215280111360163 Time: 0.254271 [TensorRT] VERBOSE: Fastest Tactic: -37215280111360163 Time: 0.254271 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(128000,1,12800,1280) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TensorRT] VERBOSE: Tactic: 3886731678879822788 Time: 0.2175 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TensorRT] VERBOSE: Tactic: 6629944304117643200 Time: 0.351563 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TensorRT] VERBOSE: Tactic: -9153228964338181824 Time: 0.353542 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TensorRT] VERBOSE: Tactic: -7394439838318485025 Time: 0.218646 [TensorRT] VERBOSE: Fastest Tactic: 3886731678879822788 Time: 0.2175 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(128000,100,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.686615 [TensorRT] VERBOSE: Tactic: 1 Time: 0.543906 [TensorRT] VERBOSE: Tactic: 2 Time: 0.714792 [TensorRT] VERBOSE: Tactic: 4 Time: 36.4253 [TensorRT] VERBOSE: Tactic: 5 Time: 11.0582 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.543906 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(64000,100:2,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(64000,100:2,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 Time: 0.307292 [TensorRT] VERBOSE: Tactic: 655359 Time: 0.289583 [TensorRT] VERBOSE: Tactic: 786431 Time: 0.235 [TensorRT] VERBOSE: Tactic: 851967 Time: 0.220468 [TensorRT] VERBOSE: Tactic: 1179647 Time: 0.308125 [TensorRT] VERBOSE: Tactic: 1310719 Time: 0.69125 [TensorRT] VERBOSE: Tactic: 1376255 Time: 0.280834 [TensorRT] VERBOSE: Tactic: 1441791 Time: 0.218959 [TensorRT] VERBOSE: Tactic: 1507327 Time: 0.274896 [TensorRT] VERBOSE: Tactic: 1638399 Time: 0.274375 [TensorRT] VERBOSE: Tactic: 1835007 Time: 0.309687 [TensorRT] VERBOSE: Tactic: 1900543 Time: 0.279167 [TensorRT] VERBOSE: Tactic: 2097151 Time: 0.478854 [TensorRT] VERBOSE: Tactic: 2162687 Time: 0.271875 [TensorRT] VERBOSE: Tactic: 2293759 Time: 0.286511 [TensorRT] VERBOSE: Tactic: 2359295 Time: 0.178542 [TensorRT] VERBOSE: Tactic: 2686975 Time: 0.427604 [TensorRT] VERBOSE: Tactic: 3080191 Time: 0.270833 [TensorRT] VERBOSE: Tactic: 3342335 Time: 0.2775 [TensorRT] VERBOSE: Tactic: 3407871 Time: 0.267031 [TensorRT] VERBOSE: Tactic: 3538943 Time: 0.286354 [TensorRT] VERBOSE: Tactic: 3670015 Time: 0.485104 [TensorRT] VERBOSE: Tactic: 3932159 Time: 0.158907 [TensorRT] VERBOSE: Tactic: 3997695 Time: 0.245 [TensorRT] VERBOSE: Tactic: 4063231 Time: 0.296666 [TensorRT] VERBOSE: Tactic: 4194303 Time: 0.329844 [TensorRT] VERBOSE: Tactic: 4259839 Time: 0.484844 [TensorRT] VERBOSE: Tactic: 4325375 Time: 0.257031 [TensorRT] VERBOSE: Tactic: 4521983 Time: 0.260365 [TensorRT] VERBOSE: Tactic: 4587519 Time: 0.448437 [TensorRT] VERBOSE: Tactic: 4653055 Time: 0.377552 [TensorRT] VERBOSE: Tactic: 4915199 Time: 0.345781 [TensorRT] VERBOSE: Tactic: 4980735 Time: 0.309271 [TensorRT] VERBOSE: Tactic: 5177343 Time: 0.274948 [TensorRT] VERBOSE: Tactic: 5242879 Time: 0.249323 [TensorRT] VERBOSE: Tactic: 5373951 Time: 0.313698 [TensorRT] VERBOSE: Tactic: 5439487 Time: 0.314271 [TensorRT] VERBOSE: Tactic: 5570559 Time: 0.284792 [TensorRT] VERBOSE: Tactic: 5636095 Time: 0.299479 [TensorRT] VERBOSE: Tactic: 5701631 Time: 0.25698 [TensorRT] VERBOSE: Tactic: 5767167 Time: 0.454636 [TensorRT] VERBOSE: Tactic: 5832703 Time: 0.258125 [TensorRT] VERBOSE: Tactic: 5898239 Time: 0.2975 [TensorRT] VERBOSE: Tactic: 6029311 Time: 0.253646 [TensorRT] VERBOSE: Tactic: 6225919 Time: 0.236615 [TensorRT] VERBOSE: Tactic: 6291455 Time: 0.306875 [TensorRT] VERBOSE: Tactic: 6422527 Time: 0.255782 [TensorRT] VERBOSE: Tactic: 6750207 Time: 0.333594 [TensorRT] VERBOSE: Tactic: 6815743 Time: 0.249583 [TensorRT] VERBOSE: Tactic: 6946815 Time: 0.383437 [TensorRT] VERBOSE: Tactic: 7012351 Time: 0.486198 [TensorRT] VERBOSE: Tactic: 7077887 Time: 0.274688 [TensorRT] VERBOSE: Tactic: 7143423 Time: 0.51875 [TensorRT] VERBOSE: Tactic: 7208959 Time: 0.249375 [TensorRT] VERBOSE: Tactic: 7340031 Time: 0.314375 [TensorRT] VERBOSE: Tactic: 7405567 Time: 0.295 [TensorRT] VERBOSE: Tactic: 7536639 Time: 0.421823 [TensorRT] VERBOSE: Tactic: 7602175 Time: 0.372916 [TensorRT] VERBOSE: Tactic: 7733247 Time: 0.283229 [TensorRT] VERBOSE: Tactic: 7798783 Time: 0.234844 [TensorRT] VERBOSE: Tactic: 8191999 Time: 0.463177 [TensorRT] VERBOSE: Tactic: 8257535 Time: 0.347396 [TensorRT] VERBOSE: Tactic: 8323071 Time: 0.313125 [TensorRT] VERBOSE: Tactic: 8650751 Time: 0.315052 [TensorRT] VERBOSE: Tactic: 8716287 Time: 0.2275 [TensorRT] VERBOSE: Tactic: 9109503 Time: 0.502239 [TensorRT] VERBOSE: Tactic: 9568255 Time: 0.346042 [TensorRT] VERBOSE: Tactic: 9895935 Time: 0.330208 [TensorRT] VERBOSE: Tactic: 10223615 Time: 0.415521 [TensorRT] VERBOSE: Tactic: 10354687 Time: 0.483385 [TensorRT] VERBOSE: Tactic: 10551295 Time: 0.322604 [TensorRT] VERBOSE: Tactic: 10747903 Time: 0.25276 [TensorRT] VERBOSE: Tactic: 10944511 Time: 0.309271 [TensorRT] VERBOSE: Fastest Tactic: 3932159 Time: 0.158907 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TensorRT] VERBOSE: Tactic: 3066127711859985668 Time: 0.141979 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TensorRT] VERBOSE: Tactic: 3564772625446233998 Time: 0.176979 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TensorRT] VERBOSE: Tactic: 5319956359050645452 Time: 0.147396 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TensorRT] VERBOSE: Tactic: 7205456024582378848 Time: 0.14276 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TensorRT] VERBOSE: Tactic: 8163473458334948789 Time: 0.132656 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TensorRT] VERBOSE: Tactic: -4212163711445252890 Time: 0.133073 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TensorRT] VERBOSE: Tactic: -3898373634979201110 Time: 0.138489 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TensorRT] VERBOSE: Tactic: -2409163523992614473 Time: 0.134948 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TensorRT] VERBOSE: Tactic: -1716393687483585322 Time: 0.134271 [TensorRT] VERBOSE: Fastest Tactic: 8163473458334948789 Time: 0.132656 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8163473458334948789 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.02401 [TensorRT] VERBOSE: Tactic: 0 Time: 0.024011 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.02401 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Float(400,100:32,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.023906 [TensorRT] VERBOSE: Tactic: 0 Time: 0.033282 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.023906 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.392343 [TensorRT] VERBOSE: Tactic: 0 Time: 0.017135 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.017135 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.026406 [TensorRT] VERBOSE: Tactic: 0 Time: 0.014792 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.014792 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.031041 [TensorRT] VERBOSE: Tactic: 0 Time: 0.021615 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.021615 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Float(400,100:32,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.02625 [TensorRT] VERBOSE: Tactic: 0 Time: 0.035781 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.02625 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.021667 [TensorRT] VERBOSE: Tactic: 0 Time: 0.021666 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.021666 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.02401 [TensorRT] VERBOSE: Tactic: 0 Time: 0.02625 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.02401 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.403906 [TensorRT] VERBOSE: Tactic: 0 Time: 0.014791 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.014791 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.019479 [TensorRT] VERBOSE: Tactic: 0 Time: 0.023907 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.019479 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Float(400,100:32,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.019323 [TensorRT] VERBOSE: Tactic: 0 Time: 0.033281 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.019323 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.023958 [TensorRT] VERBOSE: Tactic: 0 Time: 0.014583 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.014583 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.02625 [TensorRT] VERBOSE: Tactic: 0 Time: 0.012344 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012344 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.019375 [TensorRT] VERBOSE: Tactic: 0 Time: 0.02625 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.019375 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Float(400,100:32,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.019479 [TensorRT] VERBOSE: Tactic: 0 Time: 0.035521 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.019479 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.033178 [TensorRT] VERBOSE: Tactic: 0 Time: 0.012344 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012344 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.023959 [TensorRT] VERBOSE: Tactic: 0 Time: 0.024062 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.023959 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.392344 [TensorRT] VERBOSE: Tactic: 0 Time: 0.017291 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.017291 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.026562 [TensorRT] VERBOSE: Tactic: 0 Time: 0.01474 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.01474 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.028802 [TensorRT] VERBOSE: Tactic: 0 Time: 0.021614 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.021614 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.021667 [TensorRT] VERBOSE: Tactic: 0 Time: 0.021615 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.021615 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.024062 [TensorRT] VERBOSE: Tactic: 0 Time: 0.026354 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.024062 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(400,100:32,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.03099 [TensorRT] VERBOSE: Tactic: 0 Time: 0.023958 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.023958 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(400,100:32,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.026302 [TensorRT] VERBOSE: Tactic: 0 Time: 0.026302 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.026302 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(400,100:32,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.021615 [TensorRT] VERBOSE: Tactic: 0 Time: 0.02401 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.021615 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(400,100:32,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.02401 [TensorRT] VERBOSE: Tactic: 0 Time: 0.028645 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.02401 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.403958 [TensorRT] VERBOSE: Tactic: 0 Time: 0.014687 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.014687 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.019375 [TensorRT] VERBOSE: Tactic: 0 Time: 0.024011 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.019375 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.023907 [TensorRT] VERBOSE: Tactic: 0 Time: 0.01474 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.01474 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.026302 [TensorRT] VERBOSE: Tactic: 0 Time: 0.012448 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012448 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.019375 [TensorRT] VERBOSE: Tactic: 0 Time: 0.026302 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.019375 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.033229 [TensorRT] VERBOSE: Tactic: 0 Time: 0.0125 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.0125 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(12800,100,10,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise (CudaDepthwiseConvolution) [TensorRT] VERBOSE: Tactic: -1 Time: 0.044739 [TensorRT] VERBOSE: Fastest Tactic: -1 Time: 0.044739 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.034635 [TensorRT] VERBOSE: Tactic: 1 Time: 0.032344 [TensorRT] VERBOSE: Tactic: 2 Time: 0.032291 [TensorRT] VERBOSE: Tactic: 5 Time: 39.1808 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.032291 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 3.42156 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [TensorRT] VERBOSE: Tactic: 1754984623894446479 Time: 3.64932 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [TensorRT] VERBOSE: Tactic: 3611739942397549984 Time: 3.83245 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [TensorRT] VERBOSE: Tactic: 4337000649858996379 Time: 3.72453 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 3.45198 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 3.41167 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 3.29021 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 3.48578 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 3.43307 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [TensorRT] VERBOSE: Tactic: -9137461792520977713 Time: 3.78865 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 3.34427 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [TensorRT] VERBOSE: Tactic: -8133971918129952780 Time: 3.69255 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [TensorRT] VERBOSE: Tactic: -6092040395344634144 Time: 3.61708 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 3.49156 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 3.33693 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 3.5287 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 3.32271 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 3.39214 [TensorRT] VERBOSE: Fastest Tactic: 5288347012147084929 Time: 3.29021 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 2 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(12800,1,1280,128) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(12800,100,10,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.034583 [TensorRT] VERBOSE: Tactic: 1 Time: 0.034635 [TensorRT] VERBOSE: Tactic: 2 Time: 0.030104 [TensorRT] VERBOSE: Tactic: 5 Time: 38.9453 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.030104 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 2 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(6400,100:2,10,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(400,100:32,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(400,100:32,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(400,100:32,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(400,100:32,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(12800,100,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise (CudaDepthwiseConvolution) [TensorRT] VERBOSE: Tactic: -1 Time: 0.054114 [TensorRT] VERBOSE: Fastest Tactic: -1 Time: 0.054114 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.033698 [TensorRT] VERBOSE: Tactic: 1 Time: 0.033958 [TensorRT] VERBOSE: Tactic: 2 Time: 0.033802 [TensorRT] VERBOSE: Tactic: 4 Time: 16.9724 [TensorRT] VERBOSE: Tactic: 5 Time: 39.5373 [TensorRT] VERBOSE: Tactic: 6 Time: 5.72943 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.033698 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 3.36302 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [TensorRT] VERBOSE: Tactic: 1754984623894446479 Time: 3.65844 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [TensorRT] VERBOSE: Tactic: 3611739942397549984 Time: 3.83255 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724 [TensorRT] VERBOSE: Tactic: 3827454225649558724 Time: 2.8849 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [TensorRT] VERBOSE: Tactic: 4337000649858996379 Time: 3.80698 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 3.42245 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 3.34354 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 3.36068 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896 [TensorRT] VERBOSE: Tactic: 5921334924264294896 Time: 2.96937 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 3.55089 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 3.41594 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038 [TensorRT] VERBOSE: Tactic: 7852627285308570038 Time: 2.97182 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [TensorRT] VERBOSE: Tactic: -9137461792520977713 Time: 3.8974 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509 [TensorRT] VERBOSE: Tactic: -8776506421218919509 Time: 2.91578 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 3.4074 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [TensorRT] VERBOSE: Tactic: -8133971918129952780 Time: 3.73198 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [TensorRT] VERBOSE: Tactic: -6092040395344634144 Time: 3.56646 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 3.42172 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 3.33068 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239 [TensorRT] VERBOSE: Tactic: -2318106587342035239 Time: 2.98156 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657 [TensorRT] VERBOSE: Tactic: -1343271414618805657 Time: 2.97573 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 3.54453 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 3.26089 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 3.37073 [TensorRT] VERBOSE: Fastest Tactic: 3827454225649558724 Time: 2.8849 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(12800,1,1280,128) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(12800,100,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.014687 [TensorRT] VERBOSE: Tactic: 1 Time: 0.01474 [TensorRT] VERBOSE: Tactic: 2 Time: 0.035469 [TensorRT] VERBOSE: Tactic: 4 Time: 17.0898 [TensorRT] VERBOSE: Tactic: 5 Time: 39.3683 [TensorRT] VERBOSE: Tactic: 6 Time: 39.0428 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.014687 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(6400,100:2,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Float(400,100:32,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.023906 [TensorRT] VERBOSE: Tactic: 0 Time: 0.033229 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.023906 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Float(400,100:32,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.026354 [TensorRT] VERBOSE: Tactic: 0 Time: 0.035521 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.026354 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(400,100:32,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(400,100:32,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(400,100:32,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(400,100:32,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Float(400,100:32,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.019375 [TensorRT] VERBOSE: Tactic: 0 Time: 0.033438 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.019375 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Float(400,100:32,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.019323 [TensorRT] VERBOSE: Tactic: 0 Time: 0.035521 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.019323 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(12800,100,10,1) -> Float(12800,1280,128,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Transpose__1965 + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.026354 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.026354 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(12800,1,1280,128) -> Float(12800,1280,1,1280,10) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Transpose__1965 + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.026511 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.026511 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(400,100:32,10,1) -> Float(1280,128,128:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Transpose__1965 + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.099115 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.099115 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(12800,100,10,1) -> Half(12800,1280,128,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Transpose__1965 + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.024219 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.024219 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(6400,100:2,10,1) -> Half(6400,640,128:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Transpose__1965 + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.033281 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.033281 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1280,128,128,1) -> Float(12800,1280,1,1280,10) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.091198 [TensorRT] VERBOSE: Tactic: 0 Time: 0.023959 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.023959 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1280,128,128,1) -> Float(1280,128,128:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.086563 [TensorRT] VERBOSE: Tactic: 0 Time: 0.095365 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.086563 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1280,128,128,1) -> Half(12800,1280,128,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.308958 [TensorRT] VERBOSE: Tactic: 0 Time: 0.017448 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.017448 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1280,128,128,1) -> Half(6400,640,128:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.047344 [TensorRT] VERBOSE: Tactic: 0 Time: 0.01474 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.01474 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1280,1,1280,10) -> Float(12800,1280,128,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.08651 [TensorRT] VERBOSE: Tactic: 0 Time: 0.021667 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.021667 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1280,1,1280,10) -> Float(1280,128,128:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.047344 [TensorRT] VERBOSE: Tactic: 0 Time: 0.099896 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.047344 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1280,1,1280,10) -> Half(12800,1280,128,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.044948 [TensorRT] VERBOSE: Tactic: 0 Time: 0.021823 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.021823 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1280,1,1280,10) -> Half(6400,640,128:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.049479 [TensorRT] VERBOSE: Tactic: 0 Time: 0.024531 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.024531 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1280,128,128:32,128,1) -> Float(12800,1280,128,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.086718 [TensorRT] VERBOSE: Tactic: 0 Time: 0.02401 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.02401 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1280,128,128:32,128,1) -> Float(12800,1280,1,1280,10) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.056407 [TensorRT] VERBOSE: Tactic: 0 Time: 0.026458 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.026458 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1280,128,128:32,128,1) -> Half(12800,1280,128,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.047239 [TensorRT] VERBOSE: Tactic: 0 Time: 0.024167 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.024167 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1280,128,128:32,128,1) -> Half(6400,640,128:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.049427 [TensorRT] VERBOSE: Tactic: 0 Time: 0.028593 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.028593 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,1280,128,128,1) -> Float(12800,1280,128,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.318177 [TensorRT] VERBOSE: Tactic: 0 Time: 0.014479 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.014479 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,1280,128,128,1) -> Float(12800,1280,1,1280,10) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.047187 [TensorRT] VERBOSE: Tactic: 0 Time: 0.024011 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.024011 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,1280,128,128,1) -> Float(1280,128,128:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.04026 [TensorRT] VERBOSE: Tactic: 0 Time: 0.09573 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.04026 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,1280,128,128,1) -> Half(6400,640,128:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.02401 [TensorRT] VERBOSE: Tactic: 0 Time: 0.014687 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.014687 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,640,128:2,128,1) -> Float(12800,1280,128,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.044792 [TensorRT] VERBOSE: Tactic: 0 Time: 0.012396 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012396 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,640,128:2,128,1) -> Float(12800,1280,1,1280,10) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.049375 [TensorRT] VERBOSE: Tactic: 0 Time: 0.026302 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.026302 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,640,128:2,128,1) -> Float(1280,128,128:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.04276 [TensorRT] VERBOSE: Tactic: 0 Time: 0.095781 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.04276 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,640,128:2,128,1) -> Half(12800,1280,128,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.114323 [TensorRT] VERBOSE: Tactic: 0 Time: 0.012396 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012396 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.01474 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007917 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007917 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.10276 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007812 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007812 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.0125 [TensorRT] VERBOSE: Tactic: 0 Time: 0.00552 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00552 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.014844 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007813 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007813 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.010104 [TensorRT] VERBOSE: Tactic: 0 Time: 0.00776 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00776 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.012395 [TensorRT] VERBOSE: Tactic: 0 Time: 0.010052 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.010052 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.105312 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.010104 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007916 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007916 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.019323 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005468 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005468 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.0125 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005625 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005625 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.010052 [TensorRT] VERBOSE: Tactic: 0 Time: 0.010052 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.010052 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.014739 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(3200,25,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 Time: 0.033437 [TensorRT] VERBOSE: Tactic: 655359 Time: 0.026198 [TensorRT] VERBOSE: Tactic: 786431 Time: 0.02198 [TensorRT] VERBOSE: Tactic: 851967 Time: 0.021614 [TensorRT] VERBOSE: Tactic: 1179647 Time: 0.026302 [TensorRT] VERBOSE: Tactic: 1310719 Time: 0.068021 [TensorRT] VERBOSE: Tactic: 1376255 Time: 0.037969 [TensorRT] VERBOSE: Tactic: 1441791 Time: 0.030937 [TensorRT] VERBOSE: Tactic: 1507327 Time: 0.028854 [TensorRT] VERBOSE: Tactic: 1638399 Time: 0.033645 [TensorRT] VERBOSE: Tactic: 1835007 Time: 0.026198 [TensorRT] VERBOSE: Tactic: 1900543 Time: 0.040156 [TensorRT] VERBOSE: Tactic: 2097151 Time: 0.037917 [TensorRT] VERBOSE: Tactic: 2162687 Time: 0.04026 [TensorRT] VERBOSE: Tactic: 2293759 Time: 0.038125 [TensorRT] VERBOSE: Tactic: 2359295 Time: 0.030886 [TensorRT] VERBOSE: Tactic: 2686975 Time: 0.037865 [TensorRT] VERBOSE: Tactic: 3080191 Time: 0.021718 [TensorRT] VERBOSE: Tactic: 3342335 Time: 0.02651 [TensorRT] VERBOSE: Tactic: 3407871 Time: 0.030937 [TensorRT] VERBOSE: Tactic: 3538943 Time: 0.026354 [TensorRT] VERBOSE: Tactic: 3670015 Time: 0.040468 [TensorRT] VERBOSE: Tactic: 3932159 Time: 0.035729 [TensorRT] VERBOSE: Tactic: 3997695 Time: 0.019479 [TensorRT] VERBOSE: Tactic: 4063231 Time: 0.021875 [TensorRT] VERBOSE: Tactic: 4194303 Time: 0.031146 [TensorRT] VERBOSE: Tactic: 4259839 Time: 0.040208 [TensorRT] VERBOSE: Tactic: 4325375 Time: 0.03323 [TensorRT] VERBOSE: Tactic: 4521983 Time: 0.037864 [TensorRT] VERBOSE: Tactic: 4587519 Time: 0.033282 [TensorRT] VERBOSE: Tactic: 4653055 Time: 0.026614 [TensorRT] VERBOSE: Tactic: 4915199 Time: 0.033438 [TensorRT] VERBOSE: Tactic: 4980735 Time: 0.03375 [TensorRT] VERBOSE: Tactic: 5177343 Time: 0.031198 [TensorRT] VERBOSE: Tactic: 5242879 Time: 0.026563 [TensorRT] VERBOSE: Tactic: 5373951 Time: 0.026198 [TensorRT] VERBOSE: Tactic: 5439487 Time: 0.028645 [TensorRT] VERBOSE: Tactic: 5570559 Time: 0.024063 [TensorRT] VERBOSE: Tactic: 5636095 Time: 0.021718 [TensorRT] VERBOSE: Tactic: 5701631 Time: 0.038073 [TensorRT] VERBOSE: Tactic: 5767167 Time: 0.030886 [TensorRT] VERBOSE: Tactic: 5832703 Time: 0.028646 [TensorRT] VERBOSE: Tactic: 5898239 Time: 0.026666 [TensorRT] VERBOSE: Tactic: 6029311 Time: 0.035781 [TensorRT] VERBOSE: Tactic: 6225919 Time: 0.024063 [TensorRT] VERBOSE: Tactic: 6291455 Time: 0.02625 [TensorRT] VERBOSE: Tactic: 6422527 Time: 0.024167 [TensorRT] VERBOSE: Tactic: 6750207 Time: 0.030885 [TensorRT] VERBOSE: Tactic: 6815743 Time: 0.026458 [TensorRT] VERBOSE: Tactic: 6946815 Time: 0.03099 [TensorRT] VERBOSE: Tactic: 7012351 Time: 0.037865 [TensorRT] VERBOSE: Tactic: 7077887 Time: 0.026302 [TensorRT] VERBOSE: Tactic: 7143423 Time: 0.031302 [TensorRT] VERBOSE: Tactic: 7208959 Time: 0.033229 [TensorRT] VERBOSE: Tactic: 7340031 Time: 0.028698 [TensorRT] VERBOSE: Tactic: 7405567 Time: 0.024011 [TensorRT] VERBOSE: Tactic: 7536639 Time: 0.028645 [TensorRT] VERBOSE: Tactic: 7602175 Time: 0.030937 [TensorRT] VERBOSE: Tactic: 7733247 Time: 0.026406 [TensorRT] VERBOSE: Tactic: 7798783 Time: 0.022031 [TensorRT] VERBOSE: Tactic: 8191999 Time: 0.033385 [TensorRT] VERBOSE: Tactic: 8257535 Time: 0.033386 [TensorRT] VERBOSE: Tactic: 8323071 Time: 0.028594 [TensorRT] VERBOSE: Tactic: 8650751 Time: 0.047344 [TensorRT] VERBOSE: Tactic: 8716287 Time: 0.024166 [TensorRT] VERBOSE: Tactic: 9109503 Time: 0.038125 [TensorRT] VERBOSE: Tactic: 9568255 Time: 0.035625 [TensorRT] VERBOSE: Tactic: 9895935 Time: 0.031198 [TensorRT] VERBOSE: Tactic: 10223615 Time: 0.037916 [TensorRT] VERBOSE: Tactic: 10354687 Time: 0.038021 [TensorRT] VERBOSE: Tactic: 10551295 Time: 0.028802 [TensorRT] VERBOSE: Tactic: 10747903 Time: 0.026302 [TensorRT] VERBOSE: Tactic: 10944511 Time: 0.035521 [TensorRT] VERBOSE: Fastest Tactic: 3997695 Time: 0.019479 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.06849 [TensorRT] VERBOSE: Tactic: 1 Time: 0.0675 [TensorRT] VERBOSE: Tactic: 2 Time: 0.128802 [TensorRT] VERBOSE: Tactic: 4 Time: 4.18953 [TensorRT] VERBOSE: Tactic: 5 Time: 1.30021 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.0675 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 0.045312 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TensorRT] VERBOSE: Tactic: 1698681053543049347 Time: 0.038229 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 0.035885 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 0.040209 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 0.035573 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TensorRT] VERBOSE: Tactic: 5326823351883942011 Time: 0.035729 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TensorRT] VERBOSE: Tactic: 5500448035057547314 Time: 0.038334 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 0.04276 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 0.040157 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 0.038125 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TensorRT] VERBOSE: Tactic: -6576203419454146580 Time: 0.040782 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 0.040521 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 0.044843 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 0.040521 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 0.040416 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 0.03526 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TensorRT] VERBOSE: Tactic: -377491875521947884 Time: 0.035833 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TensorRT] VERBOSE: Tactic: -37215280111360163 Time: 0.038229 [TensorRT] VERBOSE: Fastest Tactic: -410470605513481746 Time: 0.03526 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 3997695 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(3200,1,640,128) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TensorRT] VERBOSE: Tactic: 3886731678879822788 Time: 0.033541 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TensorRT] VERBOSE: Tactic: 6629944304117643200 Time: 0.056666 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TensorRT] VERBOSE: Tactic: -9153228964338181824 Time: 0.056354 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TensorRT] VERBOSE: Tactic: -7394439838318485025 Time: 0.033489 [TensorRT] VERBOSE: Fastest Tactic: -7394439838318485025 Time: 0.033489 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(3200,25,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.068542 [TensorRT] VERBOSE: Tactic: 1 Time: 0.066771 [TensorRT] VERBOSE: Tactic: 2 Time: 0.131407 [TensorRT] VERBOSE: Tactic: 4 Time: 4.23172 [TensorRT] VERBOSE: Tactic: 5 Time: 1.27698 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.066771 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(1600,25:2,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(1600,25:2,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 Time: 0.02177 [TensorRT] VERBOSE: Tactic: 655359 Time: 0.026354 [TensorRT] VERBOSE: Tactic: 786431 Time: 0.017135 [TensorRT] VERBOSE: Tactic: 851967 Time: 0.014739 [TensorRT] VERBOSE: Tactic: 1179647 Time: 0.017083 [TensorRT] VERBOSE: Tactic: 1310719 Time: 0.049687 [TensorRT] VERBOSE: Tactic: 1376255 Time: 0.021667 [TensorRT] VERBOSE: Tactic: 1441791 Time: 0.021563 [TensorRT] VERBOSE: Tactic: 1507327 Time: 0.019375 [TensorRT] VERBOSE: Tactic: 1638399 Time: 0.023958 [TensorRT] VERBOSE: Tactic: 1835007 Time: 0.016979 [TensorRT] VERBOSE: Tactic: 1900543 Time: 0.028542 [TensorRT] VERBOSE: Tactic: 2097151 Time: 0.028959 [TensorRT] VERBOSE: Tactic: 2162687 Time: 0.023958 [TensorRT] VERBOSE: Tactic: 2293759 Time: 0.02401 [TensorRT] VERBOSE: Tactic: 2359295 Time: 0.021719 [TensorRT] VERBOSE: Tactic: 2686975 Time: 0.033229 [TensorRT] VERBOSE: Tactic: 3080191 Time: 0.017031 [TensorRT] VERBOSE: Tactic: 3342335 Time: 0.016979 [TensorRT] VERBOSE: Tactic: 3407871 Time: 0.017031 [TensorRT] VERBOSE: Tactic: 3538943 Time: 0.017135 [TensorRT] VERBOSE: Tactic: 3670015 Time: 0.042708 [TensorRT] VERBOSE: Tactic: 3932159 Time: 0.017135 [TensorRT] VERBOSE: Tactic: 3997695 Time: 0.012656 [TensorRT] VERBOSE: Tactic: 4063231 Time: 0.014791 [TensorRT] VERBOSE: Tactic: 4194303 Time: 0.021667 [TensorRT] VERBOSE: Tactic: 4259839 Time: 0.030937 [TensorRT] VERBOSE: Tactic: 4325375 Time: 0.026355 [TensorRT] VERBOSE: Tactic: 4521983 Time: 0.024114 [TensorRT] VERBOSE: Tactic: 4587519 Time: 0.022031 [TensorRT] VERBOSE: Tactic: 4653055 Time: 0.019271 [TensorRT] VERBOSE: Tactic: 4915199 Time: 0.024062 [TensorRT] VERBOSE: Tactic: 4980735 Time: 0.021667 [TensorRT] VERBOSE: Tactic: 5177343 Time: 0.019635 [TensorRT] VERBOSE: Tactic: 5242879 Time: 0.014636 [TensorRT] VERBOSE: Tactic: 5373951 Time: 0.017136 [TensorRT] VERBOSE: Tactic: 5439487 Time: 0.017396 [TensorRT] VERBOSE: Tactic: 5570559 Time: 0.017188 [TensorRT] VERBOSE: Tactic: 5636095 Time: 0.014688 [TensorRT] VERBOSE: Tactic: 5701631 Time: 0.021667 [TensorRT] VERBOSE: Tactic: 5767167 Time: 0.017083 [TensorRT] VERBOSE: Tactic: 5832703 Time: 0.016979 [TensorRT] VERBOSE: Tactic: 5898239 Time: 0.019323 [TensorRT] VERBOSE: Tactic: 6029311 Time: 0.019531 [TensorRT] VERBOSE: Tactic: 6225919 Time: 0.01474 [TensorRT] VERBOSE: Tactic: 6291455 Time: 0.016979 [TensorRT] VERBOSE: Tactic: 6422527 Time: 0.014843 [TensorRT] VERBOSE: Tactic: 6750207 Time: 0.019323 [TensorRT] VERBOSE: Tactic: 6815743 Time: 0.014739 [TensorRT] VERBOSE: Tactic: 6946815 Time: 0.019584 [TensorRT] VERBOSE: Tactic: 7012351 Time: 0.028541 [TensorRT] VERBOSE: Tactic: 7077887 Time: 0.014739 [TensorRT] VERBOSE: Tactic: 7143423 Time: 0.017396 [TensorRT] VERBOSE: Tactic: 7208959 Time: 0.019375 [TensorRT] VERBOSE: Tactic: 7340031 Time: 0.019323 [TensorRT] VERBOSE: Tactic: 7405567 Time: 0.014948 [TensorRT] VERBOSE: Tactic: 7536639 Time: 0.019375 [TensorRT] VERBOSE: Tactic: 7602175 Time: 0.019375 [TensorRT] VERBOSE: Tactic: 7733247 Time: 0.016979 [TensorRT] VERBOSE: Tactic: 7798783 Time: 0.017032 [TensorRT] VERBOSE: Tactic: 8191999 Time: 0.019479 [TensorRT] VERBOSE: Tactic: 8257535 Time: 0.021614 [TensorRT] VERBOSE: Tactic: 8323071 Time: 0.017448 [TensorRT] VERBOSE: Tactic: 8650751 Time: 0.026302 [TensorRT] VERBOSE: Tactic: 8716287 Time: 0.014739 [TensorRT] VERBOSE: Tactic: 9109503 Time: 0.028542 [TensorRT] VERBOSE: Tactic: 9568255 Time: 0.023958 [TensorRT] VERBOSE: Tactic: 9895935 Time: 0.021667 [TensorRT] VERBOSE: Tactic: 10223615 Time: 0.033489 [TensorRT] VERBOSE: Tactic: 10354687 Time: 0.028594 [TensorRT] VERBOSE: Tactic: 10551295 Time: 0.017031 [TensorRT] VERBOSE: Tactic: 10747903 Time: 0.016979 [TensorRT] VERBOSE: Tactic: 10944511 Time: 0.021667 [TensorRT] VERBOSE: Fastest Tactic: 3997695 Time: 0.012656 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TensorRT] VERBOSE: Tactic: 3066127711859985668 Time: 0.026511 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TensorRT] VERBOSE: Tactic: 3564772625446233998 Time: 0.02651 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TensorRT] VERBOSE: Tactic: 5319956359050645452 Time: 0.02651 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TensorRT] VERBOSE: Tactic: 7205456024582378848 Time: 0.02651 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TensorRT] VERBOSE: Tactic: 8163473458334948789 Time: 0.024531 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TensorRT] VERBOSE: Tactic: -4212163711445252890 Time: 0.021614 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TensorRT] VERBOSE: Tactic: -3898373634979201110 Time: 0.02177 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TensorRT] VERBOSE: Tactic: -2409163523992614473 Time: 0.024375 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TensorRT] VERBOSE: Tactic: -1716393687483585322 Time: 0.021927 [TensorRT] VERBOSE: Fastest Tactic: -4212163711445252890 Time: 0.021614 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 3997695 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.014792 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007865 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007865 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.102709 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007813 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007813 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.012396 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.014688 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007813 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007813 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.010052 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007761 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007761 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.012448 [TensorRT] VERBOSE: Tactic: 0 Time: 0.010104 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.010104 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.105 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.008854 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007813 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007813 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.019323 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.0125 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.010052 [TensorRT] VERBOSE: Tactic: 0 Time: 0.010052 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.010052 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.014688 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(12800,100,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 Time: 0.091145 [TensorRT] VERBOSE: Tactic: 655359 Time: 0.070208 [TensorRT] VERBOSE: Tactic: 786431 Time: 0.070312 [TensorRT] VERBOSE: Tactic: 851967 Time: 0.061094 [TensorRT] VERBOSE: Tactic: 1179647 Time: 0.079635 [TensorRT] VERBOSE: Tactic: 1310719 Time: 0.181615 [TensorRT] VERBOSE: Tactic: 1376255 Time: 0.076354 [TensorRT] VERBOSE: Tactic: 1441791 Time: 0.068177 [TensorRT] VERBOSE: Tactic: 1507327 Time: 0.065834 [TensorRT] VERBOSE: Tactic: 1638399 Time: 0.079479 [TensorRT] VERBOSE: Tactic: 1835007 Time: 0.079635 [TensorRT] VERBOSE: Tactic: 1900543 Time: 0.070365 [TensorRT] VERBOSE: Tactic: 2097151 Time: 0.111979 [TensorRT] VERBOSE: Tactic: 2162687 Time: 0.065677 [TensorRT] VERBOSE: Tactic: 2293759 Time: 0.074948 [TensorRT] VERBOSE: Tactic: 2359295 Time: 0.063334 [TensorRT] VERBOSE: Tactic: 2686975 Time: 0.061145 [TensorRT] VERBOSE: Tactic: 3080191 Time: 0.065677 [TensorRT] VERBOSE: Tactic: 3342335 Time: 0.068073 [TensorRT] VERBOSE: Tactic: 3407871 Time: 0.0775 [TensorRT] VERBOSE: Tactic: 3538943 Time: 0.073281 [TensorRT] VERBOSE: Tactic: 3670015 Time: 0.061198 [TensorRT] VERBOSE: Tactic: 3932159 Time: 0.063334 [TensorRT] VERBOSE: Tactic: 3997695 Time: 0.074948 [TensorRT] VERBOSE: Tactic: 4063231 Time: 0.074948 [TensorRT] VERBOSE: Tactic: 4194303 Time: 0.100573 [TensorRT] VERBOSE: Tactic: 4259839 Time: 0.118958 [TensorRT] VERBOSE: Tactic: 4325375 Time: 0.077552 [TensorRT] VERBOSE: Tactic: 4521983 Time: 0.074896 [TensorRT] VERBOSE: Tactic: 4587519 Time: 0.116771 [TensorRT] VERBOSE: Tactic: 4653055 Time: 0.102865 [TensorRT] VERBOSE: Tactic: 4915199 Time: 0.09573 [TensorRT] VERBOSE: Tactic: 4980735 Time: 0.079635 [TensorRT] VERBOSE: Tactic: 5177343 Time: 0.075 [TensorRT] VERBOSE: Tactic: 5242879 Time: 0.070625 [TensorRT] VERBOSE: Tactic: 5373951 Time: 0.081927 [TensorRT] VERBOSE: Tactic: 5439487 Time: 0.093489 [TensorRT] VERBOSE: Tactic: 5570559 Time: 0.065677 [TensorRT] VERBOSE: Tactic: 5636095 Time: 0.074896 [TensorRT] VERBOSE: Tactic: 5701631 Time: 0.072552 [TensorRT] VERBOSE: Tactic: 5767167 Time: 0.10974 [TensorRT] VERBOSE: Tactic: 5832703 Time: 0.075208 [TensorRT] VERBOSE: Tactic: 5898239 Time: 0.072812 [TensorRT] VERBOSE: Tactic: 6029311 Time: 0.070886 [TensorRT] VERBOSE: Tactic: 6225919 Time: 0.067917 [TensorRT] VERBOSE: Tactic: 6291455 Time: 0.07974 [TensorRT] VERBOSE: Tactic: 6422527 Time: 0.065677 [TensorRT] VERBOSE: Tactic: 6750207 Time: 0.088854 [TensorRT] VERBOSE: Tactic: 6815743 Time: 0.07026 [TensorRT] VERBOSE: Tactic: 6946815 Time: 0.107396 [TensorRT] VERBOSE: Tactic: 7012351 Time: 0.111927 [TensorRT] VERBOSE: Tactic: 7077887 Time: 0.070625 [TensorRT] VERBOSE: Tactic: 7143423 Time: 0.123593 [TensorRT] VERBOSE: Tactic: 7208959 Time: 0.070678 [TensorRT] VERBOSE: Tactic: 7340031 Time: 0.072708 [TensorRT] VERBOSE: Tactic: 7405567 Time: 0.082083 [TensorRT] VERBOSE: Tactic: 7536639 Time: 0.07823 [TensorRT] VERBOSE: Tactic: 7602175 Time: 0.105 [TensorRT] VERBOSE: Tactic: 7733247 Time: 0.074948 [TensorRT] VERBOSE: Tactic: 7798783 Time: 0.072552 [TensorRT] VERBOSE: Tactic: 8191999 Time: 0.121406 [TensorRT] VERBOSE: Tactic: 8257535 Time: 0.098073 [TensorRT] VERBOSE: Tactic: 8323071 Time: 0.091458 [TensorRT] VERBOSE: Tactic: 8650751 Time: 0.093438 [TensorRT] VERBOSE: Tactic: 8716287 Time: 0.068282 [TensorRT] VERBOSE: Tactic: 9109503 Time: 0.109739 [TensorRT] VERBOSE: Tactic: 9568255 Time: 0.09599 [TensorRT] VERBOSE: Tactic: 9895935 Time: 0.100468 [TensorRT] VERBOSE: Tactic: 10223615 Time: 0.06573 [TensorRT] VERBOSE: Tactic: 10354687 Time: 0.109948 [TensorRT] VERBOSE: Tactic: 10551295 Time: 0.082188 [TensorRT] VERBOSE: Tactic: 10747903 Time: 0.075209 [TensorRT] VERBOSE: Tactic: 10944511 Time: 0.079531 [TensorRT] VERBOSE: Fastest Tactic: 851967 Time: 0.061094 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.109739 [TensorRT] VERBOSE: Tactic: 1 Time: 0.110833 [TensorRT] VERBOSE: Tactic: 2 Time: 0.160834 [TensorRT] VERBOSE: Tactic: 4 Time: 4.19463 [TensorRT] VERBOSE: Tactic: 5 Time: 1.32979 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.109739 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 0.045313 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TensorRT] VERBOSE: Tactic: 1698681053543049347 Time: 0.038541 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 0.036041 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 0.040312 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 0.03573 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TensorRT] VERBOSE: Tactic: 5326823351883942011 Time: 0.036094 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TensorRT] VERBOSE: Tactic: 5500448035057547314 Time: 0.040365 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 0.040573 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 0.042552 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 0.038178 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TensorRT] VERBOSE: Tactic: -6576203419454146580 Time: 0.043073 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 0.04276 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 0.044792 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 0.040573 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 0.038125 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 0.035729 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TensorRT] VERBOSE: Tactic: -377491875521947884 Time: 0.035833 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TensorRT] VERBOSE: Tactic: -37215280111360163 Time: 0.039062 [TensorRT] VERBOSE: Fastest Tactic: -410470605513481746 Time: 0.035729 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -410470605513481746 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(12800,1,1280,128) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TensorRT] VERBOSE: Tactic: 3886731678879822788 Time: 0.03349 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TensorRT] VERBOSE: Tactic: 6629944304117643200 Time: 0.056927 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TensorRT] VERBOSE: Tactic: -9153228964338181824 Time: 0.056458 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TensorRT] VERBOSE: Tactic: -7394439838318485025 Time: 0.033438 [TensorRT] VERBOSE: Fastest Tactic: -7394439838318485025 Time: 0.033438 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(12800,100,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.114896 [TensorRT] VERBOSE: Tactic: 1 Time: 0.110677 [TensorRT] VERBOSE: Tactic: 2 Time: 0.156406 [TensorRT] VERBOSE: Tactic: 4 Time: 4.36974 [TensorRT] VERBOSE: Tactic: 5 Time: 1.31333 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.110677 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(6400,100:2,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(6400,100:2,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 Time: 0.049479 [TensorRT] VERBOSE: Tactic: 655359 Time: 0.045 [TensorRT] VERBOSE: Tactic: 786431 Time: 0.0425 [TensorRT] VERBOSE: Tactic: 851967 Time: 0.037917 [TensorRT] VERBOSE: Tactic: 1179647 Time: 0.047136 [TensorRT] VERBOSE: Tactic: 1310719 Time: 0.09375 [TensorRT] VERBOSE: Tactic: 1376255 Time: 0.042552 [TensorRT] VERBOSE: Tactic: 1441791 Time: 0.040156 [TensorRT] VERBOSE: Tactic: 1507327 Time: 0.040105 [TensorRT] VERBOSE: Tactic: 1638399 Time: 0.045468 [TensorRT] VERBOSE: Tactic: 1835007 Time: 0.051771 [TensorRT] VERBOSE: Tactic: 1900543 Time: 0.037865 [TensorRT] VERBOSE: Tactic: 2097151 Time: 0.082031 [TensorRT] VERBOSE: Tactic: 2162687 Time: 0.035729 [TensorRT] VERBOSE: Tactic: 2293759 Time: 0.0425 [TensorRT] VERBOSE: Tactic: 2359295 Time: 0.03552 [TensorRT] VERBOSE: Tactic: 2686975 Time: 0.045781 [TensorRT] VERBOSE: Tactic: 3080191 Time: 0.042448 [TensorRT] VERBOSE: Tactic: 3342335 Time: 0.038073 [TensorRT] VERBOSE: Tactic: 3407871 Time: 0.0425 [TensorRT] VERBOSE: Tactic: 3538943 Time: 0.042656 [TensorRT] VERBOSE: Tactic: 3670015 Time: 0.049375 [TensorRT] VERBOSE: Tactic: 3932159 Time: 0.03099 [TensorRT] VERBOSE: Tactic: 3997695 Time: 0.042552 [TensorRT] VERBOSE: Tactic: 4063231 Time: 0.047344 [TensorRT] VERBOSE: Tactic: 4194303 Time: 0.058698 [TensorRT] VERBOSE: Tactic: 4259839 Time: 0.084219 [TensorRT] VERBOSE: Tactic: 4325375 Time: 0.047291 [TensorRT] VERBOSE: Tactic: 4521983 Time: 0.038333 [TensorRT] VERBOSE: Tactic: 4587519 Time: 0.079896 [TensorRT] VERBOSE: Tactic: 4653055 Time: 0.065834 [TensorRT] VERBOSE: Tactic: 4915199 Time: 0.063646 [TensorRT] VERBOSE: Tactic: 4980735 Time: 0.052135 [TensorRT] VERBOSE: Tactic: 5177343 Time: 0.042709 [TensorRT] VERBOSE: Tactic: 5242879 Time: 0.038021 [TensorRT] VERBOSE: Tactic: 5373951 Time: 0.047292 [TensorRT] VERBOSE: Tactic: 5439487 Time: 0.051771 [TensorRT] VERBOSE: Tactic: 5570559 Time: 0.040469 [TensorRT] VERBOSE: Tactic: 5636095 Time: 0.047135 [TensorRT] VERBOSE: Tactic: 5701631 Time: 0.04026 [TensorRT] VERBOSE: Tactic: 5767167 Time: 0.058907 [TensorRT] VERBOSE: Tactic: 5832703 Time: 0.04026 [TensorRT] VERBOSE: Tactic: 5898239 Time: 0.054062 [TensorRT] VERBOSE: Tactic: 6029311 Time: 0.037865 [TensorRT] VERBOSE: Tactic: 6225919 Time: 0.037864 [TensorRT] VERBOSE: Tactic: 6291455 Time: 0.047135 [TensorRT] VERBOSE: Tactic: 6422527 Time: 0.036302 [TensorRT] VERBOSE: Tactic: 6750207 Time: 0.054271 [TensorRT] VERBOSE: Tactic: 6815743 Time: 0.037865 [TensorRT] VERBOSE: Tactic: 6946815 Time: 0.05875 [TensorRT] VERBOSE: Tactic: 7012351 Time: 0.079479 [TensorRT] VERBOSE: Tactic: 7077887 Time: 0.040312 [TensorRT] VERBOSE: Tactic: 7143423 Time: 0.065573 [TensorRT] VERBOSE: Tactic: 7208959 Time: 0.038073 [TensorRT] VERBOSE: Tactic: 7340031 Time: 0.052344 [TensorRT] VERBOSE: Tactic: 7405567 Time: 0.049532 [TensorRT] VERBOSE: Tactic: 7536639 Time: 0.042709 [TensorRT] VERBOSE: Tactic: 7602175 Time: 0.056406 [TensorRT] VERBOSE: Tactic: 7733247 Time: 0.044948 [TensorRT] VERBOSE: Tactic: 7798783 Time: 0.0425 [TensorRT] VERBOSE: Tactic: 8191999 Time: 0.066042 [TensorRT] VERBOSE: Tactic: 8257535 Time: 0.061041 [TensorRT] VERBOSE: Tactic: 8323071 Time: 0.051771 [TensorRT] VERBOSE: Tactic: 8650751 Time: 0.054114 [TensorRT] VERBOSE: Tactic: 8716287 Time: 0.038073 [TensorRT] VERBOSE: Tactic: 9109503 Time: 0.0775 [TensorRT] VERBOSE: Tactic: 9568255 Time: 0.061354 [TensorRT] VERBOSE: Tactic: 9895935 Time: 0.05875 [TensorRT] VERBOSE: Tactic: 10223615 Time: 0.047135 [TensorRT] VERBOSE: Tactic: 10354687 Time: 0.079792 [TensorRT] VERBOSE: Tactic: 10551295 Time: 0.044948 [TensorRT] VERBOSE: Tactic: 10747903 Time: 0.04276 [TensorRT] VERBOSE: Tactic: 10944511 Time: 0.054063 [TensorRT] VERBOSE: Fastest Tactic: 3932159 Time: 0.03099 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TensorRT] VERBOSE: Tactic: 3066127711859985668 Time: 0.026563 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TensorRT] VERBOSE: Tactic: 3564772625446233998 Time: 0.028802 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TensorRT] VERBOSE: Tactic: 5319956359050645452 Time: 0.02651 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TensorRT] VERBOSE: Tactic: 7205456024582378848 Time: 0.02651 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TensorRT] VERBOSE: Tactic: 8163473458334948789 Time: 0.021927 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TensorRT] VERBOSE: Tactic: -4212163711445252890 Time: 0.021615 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TensorRT] VERBOSE: Tactic: -3898373634979201110 Time: 0.021875 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TensorRT] VERBOSE: Tactic: -2409163523992614473 Time: 0.021875 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_2/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TensorRT] VERBOSE: Tactic: -1716393687483585322 Time: 0.021875 [TensorRT] VERBOSE: Fastest Tactic: -4212163711445252890 Time: 0.021615 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4212163711445252890 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1280,128,128,1) -> Float(25600,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.732916 [TensorRT] VERBOSE: Tactic: 0 Time: 0.021718 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.021718 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1280,128,128,1) -> Float(25600,2560,1,1280,10) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.091042 [TensorRT] VERBOSE: Tactic: 0 Time: 0.022135 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.022135 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1280,128,128,1) -> Float(2560,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.091406 [TensorRT] VERBOSE: Tactic: 0 Time: 0.034114 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.034114 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1280,128,128,1) -> Half(25600,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.308906 [TensorRT] VERBOSE: Tactic: 0 Time: 0.021667 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.021667 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1280,128,128,1) -> Half(12800,1280,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.047187 [TensorRT] VERBOSE: Tactic: 0 Time: 0.024218 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.024218 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1280,1,1280,10) -> Float(25600,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.084583 [TensorRT] VERBOSE: Tactic: 0 Time: 0.021823 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.021823 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1280,1,1280,10) -> Float(25600,2560,1,1280,10) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.021927 [TensorRT] VERBOSE: Tactic: 0 Time: 0.02401 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.021927 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1280,1,1280,10) -> Float(2560,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.054583 [TensorRT] VERBOSE: Tactic: 0 Time: 0.038594 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.038594 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1280,1,1280,10) -> Half(25600,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.044792 [TensorRT] VERBOSE: Tactic: 0 Time: 0.021615 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.021615 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1280,1,1280,10) -> Half(12800,1280,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.047448 [TensorRT] VERBOSE: Tactic: 0 Time: 0.026354 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.026354 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1280,128,128:32,128,1) -> Float(25600,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.086719 [TensorRT] VERBOSE: Tactic: 0 Time: 0.023958 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.023958 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1280,128,128:32,128,1) -> Float(25600,2560,1,1280,10) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.056666 [TensorRT] VERBOSE: Tactic: 0 Time: 0.026458 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.026458 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1280,128,128:32,128,1) -> Float(2560,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.059062 [TensorRT] VERBOSE: Tactic: 0 Time: 0.040677 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.040677 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1280,128,128:32,128,1) -> Half(25600,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.047292 [TensorRT] VERBOSE: Tactic: 0 Time: 0.024114 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.024114 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1280,128,128:32,128,1) -> Half(12800,1280,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.049428 [TensorRT] VERBOSE: Tactic: 0 Time: 0.028594 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.028594 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,1280,128,128,1) -> Float(25600,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.317552 [TensorRT] VERBOSE: Tactic: 0 Time: 0.021615 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.021615 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,1280,128,128,1) -> Float(25600,2560,1,1280,10) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.047188 [TensorRT] VERBOSE: Tactic: 0 Time: 0.023958 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.023958 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,1280,128,128,1) -> Float(2560,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.047864 [TensorRT] VERBOSE: Tactic: 0 Time: 0.033802 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.033802 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,1280,128,128,1) -> Half(25600,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.315833 [TensorRT] VERBOSE: Tactic: 0 Time: 0.019322 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.019322 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,1280,128,128,1) -> Half(12800,1280,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.024062 [TensorRT] VERBOSE: Tactic: 0 Time: 0.021928 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.021928 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,640,128:2,128,1) -> Float(25600,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.044844 [TensorRT] VERBOSE: Tactic: 0 Time: 0.02401 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.02401 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,640,128:2,128,1) -> Float(25600,2560,1,1280,10) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.049635 [TensorRT] VERBOSE: Tactic: 0 Time: 0.026354 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.026354 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,640,128:2,128,1) -> Float(2560,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.048229 [TensorRT] VERBOSE: Tactic: 0 Time: 0.034375 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.034375 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,640,128:2,128,1) -> Half(25600,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.114375 [TensorRT] VERBOSE: Tactic: 0 Time: 0.021979 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.021979 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,640,128:2,128,1) -> Half(12800,1280,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.049479 [TensorRT] VERBOSE: Tactic: 0 Time: 0.026302 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.026302 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1280,128,128,1) -> Float(25600,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.733021 [TensorRT] VERBOSE: Tactic: 0 Time: 0.021615 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.021615 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1280,128,128,1) -> Float(25600,2560,1,1280,10) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.091094 [TensorRT] VERBOSE: Tactic: 0 Time: 0.02401 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.02401 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1280,128,128,1) -> Float(2560,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.086666 [TensorRT] VERBOSE: Tactic: 0 Time: 0.095312 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.086666 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1280,128,128,1) -> Half(25600,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.308906 [TensorRT] VERBOSE: Tactic: 0 Time: 0.021667 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.021667 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1280,128,128,1) -> Half(12800,1280,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.047396 [TensorRT] VERBOSE: Tactic: 0 Time: 0.024323 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.024323 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1280,1,1280,10) -> Float(25600,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.086771 [TensorRT] VERBOSE: Tactic: 0 Time: 0.021667 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.021667 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1280,1,1280,10) -> Float(25600,2560,1,1280,10) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.021666 [TensorRT] VERBOSE: Tactic: 0 Time: 0.02401 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.021666 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1280,1,1280,10) -> Float(2560,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.047447 [TensorRT] VERBOSE: Tactic: 0 Time: 0.101771 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.047447 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1280,1,1280,10) -> Half(25600,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.044896 [TensorRT] VERBOSE: Tactic: 0 Time: 0.021615 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.021615 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1280,1,1280,10) -> Half(12800,1280,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.047448 [TensorRT] VERBOSE: Tactic: 0 Time: 0.02625 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.02625 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1280,128,128:32,128,1) -> Float(25600,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.086771 [TensorRT] VERBOSE: Tactic: 0 Time: 0.024063 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.024063 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1280,128,128:32,128,1) -> Float(25600,2560,1,1280,10) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.056355 [TensorRT] VERBOSE: Tactic: 0 Time: 0.02625 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.02625 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1280,128,128:32,128,1) -> Float(2560,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.053125 [TensorRT] VERBOSE: Tactic: 0 Time: 0.102135 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.053125 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1280,128,128:32,128,1) -> Half(25600,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.047084 [TensorRT] VERBOSE: Tactic: 0 Time: 0.02401 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.02401 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1280,128,128:32,128,1) -> Half(12800,1280,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.049427 [TensorRT] VERBOSE: Tactic: 0 Time: 0.028802 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.028802 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,1280,128,128,1) -> Float(25600,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.318125 [TensorRT] VERBOSE: Tactic: 0 Time: 0.021667 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.021667 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,1280,128,128,1) -> Float(25600,2560,1,1280,10) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.047135 [TensorRT] VERBOSE: Tactic: 0 Time: 0.024011 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.024011 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,1280,128,128,1) -> Float(2560,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.039948 [TensorRT] VERBOSE: Tactic: 0 Time: 0.095417 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.039948 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,1280,128,128,1) -> Half(25600,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.316093 [TensorRT] VERBOSE: Tactic: 0 Time: 0.019427 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.019427 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,1280,128,128,1) -> Half(12800,1280,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.023959 [TensorRT] VERBOSE: Tactic: 0 Time: 0.022031 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.022031 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,640,128:2,128,1) -> Float(25600,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.044844 [TensorRT] VERBOSE: Tactic: 0 Time: 0.02401 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.02401 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,640,128:2,128,1) -> Float(25600,2560,1,1280,10) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.049427 [TensorRT] VERBOSE: Tactic: 0 Time: 0.026302 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.026302 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,640,128:2,128,1) -> Float(2560,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.041615 [TensorRT] VERBOSE: Tactic: 0 Time: 0.095834 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.041615 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,640,128:2,128,1) -> Half(25600,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.114375 [TensorRT] VERBOSE: Tactic: 0 Time: 0.022083 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.022083 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,640,128:2,128,1) -> Half(12800,1280,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/w_stack_Unsqueeze__1463:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.049635 [TensorRT] VERBOSE: Tactic: 0 Time: 0.02625 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.02625 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,2560,256,128,1) -> Float(25600,2560,1,1280,10) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.176875 [TensorRT] VERBOSE: Tactic: 0 Time: 0.042343 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.042343 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,2560,256,128,1) -> Float(2560,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.170313 [TensorRT] VERBOSE: Tactic: 0 Time: 0.187604 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.170313 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,2560,256,128,1) -> Half(25600,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.607813 [TensorRT] VERBOSE: Tactic: 0 Time: 0.029323 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.029323 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,2560,256,128,1) -> Half(12800,1280,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.091146 [TensorRT] VERBOSE: Tactic: 0 Time: 0.024062 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.024062 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,2560,1,1280,10) -> Float(25600,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.167604 [TensorRT] VERBOSE: Tactic: 0 Time: 0.038541 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.038541 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,2560,1,1280,10) -> Float(2560,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.091093 [TensorRT] VERBOSE: Tactic: 0 Time: 0.196042 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.091093 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,2560,1,1280,10) -> Half(25600,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.086406 [TensorRT] VERBOSE: Tactic: 0 Time: 0.040208 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.040208 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,2560,1,1280,10) -> Half(12800,1280,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.091146 [TensorRT] VERBOSE: Tactic: 0 Time: 0.04724 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.04724 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2560,256,256:32,128,1) -> Float(25600,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.170625 [TensorRT] VERBOSE: Tactic: 0 Time: 0.048177 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.048177 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2560,256,256:32,128,1) -> Float(25600,2560,1,1280,10) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.10651 [TensorRT] VERBOSE: Tactic: 0 Time: 0.049844 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.049844 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2560,256,256:32,128,1) -> Half(25600,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.09125 [TensorRT] VERBOSE: Tactic: 0 Time: 0.047084 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.047084 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2560,256,256:32,128,1) -> Half(12800,1280,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.094167 [TensorRT] VERBOSE: Tactic: 0 Time: 0.053854 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.053854 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,2560,256,128,1) -> Float(25600,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.626458 [TensorRT] VERBOSE: Tactic: 0 Time: 0.026302 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.026302 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,2560,256,128,1) -> Float(25600,2560,1,1280,10) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.091197 [TensorRT] VERBOSE: Tactic: 0 Time: 0.042552 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.042552 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,2560,256,128,1) -> Float(2560,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.077083 [TensorRT] VERBOSE: Tactic: 0 Time: 0.187343 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.077083 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,2560,256,128,1) -> Half(12800,1280,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.037968 [TensorRT] VERBOSE: Tactic: 0 Time: 0.023959 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.023959 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,1280,256:2,128,1) -> Float(25600,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.086511 [TensorRT] VERBOSE: Tactic: 0 Time: 0.021667 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.021667 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,1280,256:2,128,1) -> Float(25600,2560,1,1280,10) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.093541 [TensorRT] VERBOSE: Tactic: 0 Time: 0.049479 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.049479 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,1280,256:2,128,1) -> Float(2560,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.079427 [TensorRT] VERBOSE: Tactic: 0 Time: 0.188385 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.079427 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,1280,256:2,128,1) -> Half(25600,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.220885 [TensorRT] VERBOSE: Tactic: 0 Time: 0.021563 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.021563 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(25600,2560,256,128,1) -> Float(25600,2560,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.010156 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.010156 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(25600,2560,1,1280,10) -> Float(25600,2560,2560,1,1280,10) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.061041 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.061041 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(2560,256,256:32,128,1) -> Float(2560,256,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.213697 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.213697 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(25600,2560,256,128,1) -> Half(25600,2560,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.005833 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005833 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(12800,1280,256:2,128,1) -> Half(12800,1280,1280,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.074844 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.074844 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,2560,2560,256,128,1) -> Float(25600,2560,2560,1,1280,10) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.176771 [TensorRT] VERBOSE: Tactic: 0 Time: 0.042708 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.042708 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,2560,2560,256,128,1) -> Float(2560,256,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.170365 [TensorRT] VERBOSE: Tactic: 0 Time: 0.188073 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.170365 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,2560,2560,256,128,1) -> Half(25600,2560,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.607656 [TensorRT] VERBOSE: Tactic: 0 Time: 0.029271 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.029271 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,2560,2560,256,128,1) -> Half(12800,1280,1280,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.091146 [TensorRT] VERBOSE: Tactic: 0 Time: 0.02401 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.02401 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,2560,2560,1,1280,10) -> Float(25600,2560,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.167656 [TensorRT] VERBOSE: Tactic: 0 Time: 0.040469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.040469 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,2560,2560,1,1280,10) -> Float(2560,256,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.091146 [TensorRT] VERBOSE: Tactic: 0 Time: 0.195938 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.091146 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,2560,2560,1,1280,10) -> Half(25600,2560,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.086458 [TensorRT] VERBOSE: Tactic: 0 Time: 0.039427 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.039427 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,2560,2560,1,1280,10) -> Half(12800,1280,1280,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.09125 [TensorRT] VERBOSE: Tactic: 0 Time: 0.047187 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.047187 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2560,256,256,256:32,128,1) -> Float(25600,2560,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.170468 [TensorRT] VERBOSE: Tactic: 0 Time: 0.047812 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.047812 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2560,256,256,256:32,128,1) -> Float(25600,2560,2560,1,1280,10) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.105729 [TensorRT] VERBOSE: Tactic: 0 Time: 0.050312 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.050312 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2560,256,256,256:32,128,1) -> Half(25600,2560,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.091927 [TensorRT] VERBOSE: Tactic: 0 Time: 0.047865 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.047865 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2560,256,256,256:32,128,1) -> Half(12800,1280,1280,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.094115 [TensorRT] VERBOSE: Tactic: 0 Time: 0.054323 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.054323 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,2560,2560,256,128,1) -> Float(25600,2560,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.626354 [TensorRT] VERBOSE: Tactic: 0 Time: 0.02625 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.02625 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,2560,2560,256,128,1) -> Float(25600,2560,2560,1,1280,10) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.091145 [TensorRT] VERBOSE: Tactic: 0 Time: 0.0425 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.0425 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,2560,2560,256,128,1) -> Float(2560,256,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.077084 [TensorRT] VERBOSE: Tactic: 0 Time: 0.188385 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.077084 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,2560,2560,256,128,1) -> Half(12800,1280,1280,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.037969 [TensorRT] VERBOSE: Tactic: 0 Time: 0.023958 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.023958 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,1280,1280,256:2,128,1) -> Float(25600,2560,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.086458 [TensorRT] VERBOSE: Tactic: 0 Time: 0.021667 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.021667 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,1280,1280,256:2,128,1) -> Float(25600,2560,2560,1,1280,10) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.093438 [TensorRT] VERBOSE: Tactic: 0 Time: 0.049635 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.049635 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,1280,1280,256:2,128,1) -> Float(2560,256,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.079531 [TensorRT] VERBOSE: Tactic: 0 Time: 0.188281 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.079531 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,1280,1280,256:2,128,1) -> Half(25600,2560,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.218906 [TensorRT] VERBOSE: Tactic: 0 Time: 0.021718 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.021718 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,2560,2560,256,128,1) -> Float(51200,5120,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.72458 [TensorRT] VERBOSE: Tactic: 0 Time: 0.047084 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.047084 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,2560,2560,256,128,1) -> Float(51200,5120,2560,1,1280,10) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 10.39 [TensorRT] VERBOSE: Tactic: 0 Time: 0.051718 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.051718 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,2560,2560,256,128,1) -> Float(5120,512,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 10.3898 [TensorRT] VERBOSE: Tactic: 0 Time: 0.06427 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.06427 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,2560,2560,256,128,1) -> Half(51200,5120,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.095729 [TensorRT] VERBOSE: Tactic: 0 Time: 0.047135 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.047135 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,2560,2560,256,128,1) -> Half(25600,2560,1280,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.6975 [TensorRT] VERBOSE: Tactic: 0 Time: 0.056354 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.056354 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,2560,2560,1,1280,10) -> Float(51200,5120,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 10.4036 [TensorRT] VERBOSE: Tactic: 0 Time: 0.047136 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.047136 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,2560,2560,1,1280,10) -> Float(51200,5120,2560,1,1280,10) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 5.90651 [TensorRT] VERBOSE: Tactic: 0 Time: 0.049792 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.049792 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,2560,2560,1,1280,10) -> Float(5120,512,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 5.91104 [TensorRT] VERBOSE: Tactic: 0 Time: 0.073385 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.073385 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,2560,2560,1,1280,10) -> Half(51200,5120,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.64906 [TensorRT] VERBOSE: Tactic: 0 Time: 0.047135 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.047135 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,2560,2560,1,1280,10) -> Half(25600,2560,1280,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.62573 [TensorRT] VERBOSE: Tactic: 0 Time: 0.056302 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.056302 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2560,256,256,256:32,128,1) -> Float(51200,5120,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 10.4015 [TensorRT] VERBOSE: Tactic: 0 Time: 0.055886 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.055886 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2560,256,256,256:32,128,1) -> Float(51200,5120,2560,1,1280,10) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 5.9112 [TensorRT] VERBOSE: Tactic: 0 Time: 0.060938 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.060938 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2560,256,256,256:32,128,1) -> Float(5120,512,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 5.91339 [TensorRT] VERBOSE: Tactic: 0 Time: 0.088854 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.088854 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2560,256,256,256:32,128,1) -> Half(51200,5120,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.6675 [TensorRT] VERBOSE: Tactic: 0 Time: 0.05599 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.05599 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2560,256,256,256:32,128,1) -> Half(25600,2560,1280,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.6374 [TensorRT] VERBOSE: Tactic: 0 Time: 0.065625 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.065625 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,2560,2560,256,128,1) -> Float(51200,5120,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.733177 [TensorRT] VERBOSE: Tactic: 0 Time: 0.047239 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.047239 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,2560,2560,256,128,1) -> Float(51200,5120,2560,1,1280,10) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.71391 [TensorRT] VERBOSE: Tactic: 0 Time: 0.051719 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.051719 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,2560,2560,256,128,1) -> Float(5120,512,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.71609 [TensorRT] VERBOSE: Tactic: 0 Time: 0.06526 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.06526 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,2560,2560,256,128,1) -> Half(51200,5120,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.742031 [TensorRT] VERBOSE: Tactic: 0 Time: 0.042552 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.042552 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,2560,2560,256,128,1) -> Half(25600,2560,1280,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 3.39057 [TensorRT] VERBOSE: Tactic: 0 Time: 0.051718 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.051718 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,1280,1280,256:2,128,1) -> Float(51200,5120,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.67458 [TensorRT] VERBOSE: Tactic: 0 Time: 0.056406 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.056406 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,1280,1280,256:2,128,1) -> Float(51200,5120,2560,1,1280,10) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.69057 [TensorRT] VERBOSE: Tactic: 0 Time: 0.058854 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.058854 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,1280,1280,256:2,128,1) -> Float(5120,512,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.69536 [TensorRT] VERBOSE: Tactic: 0 Time: 0.067813 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.067813 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,1280,1280,256:2,128,1) -> Half(51200,5120,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 3.47406 [TensorRT] VERBOSE: Tactic: 0 Time: 0.051719 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.051719 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,1280,1280,256:2,128,1) -> Half(25600,2560,1280,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.67682 [TensorRT] VERBOSE: Tactic: 0 Time: 0.061198 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.061198 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,2560,2560,256,128,1) -> Float(51200,5120,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.7249 [TensorRT] VERBOSE: Tactic: 0 Time: 0.04724 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.04724 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,2560,2560,256,128,1) -> Float(51200,5120,2560,1,1280,10) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 10.3875 [TensorRT] VERBOSE: Tactic: 0 Time: 0.051771 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.051771 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,2560,2560,256,128,1) -> Float(5120,512,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 10.3831 [TensorRT] VERBOSE: Tactic: 0 Time: 0.189115 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.189115 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,2560,2560,256,128,1) -> Half(51200,5120,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.095781 [TensorRT] VERBOSE: Tactic: 0 Time: 0.047031 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.047031 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,2560,2560,256,128,1) -> Half(25600,2560,1280,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.69974 [TensorRT] VERBOSE: Tactic: 0 Time: 0.056406 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.056406 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,2560,2560,1,1280,10) -> Float(51200,5120,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 10.3947 [TensorRT] VERBOSE: Tactic: 0 Time: 0.047187 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.047187 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,2560,2560,1,1280,10) -> Float(51200,5120,2560,1,1280,10) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 5.91099 [TensorRT] VERBOSE: Tactic: 0 Time: 0.051822 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.051822 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,2560,2560,1,1280,10) -> Float(5120,512,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 5.90661 [TensorRT] VERBOSE: Tactic: 0 Time: 0.197657 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.197657 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,2560,2560,1,1280,10) -> Half(51200,5120,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.64891 [TensorRT] VERBOSE: Tactic: 0 Time: 0.047291 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.047291 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25600,2560,2560,1,1280,10) -> Half(25600,2560,1280,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.62354 [TensorRT] VERBOSE: Tactic: 0 Time: 0.056459 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.056459 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2560,256,256,256:32,128,1) -> Float(51200,5120,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 10.4014 [TensorRT] VERBOSE: Tactic: 0 Time: 0.055521 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.055521 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2560,256,256,256:32,128,1) -> Float(51200,5120,2560,1,1280,10) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 5.91364 [TensorRT] VERBOSE: Tactic: 0 Time: 0.060469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.060469 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2560,256,256,256:32,128,1) -> Float(5120,512,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 5.91177 [TensorRT] VERBOSE: Tactic: 0 Time: 0.212396 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.212396 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2560,256,256,256:32,128,1) -> Half(51200,5120,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.66307 [TensorRT] VERBOSE: Tactic: 0 Time: 0.056823 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.056823 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2560,256,256,256:32,128,1) -> Half(25600,2560,1280,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.63734 [TensorRT] VERBOSE: Tactic: 0 Time: 0.066302 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.066302 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,2560,2560,256,128,1) -> Float(51200,5120,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.73276 [TensorRT] VERBOSE: Tactic: 0 Time: 0.047083 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.047083 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,2560,2560,256,128,1) -> Float(51200,5120,2560,1,1280,10) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.7162 [TensorRT] VERBOSE: Tactic: 0 Time: 0.051667 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.051667 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,2560,2560,256,128,1) -> Float(5120,512,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.69989 [TensorRT] VERBOSE: Tactic: 0 Time: 0.188698 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.188698 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,2560,2560,256,128,1) -> Half(51200,5120,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.74198 [TensorRT] VERBOSE: Tactic: 0 Time: 0.042552 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.042552 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,2560,2560,256,128,1) -> Half(25600,2560,1280,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 3.39073 [TensorRT] VERBOSE: Tactic: 0 Time: 0.051771 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.051771 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,1280,1280,256:2,128,1) -> Float(51200,5120,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.67333 [TensorRT] VERBOSE: Tactic: 0 Time: 0.056406 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.056406 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,1280,1280,256:2,128,1) -> Float(51200,5120,2560,1,1280,10) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.69073 [TensorRT] VERBOSE: Tactic: 0 Time: 0.058958 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.058958 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,1280,1280,256:2,128,1) -> Float(5120,512,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.67453 [TensorRT] VERBOSE: Tactic: 0 Time: 0.190417 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.190417 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,1280,1280,256:2,128,1) -> Half(51200,5120,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 3.47609 [TensorRT] VERBOSE: Tactic: 0 Time: 0.051719 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.051719 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,1280,1280,256:2,128,1) -> Half(25600,2560,1280,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/h_stack_Unsqueeze__1465:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.67891 [TensorRT] VERBOSE: Tactic: 0 Time: 0.060938 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.060938 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(3200,25,5,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise (CudaDepthwiseConvolution) [TensorRT] VERBOSE: Tactic: -1 Time: 0.044792 [TensorRT] VERBOSE: Fastest Tactic: -1 Time: 0.044792 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.007865 [TensorRT] VERBOSE: Tactic: 1 Time: 0.007864 [TensorRT] VERBOSE: Tactic: 2 Time: 0.007917 [TensorRT] VERBOSE: Tactic: 5 Time: 38.9823 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.007864 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 3.41047 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [TensorRT] VERBOSE: Tactic: 1754984623894446479 Time: 3.5412 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [TensorRT] VERBOSE: Tactic: 3611739942397549984 Time: 3.7324 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [TensorRT] VERBOSE: Tactic: 4337000649858996379 Time: 3.70646 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 3.38562 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 3.28474 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 3.31104 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 3.5099 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 3.35802 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [TensorRT] VERBOSE: Tactic: -9137461792520977713 Time: 3.75375 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 3.36828 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [TensorRT] VERBOSE: Tactic: -8133971918129952780 Time: 3.70234 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [TensorRT] VERBOSE: Tactic: -6092040395344634144 Time: 3.51474 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 3.45297 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 3.2824 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 3.33839 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 3.26427 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 3.29854 [TensorRT] VERBOSE: Fastest Tactic: -836875257600482091 Time: 3.26427 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(3200,1,640,128) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(3200,25,5,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.007813 [TensorRT] VERBOSE: Tactic: 1 Time: 0.007812 [TensorRT] VERBOSE: Tactic: 2 Time: 0.007813 [TensorRT] VERBOSE: Tactic: 5 Time: 38.7823 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.007812 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(1600,25:2,5,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(3200,25,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise (CudaDepthwiseConvolution) [TensorRT] VERBOSE: Tactic: -1 Time: 0.044791 [TensorRT] VERBOSE: Fastest Tactic: -1 Time: 0.044791 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.0125 [TensorRT] VERBOSE: Tactic: 1 Time: 0.012604 [TensorRT] VERBOSE: Tactic: 2 Time: 0.010365 [TensorRT] VERBOSE: Tactic: 4 Time: 17.0493 [TensorRT] VERBOSE: Tactic: 5 Time: 39.0914 [TensorRT] VERBOSE: Tactic: 6 Time: 5.70396 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.010365 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 3.43104 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [TensorRT] VERBOSE: Tactic: 1754984623894446479 Time: 3.55479 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [TensorRT] VERBOSE: Tactic: 3611739942397549984 Time: 3.84302 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724 [TensorRT] VERBOSE: Tactic: 3827454225649558724 Time: 3.04943 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [TensorRT] VERBOSE: Tactic: 4337000649858996379 Time: 3.63458 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 3.42297 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 3.34271 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 3.2337 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896 [TensorRT] VERBOSE: Tactic: 5921334924264294896 Time: 2.97182 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 3.46021 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 3.43495 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038 [TensorRT] VERBOSE: Tactic: 7852627285308570038 Time: 2.95016 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [TensorRT] VERBOSE: Tactic: -9137461792520977713 Time: 3.85167 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509 [TensorRT] VERBOSE: Tactic: -8776506421218919509 Time: 2.95828 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 3.33474 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [TensorRT] VERBOSE: Tactic: -8133971918129952780 Time: 3.70094 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [TensorRT] VERBOSE: Tactic: -6092040395344634144 Time: 3.57927 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 3.45786 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 3.29911 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239 [TensorRT] VERBOSE: Tactic: -2318106587342035239 Time: 2.9862 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657 [TensorRT] VERBOSE: Tactic: -1343271414618805657 Time: 3.03516 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 3.42953 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 3.29635 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 3.35063 [TensorRT] VERBOSE: Fastest Tactic: 7852627285308570038 Time: 2.95016 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 2 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(3200,1,640,128) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(3200,25,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.012396 [TensorRT] VERBOSE: Tactic: 1 Time: 0.012448 [TensorRT] VERBOSE: Tactic: 2 Time: 0.0125 [TensorRT] VERBOSE: Tactic: 4 Time: 17.0189 [TensorRT] VERBOSE: Tactic: 5 Time: 38.967 [TensorRT] VERBOSE: Tactic: 6 Time: 37.7855 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012396 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(1600,25:2,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(12800,100,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(12800,1,1280,128) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_2/depthwise (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_2/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(12800,100,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(6400,100:2,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_2/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.014896 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005573 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005573 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.102917 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.010104 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.01474 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.010104 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.008073 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.105208 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.01026 [TensorRT] VERBOSE: Tactic: 0 Time: 0.00552 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00552 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.019323 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.010156 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.010104 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.012396 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1152,9,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 Time: 0.028594 [TensorRT] VERBOSE: Tactic: 655359 Time: 0.024219 [TensorRT] VERBOSE: Tactic: 786431 Time: 0.021563 [TensorRT] VERBOSE: Tactic: 851967 Time: 0.014792 [TensorRT] VERBOSE: Tactic: 1179647 Time: 0.017292 [TensorRT] VERBOSE: Tactic: 1310719 Time: 0.057292 [TensorRT] VERBOSE: Tactic: 1376255 Time: 0.035625 [TensorRT] VERBOSE: Tactic: 1441791 Time: 0.015052 [TensorRT] VERBOSE: Tactic: 1507327 Time: 0.023906 [TensorRT] VERBOSE: Tactic: 1638399 Time: 0.019323 [TensorRT] VERBOSE: Tactic: 1835007 Time: 0.019323 [TensorRT] VERBOSE: Tactic: 1900543 Time: 0.04026 [TensorRT] VERBOSE: Tactic: 2097151 Time: 0.021667 [TensorRT] VERBOSE: Tactic: 2162687 Time: 0.040156 [TensorRT] VERBOSE: Tactic: 2293759 Time: 0.035572 [TensorRT] VERBOSE: Tactic: 2359295 Time: 0.026354 [TensorRT] VERBOSE: Tactic: 2686975 Time: 0.033334 [TensorRT] VERBOSE: Tactic: 3080191 Time: 0.017031 [TensorRT] VERBOSE: Tactic: 3342335 Time: 0.024063 [TensorRT] VERBOSE: Tactic: 3407871 Time: 0.022084 [TensorRT] VERBOSE: Tactic: 3538943 Time: 0.019427 [TensorRT] VERBOSE: Tactic: 3670015 Time: 0.040156 [TensorRT] VERBOSE: Tactic: 3932159 Time: 0.030938 [TensorRT] VERBOSE: Tactic: 3997695 Time: 0.017083 [TensorRT] VERBOSE: Tactic: 4063231 Time: 0.014687 [TensorRT] VERBOSE: Tactic: 4194303 Time: 0.021927 [TensorRT] VERBOSE: Tactic: 4259839 Time: 0.021667 [TensorRT] VERBOSE: Tactic: 4325375 Time: 0.019531 [TensorRT] VERBOSE: Tactic: 4521983 Time: 0.035625 [TensorRT] VERBOSE: Tactic: 4587519 Time: 0.017135 [TensorRT] VERBOSE: Tactic: 4653055 Time: 0.014844 [TensorRT] VERBOSE: Tactic: 4915199 Time: 0.017031 [TensorRT] VERBOSE: Tactic: 4980735 Time: 0.031094 [TensorRT] VERBOSE: Tactic: 5177343 Time: 0.0125 [TensorRT] VERBOSE: Tactic: 5242879 Time: 0.021615 [TensorRT] VERBOSE: Tactic: 5373951 Time: 0.017084 [TensorRT] VERBOSE: Tactic: 5439487 Time: 0.019427 [TensorRT] VERBOSE: Tactic: 5570559 Time: 0.017136 [TensorRT] VERBOSE: Tactic: 5636095 Time: 0.015156 [TensorRT] VERBOSE: Tactic: 5701631 Time: 0.033282 [TensorRT] VERBOSE: Tactic: 5767167 Time: 0.021667 [TensorRT] VERBOSE: Tactic: 5832703 Time: 0.021875 [TensorRT] VERBOSE: Tactic: 5898239 Time: 0.014635 [TensorRT] VERBOSE: Tactic: 6029311 Time: 0.033125 [TensorRT] VERBOSE: Tactic: 6225919 Time: 0.016979 [TensorRT] VERBOSE: Tactic: 6291455 Time: 0.017083 [TensorRT] VERBOSE: Tactic: 6422527 Time: 0.019375 [TensorRT] VERBOSE: Tactic: 6750207 Time: 0.017031 [TensorRT] VERBOSE: Tactic: 6815743 Time: 0.021823 [TensorRT] VERBOSE: Tactic: 6946815 Time: 0.02401 [TensorRT] VERBOSE: Tactic: 7012351 Time: 0.019688 [TensorRT] VERBOSE: Tactic: 7077887 Time: 0.017031 [TensorRT] VERBOSE: Tactic: 7143423 Time: 0.021667 [TensorRT] VERBOSE: Tactic: 7208959 Time: 0.021562 [TensorRT] VERBOSE: Tactic: 7340031 Time: 0.01474 [TensorRT] VERBOSE: Tactic: 7405567 Time: 0.01474 [TensorRT] VERBOSE: Tactic: 7536639 Time: 0.021615 [TensorRT] VERBOSE: Tactic: 7602175 Time: 0.024011 [TensorRT] VERBOSE: Tactic: 7733247 Time: 0.016927 [TensorRT] VERBOSE: Tactic: 7798783 Time: 0.021719 [TensorRT] VERBOSE: Tactic: 8191999 Time: 0.021667 [TensorRT] VERBOSE: Tactic: 8257535 Time: 0.017083 [TensorRT] VERBOSE: Tactic: 8323071 Time: 0.019271 [TensorRT] VERBOSE: Tactic: 8650751 Time: 0.021562 [TensorRT] VERBOSE: Tactic: 8716287 Time: 0.017031 [TensorRT] VERBOSE: Tactic: 9109503 Time: 0.019427 [TensorRT] VERBOSE: Tactic: 9568255 Time: 0.01698 [TensorRT] VERBOSE: Tactic: 9895935 Time: 0.021979 [TensorRT] VERBOSE: Tactic: 10223615 Time: 0.033282 [TensorRT] VERBOSE: Tactic: 10354687 Time: 0.021823 [TensorRT] VERBOSE: Tactic: 10551295 Time: 0.023958 [TensorRT] VERBOSE: Tactic: 10747903 Time: 0.017083 [TensorRT] VERBOSE: Tactic: 10944511 Time: 0.028646 [TensorRT] VERBOSE: Fastest Tactic: 5177343 Time: 0.0125 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.066303 [TensorRT] VERBOSE: Tactic: 1 Time: 0.062657 [TensorRT] VERBOSE: Tactic: 2 Time: 0.126146 [TensorRT] VERBOSE: Tactic: 4 Time: 4.18266 [TensorRT] VERBOSE: Tactic: 5 Time: 1.27083 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.062657 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 0.047395 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TensorRT] VERBOSE: Tactic: 1698681053543049347 Time: 0.038125 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 0.035833 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 0.038125 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 0.035782 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TensorRT] VERBOSE: Tactic: 5326823351883942011 Time: 0.035729 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TensorRT] VERBOSE: Tactic: 5500448035057547314 Time: 0.038125 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 0.042708 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 0.038282 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 0.037865 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TensorRT] VERBOSE: Tactic: -6576203419454146580 Time: 0.040781 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 0.04276 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 0.042708 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 0.040416 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 0.038125 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 0.035677 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TensorRT] VERBOSE: Tactic: -377491875521947884 Time: 0.035781 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TensorRT] VERBOSE: Tactic: -37215280111360163 Time: 0.038125 [TensorRT] VERBOSE: Fastest Tactic: -410470605513481746 Time: 0.035677 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 5177343 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1152,1,384,128) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TensorRT] VERBOSE: Tactic: 3886731678879822788 Time: 0.033438 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TensorRT] VERBOSE: Tactic: 6629944304117643200 Time: 0.056563 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TensorRT] VERBOSE: Tactic: -9153228964338181824 Time: 0.056614 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TensorRT] VERBOSE: Tactic: -7394439838318485025 Time: 0.033229 [TensorRT] VERBOSE: Fastest Tactic: -7394439838318485025 Time: 0.033229 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(1152,9,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.068386 [TensorRT] VERBOSE: Tactic: 1 Time: 0.065416 [TensorRT] VERBOSE: Tactic: 2 Time: 0.128021 [TensorRT] VERBOSE: Tactic: 4 Time: 4.23896 [TensorRT] VERBOSE: Tactic: 5 Time: 1.26646 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.065416 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(576,9:2,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(576,9:2,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 Time: 0.019531 [TensorRT] VERBOSE: Tactic: 655359 Time: 0.026302 [TensorRT] VERBOSE: Tactic: 786431 Time: 0.017031 [TensorRT] VERBOSE: Tactic: 851967 Time: 0.010209 [TensorRT] VERBOSE: Tactic: 1179647 Time: 0.012448 [TensorRT] VERBOSE: Tactic: 1310719 Time: 0.044844 [TensorRT] VERBOSE: Tactic: 1376255 Time: 0.021667 [TensorRT] VERBOSE: Tactic: 1441791 Time: 0.0125 [TensorRT] VERBOSE: Tactic: 1507327 Time: 0.017083 [TensorRT] VERBOSE: Tactic: 1638399 Time: 0.014688 [TensorRT] VERBOSE: Tactic: 1835007 Time: 0.014844 [TensorRT] VERBOSE: Tactic: 1900543 Time: 0.026562 [TensorRT] VERBOSE: Tactic: 2097151 Time: 0.017084 [TensorRT] VERBOSE: Tactic: 2162687 Time: 0.024011 [TensorRT] VERBOSE: Tactic: 2293759 Time: 0.021667 [TensorRT] VERBOSE: Tactic: 2359295 Time: 0.019531 [TensorRT] VERBOSE: Tactic: 2686975 Time: 0.033177 [TensorRT] VERBOSE: Tactic: 3080191 Time: 0.014688 [TensorRT] VERBOSE: Tactic: 3342335 Time: 0.017031 [TensorRT] VERBOSE: Tactic: 3407871 Time: 0.015052 [TensorRT] VERBOSE: Tactic: 3538943 Time: 0.012448 [TensorRT] VERBOSE: Tactic: 3670015 Time: 0.042448 [TensorRT] VERBOSE: Tactic: 3932159 Time: 0.012604 [TensorRT] VERBOSE: Tactic: 3997695 Time: 0.012396 [TensorRT] VERBOSE: Tactic: 4063231 Time: 0.012395 [TensorRT] VERBOSE: Tactic: 4194303 Time: 0.017031 [TensorRT] VERBOSE: Tactic: 4259839 Time: 0.016979 [TensorRT] VERBOSE: Tactic: 4325375 Time: 0.014636 [TensorRT] VERBOSE: Tactic: 4521983 Time: 0.022031 [TensorRT] VERBOSE: Tactic: 4587519 Time: 0.012344 [TensorRT] VERBOSE: Tactic: 4653055 Time: 0.010417 [TensorRT] VERBOSE: Tactic: 4915199 Time: 0.012448 [TensorRT] VERBOSE: Tactic: 4980735 Time: 0.019323 [TensorRT] VERBOSE: Tactic: 5177343 Time: 0.007812 [TensorRT] VERBOSE: Tactic: 5242879 Time: 0.012708 [TensorRT] VERBOSE: Tactic: 5373951 Time: 0.012396 [TensorRT] VERBOSE: Tactic: 5439487 Time: 0.01474 [TensorRT] VERBOSE: Tactic: 5570559 Time: 0.017032 [TensorRT] VERBOSE: Tactic: 5636095 Time: 0.010469 [TensorRT] VERBOSE: Tactic: 5701631 Time: 0.019375 [TensorRT] VERBOSE: Tactic: 5767167 Time: 0.012343 [TensorRT] VERBOSE: Tactic: 5832703 Time: 0.014739 [TensorRT] VERBOSE: Tactic: 5898239 Time: 0.012447 [TensorRT] VERBOSE: Tactic: 6029311 Time: 0.019739 [TensorRT] VERBOSE: Tactic: 6225919 Time: 0.010417 [TensorRT] VERBOSE: Tactic: 6291455 Time: 0.012605 [TensorRT] VERBOSE: Tactic: 6422527 Time: 0.014739 [TensorRT] VERBOSE: Tactic: 6750207 Time: 0.017031 [TensorRT] VERBOSE: Tactic: 6815743 Time: 0.012605 [TensorRT] VERBOSE: Tactic: 6946815 Time: 0.014687 [TensorRT] VERBOSE: Tactic: 7012351 Time: 0.016979 [TensorRT] VERBOSE: Tactic: 7077887 Time: 0.012448 [TensorRT] VERBOSE: Tactic: 7143423 Time: 0.012708 [TensorRT] VERBOSE: Tactic: 7208959 Time: 0.01474 [TensorRT] VERBOSE: Tactic: 7340031 Time: 0.010521 [TensorRT] VERBOSE: Tactic: 7405567 Time: 0.010157 [TensorRT] VERBOSE: Tactic: 7536639 Time: 0.017031 [TensorRT] VERBOSE: Tactic: 7602175 Time: 0.014739 [TensorRT] VERBOSE: Tactic: 7733247 Time: 0.012448 [TensorRT] VERBOSE: Tactic: 7798783 Time: 0.017031 [TensorRT] VERBOSE: Tactic: 8191999 Time: 0.012396 [TensorRT] VERBOSE: Tactic: 8257535 Time: 0.012552 [TensorRT] VERBOSE: Tactic: 8323071 Time: 0.01474 [TensorRT] VERBOSE: Tactic: 8650751 Time: 0.012448 [TensorRT] VERBOSE: Tactic: 8716287 Time: 0.010521 [TensorRT] VERBOSE: Tactic: 9109503 Time: 0.017032 [TensorRT] VERBOSE: Tactic: 9568255 Time: 0.012708 [TensorRT] VERBOSE: Tactic: 9895935 Time: 0.016979 [TensorRT] VERBOSE: Tactic: 10223615 Time: 0.033282 [TensorRT] VERBOSE: Tactic: 10354687 Time: 0.014948 [TensorRT] VERBOSE: Tactic: 10551295 Time: 0.01698 [TensorRT] VERBOSE: Tactic: 10747903 Time: 0.012344 [TensorRT] VERBOSE: Tactic: 10944511 Time: 0.019323 [TensorRT] VERBOSE: Fastest Tactic: 5177343 Time: 0.007812 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TensorRT] VERBOSE: Tactic: 3066127711859985668 Time: 0.026511 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TensorRT] VERBOSE: Tactic: 3564772625446233998 Time: 0.028698 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TensorRT] VERBOSE: Tactic: 5319956359050645452 Time: 0.028542 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TensorRT] VERBOSE: Tactic: 7205456024582378848 Time: 0.024219 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TensorRT] VERBOSE: Tactic: 8163473458334948789 Time: 0.024167 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TensorRT] VERBOSE: Tactic: -4212163711445252890 Time: 0.021563 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TensorRT] VERBOSE: Tactic: -3898373634979201110 Time: 0.021771 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TensorRT] VERBOSE: Tactic: -2409163523992614473 Time: 0.023958 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TensorRT] VERBOSE: Tactic: -1716393687483585322 Time: 0.021927 [TensorRT] VERBOSE: Fastest Tactic: -4212163711445252890 Time: 0.021563 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 5177343 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(3200,25,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(3200,1,640,128) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(3200,25,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(1600,25:2,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_3/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(1600,25:2,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(12800,100,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(12800,1,1280,128) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(12800,100,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(6400,100:2,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_2/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(6400,100:2,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,5120,2560,256,128,1) -> Float(51200,5120,2560,1,1280,10) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.349427 [TensorRT] VERBOSE: Tactic: 0 Time: 0.081666 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.081666 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,5120,2560,256,128,1) -> Float(5120,512,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.335834 [TensorRT] VERBOSE: Tactic: 0 Time: 0.36724 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.335834 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,5120,2560,256,128,1) -> Half(51200,5120,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.21 [TensorRT] VERBOSE: Tactic: 0 Time: 0.05901 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.05901 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,5120,2560,256,128,1) -> Half(25600,2560,1280,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.176771 [TensorRT] VERBOSE: Tactic: 0 Time: 0.046406 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.046406 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,5120,2560,1,1280,10) -> Float(51200,5120,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.329792 [TensorRT] VERBOSE: Tactic: 0 Time: 0.075156 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.075156 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,5120,2560,1,1280,10) -> Float(5120,512,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.175677 [TensorRT] VERBOSE: Tactic: 0 Time: 0.385 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.175677 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,5120,2560,1,1280,10) -> Half(51200,5120,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.165834 [TensorRT] VERBOSE: Tactic: 0 Time: 0.076302 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.076302 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,5120,2560,1,1280,10) -> Half(25600,2560,1280,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.1775 [TensorRT] VERBOSE: Tactic: 0 Time: 0.089479 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.089479 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(5120,512,256,256:32,128,1) -> Float(51200,5120,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.338021 [TensorRT] VERBOSE: Tactic: 0 Time: 0.090052 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.090052 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(5120,512,256,256:32,128,1) -> Float(51200,5120,2560,1,1280,10) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.206875 [TensorRT] VERBOSE: Tactic: 0 Time: 0.094583 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.094583 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(5120,512,256,256:32,128,1) -> Half(51200,5120,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.173958 [TensorRT] VERBOSE: Tactic: 0 Time: 0.089427 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.089427 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(5120,512,256,256:32,128,1) -> Half(25600,2560,1280,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.179531 [TensorRT] VERBOSE: Tactic: 0 Time: 0.103021 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.103021 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,5120,2560,256,128,1) -> Float(51200,5120,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.24458 [TensorRT] VERBOSE: Tactic: 0 Time: 0.048594 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.048594 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,5120,2560,256,128,1) -> Float(51200,5120,2560,1,1280,10) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.176042 [TensorRT] VERBOSE: Tactic: 0 Time: 0.083333 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.083333 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,5120,2560,256,128,1) -> Float(5120,512,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.147447 [TensorRT] VERBOSE: Tactic: 0 Time: 0.369271 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.147447 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,5120,2560,256,128,1) -> Half(25600,2560,1280,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.070417 [TensorRT] VERBOSE: Tactic: 0 Time: 0.045104 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.045104 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,2560,1280,256:2,128,1) -> Float(51200,5120,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.166406 [TensorRT] VERBOSE: Tactic: 0 Time: 0.040625 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.040625 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,2560,1280,256:2,128,1) -> Float(51200,5120,2560,1,1280,10) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.178697 [TensorRT] VERBOSE: Tactic: 0 Time: 0.094688 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.094688 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,2560,1280,256:2,128,1) -> Float(5120,512,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.15302 [TensorRT] VERBOSE: Tactic: 0 Time: 0.370104 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.15302 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,2560,1280,256:2,128,1) -> Half(51200,5120,2560,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.433907 [TensorRT] VERBOSE: Tactic: 0 Time: 0.040208 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.040208 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,5120,2560,256,128,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape + Transpose__2001 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.117083 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.117083 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,5120,2560,1,1280,10) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape + Transpose__2001 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.174584 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.174584 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(5120,512,256,256:32,128,1) -> Float(1600,400:32,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape + Transpose__2001 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.156771 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.156771 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(51200,5120,2560,256,128,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape + Transpose__2001 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.11 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.11 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(25600,2560,1280,256:2,128,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling/Reshape + Transpose__2001 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.152032 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.152032 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,400,20,1) -> Float(38400,1,1920,96) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,400,20,1) -> Half(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,400,20,1) -> Half(19200,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1,1920,96) -> Float(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1,1920,96) -> Half(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1,1920,96) -> Half(19200,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,400,20,1) -> Float(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,400,20,1) -> Float(38400,1,1920,96) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,400,20,1) -> Half(19200,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(19200,400:2,20,1) -> Float(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(19200,400:2,20,1) -> Float(38400,1,1920,96) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(19200,400:2,20,1) -> Half(38400,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.063333 [TensorRT] VERBOSE: Tactic: 0 Time: 0.08573 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.063333 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.2588 [TensorRT] VERBOSE: Tactic: 0 Time: 0.060156 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.060156 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.082396 [TensorRT] VERBOSE: Tactic: 0 Time: 0.046093 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.046093 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.078802 [TensorRT] VERBOSE: Tactic: 0 Time: 0.083281 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.078802 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.055469 [TensorRT] VERBOSE: Tactic: 0 Time: 0.082865 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.055469 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.07375 [TensorRT] VERBOSE: Tactic: 0 Time: 0.093646 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.07375 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1600,400:32,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.078438 [TensorRT] VERBOSE: Tactic: 0 Time: 0.0925 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.078438 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1600,400:32,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.060104 [TensorRT] VERBOSE: Tactic: 0 Time: 0.093855 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.060104 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1600,400:32,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.059896 [TensorRT] VERBOSE: Tactic: 0 Time: 0.090469 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.059896 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1600,400:32,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.07401 [TensorRT] VERBOSE: Tactic: 0 Time: 0.104271 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.07401 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.29578 [TensorRT] VERBOSE: Tactic: 0 Time: 0.04849 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.04849 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.052552 [TensorRT] VERBOSE: Tactic: 0 Time: 0.082917 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.052552 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.056354 [TensorRT] VERBOSE: Tactic: 0 Time: 0.045157 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.045157 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.070417 [TensorRT] VERBOSE: Tactic: 0 Time: 0.040469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.040469 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.053385 [TensorRT] VERBOSE: Tactic: 0 Time: 0.094948 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.053385 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.093437 [TensorRT] VERBOSE: Tactic: 0 Time: 0.040209 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.040209 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(38400,400,20,1), Float(51200,400,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.246927 [TensorRT] VERBOSE: Tactic: 1 Time: 0.227969 [TensorRT] VERBOSE: Tactic: 2 Time: 0.301459 [TensorRT] VERBOSE: Tactic: 4 Time: 18.1404 [TensorRT] VERBOSE: Tactic: 5 Time: 1.17125 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.227969 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 0.132969 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TensorRT] VERBOSE: Tactic: 1698681053543049347 Time: 0.119843 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 0.101614 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 0.10224 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 0.106511 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TensorRT] VERBOSE: Tactic: 5326823351883942011 Time: 0.096667 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TensorRT] VERBOSE: Tactic: 5500448035057547314 Time: 0.108594 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 0.103229 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 0.12724 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 0.103281 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TensorRT] VERBOSE: Tactic: -6576203419454146580 Time: 0.117865 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 0.133854 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 0.12073 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 0.112396 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 0.108073 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 0.100678 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TensorRT] VERBOSE: Tactic: -377491875521947884 Time: 0.10073 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TensorRT] VERBOSE: Tactic: -37215280111360163 Time: 0.100469 [TensorRT] VERBOSE: Fastest Tactic: 5326823351883942011 Time: 0.096667 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5326823351883942011 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(38400,1,1920,96), Float(51200,1,2560,128) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TensorRT] VERBOSE: Tactic: 3886731678879822788 Time: 0.116406 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TensorRT] VERBOSE: Tactic: 6629944304117643200 Time: 0.250938 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TensorRT] VERBOSE: Tactic: -9153228964338181824 Time: 0.253125 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TensorRT] VERBOSE: Tactic: -7394439838318485025 Time: 0.117344 [TensorRT] VERBOSE: Fastest Tactic: 3886731678879822788 Time: 0.116406 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(38400,400,20,1), Half(51200,400,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.231198 [TensorRT] VERBOSE: Tactic: 1 Time: 0.20099 [TensorRT] VERBOSE: Tactic: 2 Time: 0.27099 [TensorRT] VERBOSE: Tactic: 4 Time: 17.9552 [TensorRT] VERBOSE: Tactic: 5 Time: 1.12896 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.20099 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(19200,400:2,20,1), Half(25600,400:2,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TensorRT] VERBOSE: Tactic: 3066127711859985668 Time: 0.065365 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TensorRT] VERBOSE: Tactic: 3564772625446233998 Time: 0.072292 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TensorRT] VERBOSE: Tactic: 5319956359050645452 Time: 0.066771 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TensorRT] VERBOSE: Tactic: 7205456024582378848 Time: 0.058698 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TensorRT] VERBOSE: Tactic: 8163473458334948789 Time: 0.05599 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TensorRT] VERBOSE: Tactic: -4212163711445252890 Time: 0.054895 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TensorRT] VERBOSE: Tactic: -3898373634979201110 Time: 0.056354 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TensorRT] VERBOSE: Tactic: -2409163523992614473 Time: 0.05599 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TensorRT] VERBOSE: Tactic: -1716393687483585322 Time: 0.054583 [TensorRT] VERBOSE: Fastest Tactic: -1716393687483585322 Time: 0.054583 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1716393687483585322 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1152,9,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise (CudaDepthwiseConvolution) [TensorRT] VERBOSE: Tactic: -1 Time: 0.044792 [TensorRT] VERBOSE: Fastest Tactic: -1 Time: 0.044792 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.007813 [TensorRT] VERBOSE: Tactic: 1 Time: 0.007813 [TensorRT] VERBOSE: Tactic: 2 Time: 0.007812 [TensorRT] VERBOSE: Tactic: 4 Time: 31.9711 [TensorRT] VERBOSE: Tactic: 5 Time: 38.9552 [TensorRT] VERBOSE: Tactic: 6 Time: 10.9978 [TensorRT] VERBOSE: Fastest Tactic: 2 Time: 0.007812 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 6.26552 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [TensorRT] VERBOSE: Tactic: 1754984623894446479 Time: 6.20396 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [TensorRT] VERBOSE: Tactic: 3611739942397549984 Time: 6.25818 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724 [TensorRT] VERBOSE: Tactic: 3827454225649558724 Time: 5.59234 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [TensorRT] VERBOSE: Tactic: 4337000649858996379 Time: 6.27917 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 6.15708 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 5.98427 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 3.30073 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896 [TensorRT] VERBOSE: Tactic: 5921334924264294896 Time: 2.95099 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 3.49219 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 3.40448 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038 [TensorRT] VERBOSE: Tactic: 7852627285308570038 Time: 2.95135 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [TensorRT] VERBOSE: Tactic: -9137461792520977713 Time: 3.70422 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509 [TensorRT] VERBOSE: Tactic: -8776506421218919509 Time: 3.03823 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 3.31682 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [TensorRT] VERBOSE: Tactic: -8133971918129952780 Time: 3.63385 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [TensorRT] VERBOSE: Tactic: -6092040395344634144 Time: 3.57505 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 3.45333 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 3.28167 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239 [TensorRT] VERBOSE: Tactic: -2318106587342035239 Time: 3.00974 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657 [TensorRT] VERBOSE: Tactic: -1343271414618805657 Time: 2.9975 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 3.40974 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 3.25495 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 3.26693 [TensorRT] VERBOSE: Fastest Tactic: 5921334924264294896 Time: 2.95099 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 2 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1152,1,384,128) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(1152,9,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.00776 [TensorRT] VERBOSE: Tactic: 1 Time: 0.005886 [TensorRT] VERBOSE: Tactic: 2 Time: 0.007813 [TensorRT] VERBOSE: Tactic: 4 Time: 17.0338 [TensorRT] VERBOSE: Tactic: 5 Time: 38.8764 [TensorRT] VERBOSE: Tactic: 6 Time: 37.7592 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.005886 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(576,9:2,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(3200,25,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(3200,1,640,128) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_3/depthwise (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_3/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(3200,25,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(1600,25:2,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_3/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(12800,100,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(12800,1,1280,128) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2/depthwise (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(12800,100,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(6400,100:2,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,400,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise (CudaDepthwiseConvolution) [TensorRT] VERBOSE: Tactic: -1 Time: 0.091667 [TensorRT] VERBOSE: Fastest Tactic: -1 Time: 0.091667 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.102605 [TensorRT] VERBOSE: Tactic: 1 Time: 0.102604 [TensorRT] VERBOSE: Tactic: 2 Time: 0.122344 [TensorRT] VERBOSE: Tactic: 4 Time: 18.2635 [TensorRT] VERBOSE: Tactic: 5 Time: 39.2064 [TensorRT] VERBOSE: Tactic: 6 Time: 5.53792 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.102604 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 3.36115 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [TensorRT] VERBOSE: Tactic: 1754984623894446479 Time: 3.59698 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [TensorRT] VERBOSE: Tactic: 3611739942397549984 Time: 4.9074 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724 [TensorRT] VERBOSE: Tactic: 3827454225649558724 Time: 5.98995 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [TensorRT] VERBOSE: Tactic: 4337000649858996379 Time: 3.72885 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 4.76349 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 3.31786 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 4.8513 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896 [TensorRT] VERBOSE: Tactic: 5921334924264294896 Time: 4.25719 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 3.43224 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 3.34047 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038 [TensorRT] VERBOSE: Tactic: 7852627285308570038 Time: 6.37313 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [TensorRT] VERBOSE: Tactic: -9137461792520977713 Time: 4.77313 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509 [TensorRT] VERBOSE: Tactic: -8776506421218919509 Time: 5.78807 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 4.94229 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [TensorRT] VERBOSE: Tactic: -8133971918129952780 Time: 3.7437 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [TensorRT] VERBOSE: Tactic: -6092040395344634144 Time: 3.57969 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 3.39438 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 3.29693 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239 [TensorRT] VERBOSE: Tactic: -2318106587342035239 Time: 6.08156 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657 [TensorRT] VERBOSE: Tactic: -1343271414618805657 Time: 4.22182 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 3.41797 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 2.53385 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 4.71453 [TensorRT] VERBOSE: Fastest Tactic: -836875257600482091 Time: 2.53385 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,1,2560,128) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(51200,400,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.035781 [TensorRT] VERBOSE: Tactic: 1 Time: 0.035417 [TensorRT] VERBOSE: Tactic: 2 Time: 5.17302 [TensorRT] VERBOSE: Tactic: 4 Time: 18.3889 [TensorRT] VERBOSE: Tactic: 5 Time: 39.1926 [TensorRT] VERBOSE: Tactic: 6 Time: 44.0988 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.035417 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(25600,400:2,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1152,9,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1152,1,384,128) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(1152,9,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(576,9:2,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_4/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(576,9:2,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(3200,25,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(3200,1,640,128) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(3200,25,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(1600,25:2,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_3/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(1600,25:2,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(12800,100,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(12800,1,1280,128) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(12800,100,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(6400,100:2,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_2/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(6400,100:2,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,400,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 Time: 0.279792 [TensorRT] VERBOSE: Tactic: 655359 Time: 0.206823 [TensorRT] VERBOSE: Tactic: 786431 Time: 0.272656 [TensorRT] VERBOSE: Tactic: 851967 Time: 0.233177 [TensorRT] VERBOSE: Tactic: 1179647 Time: 0.257396 [TensorRT] VERBOSE: Tactic: 1310719 Time: 0.515052 [TensorRT] VERBOSE: Tactic: 1376255 Time: 0.236927 [TensorRT] VERBOSE: Tactic: 1441791 Time: 0.266666 [TensorRT] VERBOSE: Tactic: 1507327 Time: 0.238385 [TensorRT] VERBOSE: Tactic: 1638399 Time: 0.290469 [TensorRT] VERBOSE: Tactic: 1835007 Time: 0.270104 [TensorRT] VERBOSE: Tactic: 1900543 Time: 0.274114 [TensorRT] VERBOSE: Tactic: 2097151 Time: 0.314167 [TensorRT] VERBOSE: Tactic: 2162687 Time: 0.224167 [TensorRT] VERBOSE: Tactic: 2293759 Time: 0.229583 [TensorRT] VERBOSE: Tactic: 2359295 Time: 0.228646 [TensorRT] VERBOSE: Tactic: 2686975 Time: 0.202083 [TensorRT] VERBOSE: Tactic: 3080191 Time: 0.22625 [TensorRT] VERBOSE: Tactic: 3342335 Time: 0.269688 [TensorRT] VERBOSE: Tactic: 3407871 Time: 0.239584 [TensorRT] VERBOSE: Tactic: 3538943 Time: 0.23151 [TensorRT] VERBOSE: Tactic: 3670015 Time: 0.203698 [TensorRT] VERBOSE: Tactic: 3932159 Time: 0.236302 [TensorRT] VERBOSE: Tactic: 3997695 Time: 0.268542 [TensorRT] VERBOSE: Tactic: 4063231 Time: 0.246146 [TensorRT] VERBOSE: Tactic: 4194303 Time: 0.273385 [TensorRT] VERBOSE: Tactic: 4259839 Time: 0.325468 [TensorRT] VERBOSE: Tactic: 4325375 Time: 0.276459 [TensorRT] VERBOSE: Tactic: 4521983 Time: 0.255833 [TensorRT] VERBOSE: Tactic: 4587519 Time: 0.316979 [TensorRT] VERBOSE: Tactic: 4653055 Time: 0.303698 [TensorRT] VERBOSE: Tactic: 4915199 Time: 0.277187 [TensorRT] VERBOSE: Tactic: 4980735 Time: 0.275052 [TensorRT] VERBOSE: Tactic: 5177343 Time: 0.248073 [TensorRT] VERBOSE: Tactic: 5242879 Time: 0.224792 [TensorRT] VERBOSE: Tactic: 5373951 Time: 0.329219 [TensorRT] VERBOSE: Tactic: 5439487 Time: 0.323021 [TensorRT] VERBOSE: Tactic: 5570559 Time: 0.199531 [TensorRT] VERBOSE: Tactic: 5636095 Time: 0.245156 [TensorRT] VERBOSE: Tactic: 5701631 Time: 0.241666 [TensorRT] VERBOSE: Tactic: 5767167 Time: 0.402552 [TensorRT] VERBOSE: Tactic: 5832703 Time: 0.231875 [TensorRT] VERBOSE: Tactic: 5898239 Time: 0.207708 [TensorRT] VERBOSE: Tactic: 6029311 Time: 0.225157 [TensorRT] VERBOSE: Tactic: 6225919 Time: 0.220052 [TensorRT] VERBOSE: Tactic: 6291455 Time: 0.256719 [TensorRT] VERBOSE: Tactic: 6422527 Time: 0.219531 [TensorRT] VERBOSE: Tactic: 6750207 Time: 0.279167 [TensorRT] VERBOSE: Tactic: 6815743 Time: 0.245156 [TensorRT] VERBOSE: Tactic: 6946815 Time: 0.359844 [TensorRT] VERBOSE: Tactic: 7012351 Time: 0.313438 [TensorRT] VERBOSE: Tactic: 7077887 Time: 0.22625 [TensorRT] VERBOSE: Tactic: 7143423 Time: 0.381719 [TensorRT] VERBOSE: Tactic: 7208959 Time: 0.224896 [TensorRT] VERBOSE: Tactic: 7340031 Time: 0.218125 [TensorRT] VERBOSE: Tactic: 7405567 Time: 0.245625 [TensorRT] VERBOSE: Tactic: 7536639 Time: 0.246458 [TensorRT] VERBOSE: Tactic: 7602175 Time: 0.330729 [TensorRT] VERBOSE: Tactic: 7733247 Time: 0.227396 [TensorRT] VERBOSE: Tactic: 7798783 Time: 0.270677 [TensorRT] VERBOSE: Tactic: 8191999 Time: 0.391302 [TensorRT] VERBOSE: Tactic: 8257535 Time: 0.272916 [TensorRT] VERBOSE: Tactic: 8323071 Time: 0.278855 [TensorRT] VERBOSE: Tactic: 8650751 Time: 0.306615 [TensorRT] VERBOSE: Tactic: 8716287 Time: 0.255104 [TensorRT] VERBOSE: Tactic: 9109503 Time: 0.319062 [TensorRT] VERBOSE: Tactic: 9568255 Time: 0.277136 [TensorRT] VERBOSE: Tactic: 9895935 Time: 0.270677 [TensorRT] VERBOSE: Tactic: 10223615 Time: 0.203802 [TensorRT] VERBOSE: Tactic: 10354687 Time: 0.301927 [TensorRT] VERBOSE: Tactic: 10551295 Time: 0.253125 [TensorRT] VERBOSE: Tactic: 10747903 Time: 0.221406 [TensorRT] VERBOSE: Tactic: 10944511 Time: 0.278594 [TensorRT] VERBOSE: Fastest Tactic: 5570559 Time: 0.199531 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.254063 [TensorRT] VERBOSE: Tactic: 1 Time: 0.226406 [TensorRT] VERBOSE: Tactic: 2 Time: 0.317239 [TensorRT] VERBOSE: Tactic: 4 Time: 21.9202 [TensorRT] VERBOSE: Tactic: 5 Time: 1.4463 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.226406 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 0.148802 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TensorRT] VERBOSE: Tactic: 1698681053543049347 Time: 0.13823 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 0.116458 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 0.117083 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 0.115885 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TensorRT] VERBOSE: Tactic: 5326823351883942011 Time: 0.110469 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TensorRT] VERBOSE: Tactic: 5500448035057547314 Time: 0.126927 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 0.120052 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 0.150938 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 0.116771 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TensorRT] VERBOSE: Tactic: -6576203419454146580 Time: 0.134687 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 0.156614 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 0.14 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 0.126406 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 0.128125 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 0.1125 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TensorRT] VERBOSE: Tactic: -377491875521947884 Time: 0.112292 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TensorRT] VERBOSE: Tactic: -37215280111360163 Time: 0.115625 [TensorRT] VERBOSE: Fastest Tactic: 5326823351883942011 Time: 0.110469 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5326823351883942011 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,1,2560,128) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TensorRT] VERBOSE: Tactic: 3886731678879822788 Time: 0.122552 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TensorRT] VERBOSE: Tactic: 6629944304117643200 Time: 0.234219 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TensorRT] VERBOSE: Tactic: -9153228964338181824 Time: 0.234375 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TensorRT] VERBOSE: Tactic: -7394439838318485025 Time: 0.12026 [TensorRT] VERBOSE: Fastest Tactic: -7394439838318485025 Time: 0.12026 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(51200,400,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.263594 [TensorRT] VERBOSE: Tactic: 1 Time: 0.22276 [TensorRT] VERBOSE: Tactic: 2 Time: 0.303958 [TensorRT] VERBOSE: Tactic: 4 Time: 21.3352 [TensorRT] VERBOSE: Tactic: 5 Time: 1.41562 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.22276 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(25600,400:2,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(25600,400:2,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 Time: 0.124844 [TensorRT] VERBOSE: Tactic: 655359 Time: 0.123177 [TensorRT] VERBOSE: Tactic: 786431 Time: 0.157343 [TensorRT] VERBOSE: Tactic: 851967 Time: 0.120781 [TensorRT] VERBOSE: Tactic: 1179647 Time: 0.135313 [TensorRT] VERBOSE: Tactic: 1310719 Time: 0.268958 [TensorRT] VERBOSE: Tactic: 1376255 Time: 0.113646 [TensorRT] VERBOSE: Tactic: 1441791 Time: 0.135364 [TensorRT] VERBOSE: Tactic: 1507327 Time: 0.111979 [TensorRT] VERBOSE: Tactic: 1638399 Time: 0.149323 [TensorRT] VERBOSE: Tactic: 1835007 Time: 0.153698 [TensorRT] VERBOSE: Tactic: 1900543 Time: 0.130729 [TensorRT] VERBOSE: Tactic: 2097151 Time: 0.206927 [TensorRT] VERBOSE: Tactic: 2162687 Time: 0.105104 [TensorRT] VERBOSE: Tactic: 2293759 Time: 0.112448 [TensorRT] VERBOSE: Tactic: 2359295 Time: 0.109792 [TensorRT] VERBOSE: Tactic: 2686975 Time: 0.142969 [TensorRT] VERBOSE: Tactic: 3080191 Time: 0.114375 [TensorRT] VERBOSE: Tactic: 3342335 Time: 0.130729 [TensorRT] VERBOSE: Tactic: 3407871 Time: 0.120469 [TensorRT] VERBOSE: Tactic: 3538943 Time: 0.122292 [TensorRT] VERBOSE: Tactic: 3670015 Time: 0.102969 [TensorRT] VERBOSE: Tactic: 3932159 Time: 0.100208 [TensorRT] VERBOSE: Tactic: 3997695 Time: 0.16302 [TensorRT] VERBOSE: Tactic: 4063231 Time: 0.128385 [TensorRT] VERBOSE: Tactic: 4194303 Time: 0.158542 [TensorRT] VERBOSE: Tactic: 4259839 Time: 0.214062 [TensorRT] VERBOSE: Tactic: 4325375 Time: 0.140157 [TensorRT] VERBOSE: Tactic: 4521983 Time: 0.130625 [TensorRT] VERBOSE: Tactic: 4587519 Time: 0.211614 [TensorRT] VERBOSE: Tactic: 4653055 Time: 0.167813 [TensorRT] VERBOSE: Tactic: 4915199 Time: 0.158385 [TensorRT] VERBOSE: Tactic: 4980735 Time: 0.14448 [TensorRT] VERBOSE: Tactic: 5177343 Time: 0.121406 [TensorRT] VERBOSE: Tactic: 5242879 Time: 0.115104 [TensorRT] VERBOSE: Tactic: 5373951 Time: 0.146875 [TensorRT] VERBOSE: Tactic: 5439487 Time: 0.179531 [TensorRT] VERBOSE: Tactic: 5570559 Time: 0.116615 [TensorRT] VERBOSE: Tactic: 5636095 Time: 0.126198 [TensorRT] VERBOSE: Tactic: 5701631 Time: 0.103021 [TensorRT] VERBOSE: Tactic: 5767167 Time: 0.197864 [TensorRT] VERBOSE: Tactic: 5832703 Time: 0.119167 [TensorRT] VERBOSE: Tactic: 5898239 Time: 0.133021 [TensorRT] VERBOSE: Tactic: 6029311 Time: 0.105573 [TensorRT] VERBOSE: Tactic: 6225919 Time: 0.112604 [TensorRT] VERBOSE: Tactic: 6291455 Time: 0.133021 [TensorRT] VERBOSE: Tactic: 6422527 Time: 0.103802 [TensorRT] VERBOSE: Tactic: 6750207 Time: 0.153645 [TensorRT] VERBOSE: Tactic: 6815743 Time: 0.128645 [TensorRT] VERBOSE: Tactic: 6946815 Time: 0.18151 [TensorRT] VERBOSE: Tactic: 7012351 Time: 0.204687 [TensorRT] VERBOSE: Tactic: 7077887 Time: 0.113281 [TensorRT] VERBOSE: Tactic: 7143423 Time: 0.190937 [TensorRT] VERBOSE: Tactic: 7208959 Time: 0.118958 [TensorRT] VERBOSE: Tactic: 7340031 Time: 0.130729 [TensorRT] VERBOSE: Tactic: 7405567 Time: 0.126354 [TensorRT] VERBOSE: Tactic: 7536639 Time: 0.129531 [TensorRT] VERBOSE: Tactic: 7602175 Time: 0.165469 [TensorRT] VERBOSE: Tactic: 7733247 Time: 0.114635 [TensorRT] VERBOSE: Tactic: 7798783 Time: 0.160573 [TensorRT] VERBOSE: Tactic: 8191999 Time: 0.202292 [TensorRT] VERBOSE: Tactic: 8257535 Time: 0.156562 [TensorRT] VERBOSE: Tactic: 8323071 Time: 0.153697 [TensorRT] VERBOSE: Tactic: 8650751 Time: 0.15375 [TensorRT] VERBOSE: Tactic: 8716287 Time: 0.126666 [TensorRT] VERBOSE: Tactic: 9109503 Time: 0.193073 [TensorRT] VERBOSE: Tactic: 9568255 Time: 0.158333 [TensorRT] VERBOSE: Tactic: 9895935 Time: 0.160729 [TensorRT] VERBOSE: Tactic: 10223615 Time: 0.142865 [TensorRT] VERBOSE: Tactic: 10354687 Time: 0.2 [TensorRT] VERBOSE: Tactic: 10551295 Time: 0.12599 [TensorRT] VERBOSE: Tactic: 10747903 Time: 0.11 [TensorRT] VERBOSE: Tactic: 10944511 Time: 0.146667 [TensorRT] VERBOSE: Fastest Tactic: 3932159 Time: 0.100208 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TensorRT] VERBOSE: Tactic: 3066127711859985668 Time: 0.073646 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TensorRT] VERBOSE: Tactic: 3564772625446233998 Time: 0.082969 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TensorRT] VERBOSE: Tactic: 5319956359050645452 Time: 0.077396 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TensorRT] VERBOSE: Tactic: 7205456024582378848 Time: 0.06823 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TensorRT] VERBOSE: Tactic: 8163473458334948789 Time: 0.066302 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TensorRT] VERBOSE: Tactic: -4212163711445252890 Time: 0.061562 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TensorRT] VERBOSE: Tactic: -3898373634979201110 Time: 0.06474 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TensorRT] VERBOSE: Tactic: -2409163523992614473 Time: 0.066094 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TensorRT] VERBOSE: Tactic: -1716393687483585322 Time: 0.05974 [TensorRT] VERBOSE: Fastest Tactic: -1716393687483585322 Time: 0.05974 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1716393687483585322 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.063542 [TensorRT] VERBOSE: Tactic: 0 Time: 0.087031 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.063542 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Float(1600,400:32,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.062812 [TensorRT] VERBOSE: Tactic: 0 Time: 0.120677 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.062812 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.25859 [TensorRT] VERBOSE: Tactic: 0 Time: 0.058906 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.058906 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.08323 [TensorRT] VERBOSE: Tactic: 0 Time: 0.046302 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.046302 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.079479 [TensorRT] VERBOSE: Tactic: 0 Time: 0.085052 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.079479 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Float(1600,400:32,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.061719 [TensorRT] VERBOSE: Tactic: 0 Time: 0.163073 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.061719 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.056042 [TensorRT] VERBOSE: Tactic: 0 Time: 0.08276 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.056042 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.07401 [TensorRT] VERBOSE: Tactic: 0 Time: 0.093333 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.07401 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.29365 [TensorRT] VERBOSE: Tactic: 0 Time: 0.049062 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.049062 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.053333 [TensorRT] VERBOSE: Tactic: 0 Time: 0.083021 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.053333 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Float(1600,400:32,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.052812 [TensorRT] VERBOSE: Tactic: 0 Time: 0.121302 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.052812 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.056458 [TensorRT] VERBOSE: Tactic: 0 Time: 0.045469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.045469 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.069896 [TensorRT] VERBOSE: Tactic: 0 Time: 0.04026 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.04026 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.054115 [TensorRT] VERBOSE: Tactic: 0 Time: 0.095625 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.054115 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Float(1600,400:32,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.05349 [TensorRT] VERBOSE: Tactic: 0 Time: 0.123021 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.05349 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.093438 [TensorRT] VERBOSE: Tactic: 0 Time: 0.04026 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.04026 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1152,9,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1152,1,384,128) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_4/depthwise (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_4/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(1152,9,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(576,9:2,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_4/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(3200,25,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(3200,1,640,128) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_3/depthwise (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_3/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(3200,25,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(1600,25:2,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_3/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(12800,100,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(12800,1,1280,128) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2/depthwise (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(12800,100,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(6400,100:2,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1600,400:32,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1600,400:32,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1600,400:32,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1600,400:32,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,400,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,1,2560,128) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_1/depthwise (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_1/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(51200,400,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(25600,400:2,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_1/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1152,9,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1152,1,384,128) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(1152,9,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(576,9:2,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_4/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(576,9:2,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(3200,25,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(3200,1,640,128) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(3200,25,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(1600,25:2,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_3/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(1600,25:2,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(12800,100,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(12800,1,1280,128) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(12800,100,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(6400,100:2,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_2/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(6400,100:2,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Float(1600,400:32,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.063646 [TensorRT] VERBOSE: Tactic: 0 Time: 0.120885 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.063646 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Float(1600,400:32,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.061667 [TensorRT] VERBOSE: Tactic: 0 Time: 0.166041 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.061667 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1600,400:32,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1600,400:32,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1600,400:32,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1600,400:32,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Float(1600,400:32,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.0525 [TensorRT] VERBOSE: Tactic: 0 Time: 0.124062 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.0525 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Float(1600,400:32,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.052917 [TensorRT] VERBOSE: Tactic: 0 Time: 0.123646 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.052917 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,400,20,1) -> Float(51200,2560,128,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Transpose__2009 + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.092917 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.092917 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,1,2560,128) -> Float(51200,2560,1,2560,20) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Transpose__2009 + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.096822 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.096822 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1600,400:32,20,1) -> Float(2560,128,128:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Transpose__2009 + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.197083 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.197083 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(51200,400,20,1) -> Half(51200,2560,128,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Transpose__2009 + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.08651 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.08651 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(25600,400:2,20,1) -> Half(25600,1280,128:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Transpose__2009 + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.123489 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.123489 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,2560,128,128,1) -> Float(51200,2560,1,2560,20) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.172656 [TensorRT] VERBOSE: Tactic: 0 Time: 0.081198 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.081198 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,2560,128,128,1) -> Float(2560,128,128:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.173282 [TensorRT] VERBOSE: Tactic: 0 Time: 0.187709 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.173282 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,2560,128,128,1) -> Half(51200,2560,128,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.2099 [TensorRT] VERBOSE: Tactic: 0 Time: 0.059063 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.059063 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,2560,128,128,1) -> Half(25600,1280,128:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.093333 [TensorRT] VERBOSE: Tactic: 0 Time: 0.046094 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.046094 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,2560,1,2560,20) -> Float(51200,2560,128,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.174792 [TensorRT] VERBOSE: Tactic: 0 Time: 0.074792 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.074792 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,2560,1,2560,20) -> Float(2560,128,128:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.0925 [TensorRT] VERBOSE: Tactic: 0 Time: 0.195625 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.0925 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,2560,1,2560,20) -> Half(51200,2560,128,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.091927 [TensorRT] VERBOSE: Tactic: 0 Time: 0.075469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.075469 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,2560,1,2560,20) -> Half(25600,1280,128:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.09375 [TensorRT] VERBOSE: Tactic: 0 Time: 0.090781 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.090781 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2560,128,128:32,128,1) -> Float(51200,2560,128,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.175781 [TensorRT] VERBOSE: Tactic: 0 Time: 0.088021 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.088021 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2560,128,128:32,128,1) -> Float(51200,2560,1,2560,20) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.100365 [TensorRT] VERBOSE: Tactic: 0 Time: 0.093802 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.093802 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2560,128,128:32,128,1) -> Half(51200,2560,128,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.093385 [TensorRT] VERBOSE: Tactic: 0 Time: 0.088385 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.088385 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2560,128,128:32,128,1) -> Half(25600,1280,128:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.094896 [TensorRT] VERBOSE: Tactic: 0 Time: 0.102864 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.094896 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,2560,128,128,1) -> Float(51200,2560,128,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.24714 [TensorRT] VERBOSE: Tactic: 0 Time: 0.048229 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.048229 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,2560,128,128,1) -> Float(51200,2560,1,2560,20) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.086719 [TensorRT] VERBOSE: Tactic: 0 Time: 0.082344 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.082344 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,2560,128,128,1) -> Float(2560,128,128:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.078177 [TensorRT] VERBOSE: Tactic: 0 Time: 0.187969 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.078177 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,2560,128,128,1) -> Half(25600,1280,128:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.065729 [TensorRT] VERBOSE: Tactic: 0 Time: 0.045157 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.045157 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1280,128:2,128,1) -> Float(51200,2560,128,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.089166 [TensorRT] VERBOSE: Tactic: 0 Time: 0.040365 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.040365 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1280,128:2,128,1) -> Float(51200,2560,1,2560,20) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.090208 [TensorRT] VERBOSE: Tactic: 0 Time: 0.095677 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.090208 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1280,128:2,128,1) -> Float(2560,128,128:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.079114 [TensorRT] VERBOSE: Tactic: 0 Time: 0.189114 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.079114 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1280,128:2,128,1) -> Half(51200,2560,128,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.225469 [TensorRT] VERBOSE: Tactic: 0 Time: 0.040208 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.040208 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,400,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,1,2560,128) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(51200,400,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(25600,400:2,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_1/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(25600,400:2,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,2560,128,128,1) -> Float(102400,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.91062 [TensorRT] VERBOSE: Tactic: 0 Time: 0.075417 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.075417 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,2560,128,128,1) -> Float(102400,5120,1,2560,20) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.174011 [TensorRT] VERBOSE: Tactic: 0 Time: 0.08099 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.08099 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,2560,128,128,1) -> Float(5120,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.174063 [TensorRT] VERBOSE: Tactic: 0 Time: 0.121094 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.121094 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,2560,128,128,1) -> Half(102400,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.21016 [TensorRT] VERBOSE: Tactic: 0 Time: 0.075417 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.075417 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,2560,128,128,1) -> Half(51200,2560,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.092812 [TensorRT] VERBOSE: Tactic: 0 Time: 0.089844 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.089844 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,2560,1,2560,20) -> Float(102400,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.175833 [TensorRT] VERBOSE: Tactic: 0 Time: 0.075052 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.075052 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,2560,1,2560,20) -> Float(102400,5120,1,2560,20) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.056094 [TensorRT] VERBOSE: Tactic: 0 Time: 0.081041 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.056094 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,2560,1,2560,20) -> Float(5120,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.100209 [TensorRT] VERBOSE: Tactic: 0 Time: 0.12875 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.100209 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,2560,1,2560,20) -> Half(102400,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.092761 [TensorRT] VERBOSE: Tactic: 0 Time: 0.07526 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.07526 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,2560,1,2560,20) -> Half(51200,2560,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.093646 [TensorRT] VERBOSE: Tactic: 0 Time: 0.089843 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.089843 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2560,128,128:32,128,1) -> Float(102400,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.17448 [TensorRT] VERBOSE: Tactic: 0 Time: 0.0875 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.0875 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2560,128,128:32,128,1) -> Float(102400,5120,1,2560,20) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.100365 [TensorRT] VERBOSE: Tactic: 0 Time: 0.09375 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.09375 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2560,128,128:32,128,1) -> Float(5120,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.107448 [TensorRT] VERBOSE: Tactic: 0 Time: 0.143542 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.107448 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2560,128,128:32,128,1) -> Half(102400,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.09401 [TensorRT] VERBOSE: Tactic: 0 Time: 0.088542 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.088542 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2560,128,128:32,128,1) -> Half(51200,2560,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.094063 [TensorRT] VERBOSE: Tactic: 0 Time: 0.103334 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.094063 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,2560,128,128,1) -> Float(102400,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.24484 [TensorRT] VERBOSE: Tactic: 0 Time: 0.076927 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.076927 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,2560,128,128,1) -> Float(102400,5120,1,2560,20) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.085937 [TensorRT] VERBOSE: Tactic: 0 Time: 0.082343 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.082343 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,2560,128,128,1) -> Float(5120,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.08698 [TensorRT] VERBOSE: Tactic: 0 Time: 0.12125 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.08698 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,2560,128,128,1) -> Half(102400,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.24255 [TensorRT] VERBOSE: Tactic: 0 Time: 0.065677 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.065677 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,2560,128,128,1) -> Half(51200,2560,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.065833 [TensorRT] VERBOSE: Tactic: 0 Time: 0.079531 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.065833 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1280,128:2,128,1) -> Float(102400,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.088959 [TensorRT] VERBOSE: Tactic: 0 Time: 0.08849 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.08849 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1280,128:2,128,1) -> Float(102400,5120,1,2560,20) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.088542 [TensorRT] VERBOSE: Tactic: 0 Time: 0.094896 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.088542 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1280,128:2,128,1) -> Float(5120,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.089479 [TensorRT] VERBOSE: Tactic: 0 Time: 0.122084 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.089479 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1280,128:2,128,1) -> Half(102400,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.22552 [TensorRT] VERBOSE: Tactic: 0 Time: 0.079531 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.079531 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1280,128:2,128,1) -> Half(51200,2560,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.09401 [TensorRT] VERBOSE: Tactic: 0 Time: 0.095729 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.09401 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,2560,128,128,1) -> Float(102400,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.90849 [TensorRT] VERBOSE: Tactic: 0 Time: 0.074739 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.074739 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,2560,128,128,1) -> Float(102400,5120,1,2560,20) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.172031 [TensorRT] VERBOSE: Tactic: 0 Time: 0.080729 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.080729 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,2560,128,128,1) -> Float(5120,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.171615 [TensorRT] VERBOSE: Tactic: 0 Time: 0.188073 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.171615 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,2560,128,128,1) -> Half(102400,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.2099 [TensorRT] VERBOSE: Tactic: 0 Time: 0.076302 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.076302 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,2560,128,128,1) -> Half(51200,2560,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.092604 [TensorRT] VERBOSE: Tactic: 0 Time: 0.089427 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.089427 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,2560,1,2560,20) -> Float(102400,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.174896 [TensorRT] VERBOSE: Tactic: 0 Time: 0.075209 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.075209 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,2560,1,2560,20) -> Float(102400,5120,1,2560,20) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.05724 [TensorRT] VERBOSE: Tactic: 0 Time: 0.081823 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.05724 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,2560,1,2560,20) -> Float(5120,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.091302 [TensorRT] VERBOSE: Tactic: 0 Time: 0.195677 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.091302 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,2560,1,2560,20) -> Half(102400,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.091354 [TensorRT] VERBOSE: Tactic: 0 Time: 0.075729 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.075729 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,2560,1,2560,20) -> Half(51200,2560,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.093802 [TensorRT] VERBOSE: Tactic: 0 Time: 0.089792 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.089792 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2560,128,128:32,128,1) -> Float(102400,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.174636 [TensorRT] VERBOSE: Tactic: 0 Time: 0.087656 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.087656 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2560,128,128:32,128,1) -> Float(102400,5120,1,2560,20) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.100781 [TensorRT] VERBOSE: Tactic: 0 Time: 0.094896 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.094896 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2560,128,128:32,128,1) -> Float(5120,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.099063 [TensorRT] VERBOSE: Tactic: 0 Time: 0.210677 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.099063 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2560,128,128:32,128,1) -> Half(102400,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.09427 [TensorRT] VERBOSE: Tactic: 0 Time: 0.089427 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.089427 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2560,128,128:32,128,1) -> Half(51200,2560,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.095052 [TensorRT] VERBOSE: Tactic: 0 Time: 0.103021 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.095052 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,2560,128,128,1) -> Float(102400,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.24474 [TensorRT] VERBOSE: Tactic: 0 Time: 0.076042 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.076042 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,2560,128,128,1) -> Float(102400,5120,1,2560,20) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.086614 [TensorRT] VERBOSE: Tactic: 0 Time: 0.083073 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.083073 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,2560,128,128,1) -> Float(5120,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.077343 [TensorRT] VERBOSE: Tactic: 0 Time: 0.188646 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.077343 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,2560,128,128,1) -> Half(102400,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.24245 [TensorRT] VERBOSE: Tactic: 0 Time: 0.06573 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.06573 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,2560,128,128,1) -> Half(51200,2560,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.065885 [TensorRT] VERBOSE: Tactic: 0 Time: 0.081823 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.065885 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1280,128:2,128,1) -> Float(102400,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.08948 [TensorRT] VERBOSE: Tactic: 0 Time: 0.089427 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.089427 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1280,128:2,128,1) -> Float(102400,5120,1,2560,20) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.088437 [TensorRT] VERBOSE: Tactic: 0 Time: 0.095573 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.088437 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1280,128:2,128,1) -> Float(5120,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.080208 [TensorRT] VERBOSE: Tactic: 0 Time: 0.189219 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.080208 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1280,128:2,128,1) -> Half(102400,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.225521 [TensorRT] VERBOSE: Tactic: 0 Time: 0.079739 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.079739 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1280,128:2,128,1) -> Half(51200,2560,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/w_stack_Unsqueeze__1596:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.095885 [TensorRT] VERBOSE: Tactic: 0 Time: 0.095729 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.095729 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,5120,256,128,1) -> Float(102400,5120,1,2560,20) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.341562 [TensorRT] VERBOSE: Tactic: 0 Time: 0.156562 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.156562 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,5120,256,128,1) -> Float(5120,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.338334 [TensorRT] VERBOSE: Tactic: 0 Time: 0.369063 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.338334 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,5120,256,128,1) -> Half(102400,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.41271 [TensorRT] VERBOSE: Tactic: 0 Time: 0.110833 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.110833 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,5120,256,128,1) -> Half(51200,2560,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.177344 [TensorRT] VERBOSE: Tactic: 0 Time: 0.088698 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.088698 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,5120,1,2560,20) -> Float(102400,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.343021 [TensorRT] VERBOSE: Tactic: 0 Time: 0.146615 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.146615 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,5120,1,2560,20) -> Float(5120,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.177968 [TensorRT] VERBOSE: Tactic: 0 Time: 0.420417 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.177968 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,5120,1,2560,20) -> Half(102400,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.176719 [TensorRT] VERBOSE: Tactic: 0 Time: 0.1475 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.1475 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,5120,1,2560,20) -> Half(51200,2560,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.179791 [TensorRT] VERBOSE: Tactic: 0 Time: 0.17401 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.17401 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(5120,256,256:32,128,1) -> Float(102400,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.342292 [TensorRT] VERBOSE: Tactic: 0 Time: 0.174843 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.174843 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(5120,256,256:32,128,1) -> Float(102400,5120,1,2560,20) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.194323 [TensorRT] VERBOSE: Tactic: 0 Time: 0.182084 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.182084 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(5120,256,256:32,128,1) -> Half(102400,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.180573 [TensorRT] VERBOSE: Tactic: 0 Time: 0.171928 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.171928 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(5120,256,256:32,128,1) -> Half(51200,2560,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.180886 [TensorRT] VERBOSE: Tactic: 0 Time: 0.199844 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.180886 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,5120,256,128,1) -> Float(102400,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.48219 [TensorRT] VERBOSE: Tactic: 0 Time: 0.093229 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.093229 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,5120,256,128,1) -> Float(102400,5120,1,2560,20) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.166875 [TensorRT] VERBOSE: Tactic: 0 Time: 0.158698 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.158698 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,5120,256,128,1) -> Float(5120,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.148698 [TensorRT] VERBOSE: Tactic: 0 Time: 0.371979 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.148698 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,5120,256,128,1) -> Half(51200,2560,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.13099 [TensorRT] VERBOSE: Tactic: 0 Time: 0.088437 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.088437 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,2560,256:2,128,1) -> Float(102400,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.171719 [TensorRT] VERBOSE: Tactic: 0 Time: 0.076458 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.076458 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,2560,256:2,128,1) -> Float(102400,5120,1,2560,20) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.170729 [TensorRT] VERBOSE: Tactic: 0 Time: 0.18375 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.170729 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,2560,256:2,128,1) -> Float(5120,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.152552 [TensorRT] VERBOSE: Tactic: 0 Time: 0.370886 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.152552 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,2560,256:2,128,1) -> Half(102400,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.45599 [TensorRT] VERBOSE: Tactic: 0 Time: 0.076614 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.076614 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(102400,5120,256,128,1) -> Float(102400,5120,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.054115 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.054115 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(102400,5120,1,2560,20) -> Float(102400,5120,5120,1,2560,20) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.225781 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.225781 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(5120,256,256:32,128,1) -> Float(5120,256,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.45875 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.45875 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(102400,5120,256,128,1) -> Half(102400,5120,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.030729 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.030729 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(51200,2560,256:2,128,1) -> Half(51200,2560,2560,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.282292 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.282292 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,5120,5120,256,128,1) -> Float(102400,5120,5120,1,2560,20) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.34125 [TensorRT] VERBOSE: Tactic: 0 Time: 0.155937 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.155937 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,5120,5120,256,128,1) -> Float(5120,256,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.340104 [TensorRT] VERBOSE: Tactic: 0 Time: 0.369531 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.340104 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,5120,5120,256,128,1) -> Half(102400,5120,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.41042 [TensorRT] VERBOSE: Tactic: 0 Time: 0.11198 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.11198 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,5120,5120,256,128,1) -> Half(51200,2560,2560,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.176719 [TensorRT] VERBOSE: Tactic: 0 Time: 0.088333 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.088333 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,5120,5120,1,2560,20) -> Float(102400,5120,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.34073 [TensorRT] VERBOSE: Tactic: 0 Time: 0.145469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.145469 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,5120,5120,1,2560,20) -> Float(5120,256,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.177239 [TensorRT] VERBOSE: Tactic: 0 Time: 0.420885 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.177239 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,5120,5120,1,2560,20) -> Half(102400,5120,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.176511 [TensorRT] VERBOSE: Tactic: 0 Time: 0.147344 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.147344 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,5120,5120,1,2560,20) -> Half(51200,2560,2560,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.179688 [TensorRT] VERBOSE: Tactic: 0 Time: 0.17375 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.17375 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(5120,256,256,256:32,128,1) -> Float(102400,5120,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.343958 [TensorRT] VERBOSE: Tactic: 0 Time: 0.1725 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.1725 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(5120,256,256,256:32,128,1) -> Float(102400,5120,5120,1,2560,20) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.195833 [TensorRT] VERBOSE: Tactic: 0 Time: 0.18276 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.18276 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(5120,256,256,256:32,128,1) -> Half(102400,5120,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.180573 [TensorRT] VERBOSE: Tactic: 0 Time: 0.173385 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.173385 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(5120,256,256,256:32,128,1) -> Half(51200,2560,2560,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.180209 [TensorRT] VERBOSE: Tactic: 0 Time: 0.200833 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.180209 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,5120,5120,256,128,1) -> Float(102400,5120,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.48208 [TensorRT] VERBOSE: Tactic: 0 Time: 0.093333 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.093333 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,5120,5120,256,128,1) -> Float(102400,5120,5120,1,2560,20) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.166875 [TensorRT] VERBOSE: Tactic: 0 Time: 0.15849 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.15849 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,5120,5120,256,128,1) -> Float(5120,256,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.148854 [TensorRT] VERBOSE: Tactic: 0 Time: 0.372344 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.148854 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,5120,5120,256,128,1) -> Half(51200,2560,2560,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.130625 [TensorRT] VERBOSE: Tactic: 0 Time: 0.088177 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.088177 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,2560,2560,256:2,128,1) -> Float(102400,5120,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.171302 [TensorRT] VERBOSE: Tactic: 0 Time: 0.076666 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.076666 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,2560,2560,256:2,128,1) -> Float(102400,5120,5120,1,2560,20) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.170156 [TensorRT] VERBOSE: Tactic: 0 Time: 0.183541 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.170156 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,2560,2560,256:2,128,1) -> Float(5120,256,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.152292 [TensorRT] VERBOSE: Tactic: 0 Time: 0.371355 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.152292 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,2560,2560,256:2,128,1) -> Half(102400,5120,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.457135 [TensorRT] VERBOSE: Tactic: 0 Time: 0.07474 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.07474 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1152,9,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1152,1,384,128) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4/depthwise (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(1152,9,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(576,9:2,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(3200,25,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(3200,1,640,128) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3/depthwise (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(3200,25,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(1600,25:2,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(12800,100,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(12800,1,1280,128) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_2/depthwise (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_2/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(12800,100,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(6400,100:2,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_2/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(12800,100,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(12800,1,1280,128) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_2/depthwise (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_2/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(12800,100,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(6400,100:2,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_2/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,5120,5120,256,128,1) -> Float(204800,10240,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 6.88438 [TensorRT] VERBOSE: Tactic: 0 Time: 0.172135 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.172135 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,5120,5120,256,128,1) -> Float(204800,10240,5120,1,2560,20) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 20.7603 [TensorRT] VERBOSE: Tactic: 0 Time: 0.188594 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.188594 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,5120,5120,256,128,1) -> Float(10240,512,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 20.7594 [TensorRT] VERBOSE: Tactic: 0 Time: 0.236615 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.236615 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,5120,5120,256,128,1) -> Half(204800,10240,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.360105 [TensorRT] VERBOSE: Tactic: 0 Time: 0.173281 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.173281 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,5120,5120,256,128,1) -> Half(102400,5120,2560,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 5.38312 [TensorRT] VERBOSE: Tactic: 0 Time: 0.206406 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.206406 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,5120,5120,1,2560,20) -> Float(204800,10240,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 20.7774 [TensorRT] VERBOSE: Tactic: 0 Time: 0.173177 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.173177 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,5120,5120,1,2560,20) -> Float(204800,10240,5120,1,2560,20) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 11.8149 [TensorRT] VERBOSE: Tactic: 0 Time: 0.187448 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.187448 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,5120,5120,1,2560,20) -> Float(10240,512,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 11.8148 [TensorRT] VERBOSE: Tactic: 0 Time: 0.2925 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.2925 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,5120,5120,1,2560,20) -> Half(204800,10240,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 5.29745 [TensorRT] VERBOSE: Tactic: 0 Time: 0.173802 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.173802 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,5120,5120,1,2560,20) -> Half(102400,5120,2560,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 5.23469 [TensorRT] VERBOSE: Tactic: 0 Time: 0.206667 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.206667 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(5120,256,256,256:32,128,1) -> Float(204800,10240,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 20.78 [TensorRT] VERBOSE: Tactic: 0 Time: 0.20724 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.20724 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(5120,256,256,256:32,128,1) -> Float(204800,10240,5120,1,2560,20) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 11.8103 [TensorRT] VERBOSE: Tactic: 0 Time: 0.220834 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.220834 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(5120,256,256,256:32,128,1) -> Float(10240,512,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 11.8139 [TensorRT] VERBOSE: Tactic: 0 Time: 0.328177 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.328177 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(5120,256,256,256:32,128,1) -> Half(204800,10240,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 5.32984 [TensorRT] VERBOSE: Tactic: 0 Time: 0.208541 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.208541 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(5120,256,256,256:32,128,1) -> Half(102400,5120,2560,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 5.26016 [TensorRT] VERBOSE: Tactic: 0 Time: 0.242813 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.242813 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,5120,5120,256,128,1) -> Float(204800,10240,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.90599 [TensorRT] VERBOSE: Tactic: 0 Time: 0.172969 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.172969 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,5120,5120,256,128,1) -> Float(204800,10240,5120,1,2560,20) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 5.41995 [TensorRT] VERBOSE: Tactic: 0 Time: 0.190208 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.190208 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,5120,5120,256,128,1) -> Float(10240,512,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 5.38823 [TensorRT] VERBOSE: Tactic: 0 Time: 0.238437 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.238437 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,5120,5120,256,128,1) -> Half(204800,10240,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.94125 [TensorRT] VERBOSE: Tactic: 0 Time: 0.15849 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.15849 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,5120,5120,256,128,1) -> Half(102400,5120,2560,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 13.3945 [TensorRT] VERBOSE: Tactic: 0 Time: 0.192761 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.192761 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,2560,2560,256:2,128,1) -> Float(204800,10240,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 5.33255 [TensorRT] VERBOSE: Tactic: 0 Time: 0.206667 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.206667 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,2560,2560,256:2,128,1) -> Float(204800,10240,5120,1,2560,20) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 5.37136 [TensorRT] VERBOSE: Tactic: 0 Time: 0.222604 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.222604 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,2560,2560,256:2,128,1) -> Float(10240,512,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 5.34615 [TensorRT] VERBOSE: Tactic: 0 Time: 0.245104 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.245104 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,2560,2560,256:2,128,1) -> Half(204800,10240,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 6.95849 [TensorRT] VERBOSE: Tactic: 0 Time: 0.1925 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.1925 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,2560,2560,256:2,128,1) -> Half(102400,5120,2560,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 5.34568 [TensorRT] VERBOSE: Tactic: 0 Time: 0.230156 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.230156 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,5120,5120,256,128,1) -> Float(204800,10240,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 6.88188 [TensorRT] VERBOSE: Tactic: 0 Time: 0.172396 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.172396 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,5120,5120,256,128,1) -> Float(204800,10240,5120,1,2560,20) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 20.7649 [TensorRT] VERBOSE: Tactic: 0 Time: 0.187656 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.187656 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,5120,5120,256,128,1) -> Float(10240,512,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 20.7607 [TensorRT] VERBOSE: Tactic: 0 Time: 0.372032 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.372032 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,5120,5120,256,128,1) -> Half(204800,10240,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.360885 [TensorRT] VERBOSE: Tactic: 0 Time: 0.173437 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.173437 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,5120,5120,256,128,1) -> Half(102400,5120,2560,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 5.38141 [TensorRT] VERBOSE: Tactic: 0 Time: 0.207031 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.207031 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,5120,5120,1,2560,20) -> Float(204800,10240,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 20.7881 [TensorRT] VERBOSE: Tactic: 0 Time: 0.172865 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.172865 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,5120,5120,1,2560,20) -> Float(204800,10240,5120,1,2560,20) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 11.8148 [TensorRT] VERBOSE: Tactic: 0 Time: 0.187813 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.187813 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,5120,5120,1,2560,20) -> Float(10240,512,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 11.8054 [TensorRT] VERBOSE: Tactic: 0 Time: 0.426875 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.426875 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,5120,5120,1,2560,20) -> Half(204800,10240,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 5.29958 [TensorRT] VERBOSE: Tactic: 0 Time: 0.173593 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.173593 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(102400,5120,5120,1,2560,20) -> Half(102400,5120,2560,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 5.23469 [TensorRT] VERBOSE: Tactic: 0 Time: 0.207031 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.207031 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(5120,256,256,256:32,128,1) -> Float(204800,10240,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 20.8033 [TensorRT] VERBOSE: Tactic: 0 Time: 0.207448 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.207448 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(5120,256,256,256:32,128,1) -> Float(204800,10240,5120,1,2560,20) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 11.8124 [TensorRT] VERBOSE: Tactic: 0 Time: 0.221407 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.221407 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(5120,256,256,256:32,128,1) -> Float(10240,512,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 11.8154 [TensorRT] VERBOSE: Tactic: 0 Time: 0.460469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.460469 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(5120,256,256,256:32,128,1) -> Half(204800,10240,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 5.32729 [TensorRT] VERBOSE: Tactic: 0 Time: 0.207709 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.207709 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(5120,256,256,256:32,128,1) -> Half(102400,5120,2560,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 5.25115 [TensorRT] VERBOSE: Tactic: 0 Time: 0.242916 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.242916 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,5120,5120,256,128,1) -> Float(204800,10240,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.90615 [TensorRT] VERBOSE: Tactic: 0 Time: 0.1725 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.1725 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,5120,5120,256,128,1) -> Float(204800,10240,5120,1,2560,20) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 5.42109 [TensorRT] VERBOSE: Tactic: 0 Time: 0.189843 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.189843 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,5120,5120,256,128,1) -> Float(10240,512,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 5.39443 [TensorRT] VERBOSE: Tactic: 0 Time: 0.373959 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.373959 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,5120,5120,256,128,1) -> Half(204800,10240,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.94313 [TensorRT] VERBOSE: Tactic: 0 Time: 0.157813 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.157813 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,5120,5120,256,128,1) -> Half(102400,5120,2560,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 13.3992 [TensorRT] VERBOSE: Tactic: 0 Time: 0.192812 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.192812 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,2560,2560,256:2,128,1) -> Float(204800,10240,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 5.33703 [TensorRT] VERBOSE: Tactic: 0 Time: 0.206563 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.206563 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,2560,2560,256:2,128,1) -> Float(204800,10240,5120,1,2560,20) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 5.37401 [TensorRT] VERBOSE: Tactic: 0 Time: 0.223021 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.223021 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,2560,2560,256:2,128,1) -> Float(10240,512,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 5.34354 [TensorRT] VERBOSE: Tactic: 0 Time: 0.37875 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.37875 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,2560,2560,256:2,128,1) -> Half(204800,10240,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 6.95833 [TensorRT] VERBOSE: Tactic: 0 Time: 0.19224 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.19224 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,2560,2560,256:2,128,1) -> Half(102400,5120,2560,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/h_stack_Unsqueeze__1599:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 5.33219 [TensorRT] VERBOSE: Tactic: 0 Time: 0.230052 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.230052 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,400,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,1,2560,128) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_1/depthwise (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_1/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(51200,400,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(25600,400:2,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_1/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1152,9,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1152,1,384,128) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(1152,9,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(576,9:2,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_4/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(576,9:2,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(3200,25,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(3200,1,640,128) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(3200,25,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(1600,25:2,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_3 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_3/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(1600,25:2,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(12800,100,10,1) -> Float(2400,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 Time: 0.030937 [TensorRT] VERBOSE: Tactic: 655359 Time: 0.054063 [TensorRT] VERBOSE: Tactic: 786431 Time: 0.021615 [TensorRT] VERBOSE: Tactic: 851967 Time: 0.047135 [TensorRT] VERBOSE: Tactic: 1179647 Time: 0.035677 [TensorRT] VERBOSE: Tactic: 1310719 Time: 0.063333 [TensorRT] VERBOSE: Tactic: 1376255 Time: 0.038281 [TensorRT] VERBOSE: Tactic: 1441791 Time: 0.028646 [TensorRT] VERBOSE: Tactic: 1507327 Time: 0.049584 [TensorRT] VERBOSE: Tactic: 1638399 Time: 0.021614 [TensorRT] VERBOSE: Tactic: 1835007 Time: 0.021667 [TensorRT] VERBOSE: Tactic: 1900543 Time: 0.047083 [TensorRT] VERBOSE: Tactic: 2097151 Time: 0.028802 [TensorRT] VERBOSE: Tactic: 2162687 Time: 0.040208 [TensorRT] VERBOSE: Tactic: 2293759 Time: 0.042657 [TensorRT] VERBOSE: Tactic: 2359295 Time: 0.030885 [TensorRT] VERBOSE: Tactic: 2686975 Time: 0.035937 [TensorRT] VERBOSE: Tactic: 3080191 Time: 0.049479 [TensorRT] VERBOSE: Tactic: 3342335 Time: 0.049428 [TensorRT] VERBOSE: Tactic: 3407871 Time: 0.035625 [TensorRT] VERBOSE: Tactic: 3538943 Time: 0.033541 [TensorRT] VERBOSE: Tactic: 3670015 Time: 0.038177 [TensorRT] VERBOSE: Tactic: 3932159 Time: 0.040208 [TensorRT] VERBOSE: Tactic: 3997695 Time: 0.019375 [TensorRT] VERBOSE: Tactic: 4063231 Time: 0.059063 [TensorRT] VERBOSE: Tactic: 4194303 Time: 0.026354 [TensorRT] VERBOSE: Tactic: 4259839 Time: 0.030938 [TensorRT] VERBOSE: Tactic: 4325375 Time: 0.021615 [TensorRT] VERBOSE: Tactic: 4521983 Time: 0.035782 [TensorRT] VERBOSE: Tactic: 4587519 Time: 0.033125 [TensorRT] VERBOSE: Tactic: 4653055 Time: 0.049427 [TensorRT] VERBOSE: Tactic: 4915199 Time: 0.030938 [TensorRT] VERBOSE: Tactic: 4980735 Time: 0.030833 [TensorRT] VERBOSE: Tactic: 5177343 Time: 0.033281 [TensorRT] VERBOSE: Tactic: 5242879 Time: 0.030989 [TensorRT] VERBOSE: Tactic: 5373951 Time: 0.035521 [TensorRT] VERBOSE: Tactic: 5439487 Time: 0.024115 [TensorRT] VERBOSE: Tactic: 5570559 Time: 0.049479 [TensorRT] VERBOSE: Tactic: 5636095 Time: 0.06099 [TensorRT] VERBOSE: Tactic: 5701631 Time: 0.040261 [TensorRT] VERBOSE: Tactic: 5767167 Time: 0.028802 [TensorRT] VERBOSE: Tactic: 5832703 Time: 0.035573 [TensorRT] VERBOSE: Tactic: 5898239 Time: 0.033177 [TensorRT] VERBOSE: Tactic: 6029311 Time: 0.038073 [TensorRT] VERBOSE: Tactic: 6225919 Time: 0.030885 [TensorRT] VERBOSE: Tactic: 6291455 Time: 0.035781 [TensorRT] VERBOSE: Tactic: 6422527 Time: 0.04724 [TensorRT] VERBOSE: Tactic: 6750207 Time: 0.028646 [TensorRT] VERBOSE: Tactic: 6815743 Time: 0.031093 [TensorRT] VERBOSE: Tactic: 6946815 Time: 0.026563 [TensorRT] VERBOSE: Tactic: 7012351 Time: 0.028697 [TensorRT] VERBOSE: Tactic: 7077887 Time: 0.033386 [TensorRT] VERBOSE: Tactic: 7143423 Time: 0.030937 [TensorRT] VERBOSE: Tactic: 7208959 Time: 0.035573 [TensorRT] VERBOSE: Tactic: 7340031 Time: 0.033282 [TensorRT] VERBOSE: Tactic: 7405567 Time: 0.037916 [TensorRT] VERBOSE: Tactic: 7536639 Time: 0.035572 [TensorRT] VERBOSE: Tactic: 7602175 Time: 0.026666 [TensorRT] VERBOSE: Tactic: 7733247 Time: 0.035573 [TensorRT] VERBOSE: Tactic: 7798783 Time: 0.021562 [TensorRT] VERBOSE: Tactic: 8191999 Time: 0.03323 [TensorRT] VERBOSE: Tactic: 8257535 Time: 0.031042 [TensorRT] VERBOSE: Tactic: 8323071 Time: 0.023958 [TensorRT] VERBOSE: Tactic: 8650751 Time: 0.02625 [TensorRT] VERBOSE: Tactic: 8716287 Time: 0.030938 [TensorRT] VERBOSE: Tactic: 9109503 Time: 0.02901 [TensorRT] VERBOSE: Tactic: 9568255 Time: 0.030937 [TensorRT] VERBOSE: Tactic: 9895935 Time: 0.02625 [TensorRT] VERBOSE: Tactic: 10223615 Time: 0.035625 [TensorRT] VERBOSE: Tactic: 10354687 Time: 0.028646 [TensorRT] VERBOSE: Tactic: 10551295 Time: 0.026407 [TensorRT] VERBOSE: Tactic: 10747903 Time: 0.035521 [TensorRT] VERBOSE: Tactic: 10944511 Time: 0.028646 [TensorRT] VERBOSE: Fastest Tactic: 3997695 Time: 0.019375 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.034791 [TensorRT] VERBOSE: Tactic: 1 Time: 0.033073 [TensorRT] VERBOSE: Tactic: 2 Time: 0.10974 [TensorRT] VERBOSE: Tactic: 4 Time: 0.834115 [TensorRT] VERBOSE: Tactic: 5 Time: 0.313281 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.033073 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 0.033489 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TensorRT] VERBOSE: Tactic: 1698681053543049347 Time: 0.024167 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 0.03573 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 0.026563 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 0.035781 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TensorRT] VERBOSE: Tactic: 5326823351883942011 Time: 0.036146 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TensorRT] VERBOSE: Tactic: 5500448035057547314 Time: 0.03151 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 0.028698 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 0.024063 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 0.038072 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TensorRT] VERBOSE: Tactic: -6576203419454146580 Time: 0.028802 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 0.026302 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 0.030885 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 0.033229 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 0.030885 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 0.035521 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TensorRT] VERBOSE: Tactic: -377491875521947884 Time: 0.035781 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TensorRT] VERBOSE: Tactic: -37215280111360163 Time: 0.026875 [TensorRT] VERBOSE: Fastest Tactic: 7144526460361122478 Time: 0.024063 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 3997695 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(12800,1,1280,128) -> Float(2400,1,240,24) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TensorRT] VERBOSE: Tactic: 3886731678879822788 Time: 0.021823 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TensorRT] VERBOSE: Tactic: 6629944304117643200 Time: 0.017187 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TensorRT] VERBOSE: Tactic: -9153228964338181824 Time: 0.017031 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TensorRT] VERBOSE: Tactic: -7394439838318485025 Time: 0.021719 [TensorRT] VERBOSE: Fastest Tactic: -9153228964338181824 Time: 0.017031 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9153228964338181824 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(12800,100,10,1) -> Half(2400,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.036198 [TensorRT] VERBOSE: Tactic: 1 Time: 0.035469 [TensorRT] VERBOSE: Tactic: 2 Time: 0.111614 [TensorRT] VERBOSE: Tactic: 4 Time: 0.854115 [TensorRT] VERBOSE: Tactic: 5 Time: 0.300729 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.035469 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(6400,100:2,10,1) -> Half(2400,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(6400,100:2,10,1) -> Half(1200,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 Time: 0.021614 [TensorRT] VERBOSE: Tactic: 655359 Time: 0.035886 [TensorRT] VERBOSE: Tactic: 786431 Time: 0.016979 [TensorRT] VERBOSE: Tactic: 851967 Time: 0.033125 [TensorRT] VERBOSE: Tactic: 1179647 Time: 0.023958 [TensorRT] VERBOSE: Tactic: 1310719 Time: 0.047292 [TensorRT] VERBOSE: Tactic: 1376255 Time: 0.023958 [TensorRT] VERBOSE: Tactic: 1441791 Time: 0.021615 [TensorRT] VERBOSE: Tactic: 1507327 Time: 0.033281 [TensorRT] VERBOSE: Tactic: 1638399 Time: 0.014688 [TensorRT] VERBOSE: Tactic: 1835007 Time: 0.017031 [TensorRT] VERBOSE: Tactic: 1900543 Time: 0.030937 [TensorRT] VERBOSE: Tactic: 2097151 Time: 0.023958 [TensorRT] VERBOSE: Tactic: 2162687 Time: 0.026302 [TensorRT] VERBOSE: Tactic: 2293759 Time: 0.026302 [TensorRT] VERBOSE: Tactic: 2359295 Time: 0.021667 [TensorRT] VERBOSE: Tactic: 2686975 Time: 0.033281 [TensorRT] VERBOSE: Tactic: 3080191 Time: 0.035625 [TensorRT] VERBOSE: Tactic: 3342335 Time: 0.033281 [TensorRT] VERBOSE: Tactic: 3407871 Time: 0.02401 [TensorRT] VERBOSE: Tactic: 3538943 Time: 0.023958 [TensorRT] VERBOSE: Tactic: 3670015 Time: 0.042552 [TensorRT] VERBOSE: Tactic: 3932159 Time: 0.021823 [TensorRT] VERBOSE: Tactic: 3997695 Time: 0.013073 [TensorRT] VERBOSE: Tactic: 4063231 Time: 0.044896 [TensorRT] VERBOSE: Tactic: 4194303 Time: 0.019427 [TensorRT] VERBOSE: Tactic: 4259839 Time: 0.023958 [TensorRT] VERBOSE: Tactic: 4325375 Time: 0.014688 [TensorRT] VERBOSE: Tactic: 4521983 Time: 0.023959 [TensorRT] VERBOSE: Tactic: 4587519 Time: 0.021666 [TensorRT] VERBOSE: Tactic: 4653055 Time: 0.033489 [TensorRT] VERBOSE: Tactic: 4915199 Time: 0.021563 [TensorRT] VERBOSE: Tactic: 4980735 Time: 0.019531 [TensorRT] VERBOSE: Tactic: 5177343 Time: 0.021719 [TensorRT] VERBOSE: Tactic: 5242879 Time: 0.019531 [TensorRT] VERBOSE: Tactic: 5373951 Time: 0.024115 [TensorRT] VERBOSE: Tactic: 5439487 Time: 0.017031 [TensorRT] VERBOSE: Tactic: 5570559 Time: 0.037917 [TensorRT] VERBOSE: Tactic: 5636095 Time: 0.04474 [TensorRT] VERBOSE: Tactic: 5701631 Time: 0.021979 [TensorRT] VERBOSE: Tactic: 5767167 Time: 0.017031 [TensorRT] VERBOSE: Tactic: 5832703 Time: 0.021719 [TensorRT] VERBOSE: Tactic: 5898239 Time: 0.028594 [TensorRT] VERBOSE: Tactic: 6029311 Time: 0.024011 [TensorRT] VERBOSE: Tactic: 6225919 Time: 0.019375 [TensorRT] VERBOSE: Tactic: 6291455 Time: 0.024167 [TensorRT] VERBOSE: Tactic: 6422527 Time: 0.031198 [TensorRT] VERBOSE: Tactic: 6750207 Time: 0.017031 [TensorRT] VERBOSE: Tactic: 6815743 Time: 0.019479 [TensorRT] VERBOSE: Tactic: 6946815 Time: 0.016979 [TensorRT] VERBOSE: Tactic: 7012351 Time: 0.023958 [TensorRT] VERBOSE: Tactic: 7077887 Time: 0.021667 [TensorRT] VERBOSE: Tactic: 7143423 Time: 0.019271 [TensorRT] VERBOSE: Tactic: 7208959 Time: 0.021614 [TensorRT] VERBOSE: Tactic: 7340031 Time: 0.028698 [TensorRT] VERBOSE: Tactic: 7405567 Time: 0.026354 [TensorRT] VERBOSE: Tactic: 7536639 Time: 0.021667 [TensorRT] VERBOSE: Tactic: 7602175 Time: 0.017032 [TensorRT] VERBOSE: Tactic: 7733247 Time: 0.023958 [TensorRT] VERBOSE: Tactic: 7798783 Time: 0.017135 [TensorRT] VERBOSE: Tactic: 8191999 Time: 0.019271 [TensorRT] VERBOSE: Tactic: 8257535 Time: 0.019427 [TensorRT] VERBOSE: Tactic: 8323071 Time: 0.016979 [TensorRT] VERBOSE: Tactic: 8650751 Time: 0.017084 [TensorRT] VERBOSE: Tactic: 8716287 Time: 0.019427 [TensorRT] VERBOSE: Tactic: 9109503 Time: 0.022032 [TensorRT] VERBOSE: Tactic: 9568255 Time: 0.019687 [TensorRT] VERBOSE: Tactic: 9895935 Time: 0.019375 [TensorRT] VERBOSE: Tactic: 10223615 Time: 0.033333 [TensorRT] VERBOSE: Tactic: 10354687 Time: 0.021719 [TensorRT] VERBOSE: Tactic: 10551295 Time: 0.017031 [TensorRT] VERBOSE: Tactic: 10747903 Time: 0.02401 [TensorRT] VERBOSE: Tactic: 10944511 Time: 0.019323 [TensorRT] VERBOSE: Fastest Tactic: 3997695 Time: 0.013073 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TensorRT] VERBOSE: Tactic: 3066127711859985668 Time: 0.019531 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TensorRT] VERBOSE: Tactic: 3564772625446233998 Time: 0.022031 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TensorRT] VERBOSE: Tactic: 5319956359050645452 Time: 0.019375 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TensorRT] VERBOSE: Tactic: 7205456024582378848 Time: 0.019584 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TensorRT] VERBOSE: Tactic: 8163473458334948789 Time: 0.017188 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TensorRT] VERBOSE: Tactic: -4212163711445252890 Time: 0.021667 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TensorRT] VERBOSE: Tactic: -3898373634979201110 Time: 0.021718 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TensorRT] VERBOSE: Tactic: -2409163523992614473 Time: 0.017344 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TensorRT] VERBOSE: Tactic: -1716393687483585322 Time: 0.021823 [TensorRT] VERBOSE: Fastest Tactic: 8163473458334948789 Time: 0.017188 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 3997695 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,100,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(12800,1,1280,128) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(12800,100,10,1) -> Half(6400,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Float(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Float(12800,1,1280,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(6400,100:2,10,1) -> Half(12800,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(12800,100,10,1) -> Float(2400,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(12800,1,1280,128) -> Float(2400,1,240,24) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(12800,100,10,1) -> Half(2400,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(6400,100:2,10,1) -> Half(2400,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(6400,100:2,10,1) -> Half(1200,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,400,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,1,2560,128) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(51200,400,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(25600,400:2,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_1/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(25600,400:2,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,10240,5120,256,128,1) -> Float(204800,10240,5120,1,2560,20) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.674114 [TensorRT] VERBOSE: Tactic: 0 Time: 0.305364 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.305364 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,10240,5120,256,128,1) -> Float(10240,512,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.675729 [TensorRT] VERBOSE: Tactic: 0 Time: 0.729271 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.675729 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,10240,5120,256,128,1) -> Half(204800,10240,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 4.81063 [TensorRT] VERBOSE: Tactic: 0 Time: 0.214531 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.214531 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,10240,5120,256,128,1) -> Half(102400,5120,2560,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.346198 [TensorRT] VERBOSE: Tactic: 0 Time: 0.171042 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.171042 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,10240,5120,1,2560,20) -> Float(204800,10240,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.680886 [TensorRT] VERBOSE: Tactic: 0 Time: 0.284427 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.284427 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,10240,5120,1,2560,20) -> Float(10240,512,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.351615 [TensorRT] VERBOSE: Tactic: 0 Time: 0.83151 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.351615 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,10240,5120,1,2560,20) -> Half(204800,10240,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.345833 [TensorRT] VERBOSE: Tactic: 0 Time: 0.285678 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.285678 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,10240,5120,1,2560,20) -> Half(102400,5120,2560,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.351927 [TensorRT] VERBOSE: Tactic: 0 Time: 0.341615 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.341615 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(10240,512,256,256:32,128,1) -> Float(204800,10240,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.678958 [TensorRT] VERBOSE: Tactic: 0 Time: 0.341094 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.341094 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(10240,512,256,256:32,128,1) -> Float(204800,10240,5120,1,2560,20) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.383021 [TensorRT] VERBOSE: Tactic: 0 Time: 0.355677 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.355677 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(10240,512,256,256:32,128,1) -> Half(204800,10240,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.35125 [TensorRT] VERBOSE: Tactic: 0 Time: 0.335833 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.335833 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(10240,512,256,256:32,128,1) -> Half(102400,5120,2560,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.350834 [TensorRT] VERBOSE: Tactic: 0 Time: 0.391718 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.350834 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,10240,5120,256,128,1) -> Float(204800,10240,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 4.95193 [TensorRT] VERBOSE: Tactic: 0 Time: 0.18302 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.18302 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,10240,5120,256,128,1) -> Float(204800,10240,5120,1,2560,20) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.326354 [TensorRT] VERBOSE: Tactic: 0 Time: 0.309688 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.309688 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,10240,5120,256,128,1) -> Float(10240,512,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.289062 [TensorRT] VERBOSE: Tactic: 0 Time: 0.733958 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.289062 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,10240,5120,256,128,1) -> Half(102400,5120,2560,256:2,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.249531 [TensorRT] VERBOSE: Tactic: 0 Time: 0.169427 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.169427 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,5120,2560,256:2,128,1) -> Float(204800,10240,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.33349 [TensorRT] VERBOSE: Tactic: 0 Time: 0.148802 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.148802 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,5120,2560,256:2,128,1) -> Float(204800,10240,5120,1,2560,20) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.33375 [TensorRT] VERBOSE: Tactic: 0 Time: 0.361302 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.33375 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,5120,2560,256:2,128,1) -> Float(10240,512,256,256:32,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.296302 [TensorRT] VERBOSE: Tactic: 0 Time: 0.732969 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.296302 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,5120,2560,256:2,128,1) -> Half(204800,10240,5120,256,128,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.904583 [TensorRT] VERBOSE: Tactic: 0 Time: 0.144948 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.144948 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(204800,10240,5120,256,128,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape + Transpose__2021 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.461198 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.461198 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(204800,10240,5120,1,2560,20) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape + Transpose__2021 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.893437 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.893437 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(10240,512,256,256:32,128,1) -> Float(6400,1600:32,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape + Transpose__2021 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.606406 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.606406 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(204800,10240,5120,256,128,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape + Transpose__2021 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.42823 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.42823 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(102400,5120,2560,256:2,128,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/nearest_neighbor_upsampling/nearest_neighbor_upsampling_1/Reshape + Transpose__2021 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.585938 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.585938 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2400,100,10,1) -> Float(2400,1,240,24) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.014635 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007812 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007812 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2400,100,10,1) -> Float(100,100:32,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.014687 [TensorRT] VERBOSE: Tactic: 0 Time: 0.012448 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012448 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2400,100,10,1) -> Half(2400,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.079635 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005625 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005625 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2400,100,10,1) -> Half(1200,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.010052 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2400,1,240,24) -> Float(2400,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.014947 [TensorRT] VERBOSE: Tactic: 0 Time: 0.00776 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00776 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2400,1,240,24) -> Float(100,100:32,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.014688 [TensorRT] VERBOSE: Tactic: 0 Time: 0.012396 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012396 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2400,1,240,24) -> Half(2400,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.010104 [TensorRT] VERBOSE: Tactic: 0 Time: 0.00776 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00776 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2400,1,240,24) -> Half(1200,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.010104 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007864 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007864 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(100,100:32,10,1) -> Float(2400,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.014844 [TensorRT] VERBOSE: Tactic: 0 Time: 0.00776 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00776 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(100,100:32,10,1) -> Float(2400,1,240,24) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.014739 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007865 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007865 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(100,100:32,10,1) -> Half(2400,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.010104 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007812 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007812 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(100,100:32,10,1) -> Half(1200,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.010052 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007813 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007813 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(2400,100,10,1) -> Float(2400,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.081823 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(2400,100,10,1) -> Float(2400,1,240,24) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.010364 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007813 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007813 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(2400,100,10,1) -> Float(100,100:32,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.010052 [TensorRT] VERBOSE: Tactic: 0 Time: 0.012344 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.010052 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(2400,100,10,1) -> Half(1200,100:2,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.012396 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1200,100:2,10,1) -> Float(2400,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.010156 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005468 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005468 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1200,100:2,10,1) -> Float(2400,1,240,24) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.01 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007813 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007813 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1200,100:2,10,1) -> Float(100,100:32,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.010104 [TensorRT] VERBOSE: Tactic: 0 Time: 0.012344 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.010104 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1200,100:2,10,1) -> Half(2400,100,10,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.014739 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(2400,100,10,1) -> Float(2400,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2__1575 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.00776 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00776 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(2400,1,240,24) -> Float(1,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2__1575 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.007761 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007761 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(100,100:32,10,1) -> Float(2400:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2__1575 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.194792 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.194792 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(2400,100,10,1) -> Half(2400,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2__1575 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.00776 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00776 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(1200,100:2,10,1) -> Half(2400:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_2__1575 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.01026 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.01026 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1600,40,1) -> Float(51200,1,1280,32) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1600,40,1) -> Half(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1600,40,1) -> Half(25600,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,1280,32) -> Float(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,1280,32) -> Half(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,1280,32) -> Half(25600,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,1600,40,1) -> Float(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,1600,40,1) -> Float(51200,1,1280,32) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,1600,40,1) -> Half(25600,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1600:2,40,1) -> Float(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1600:2,40,1) -> Float(51200,1,1280,32) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,1600:2,40,1) -> Half(51200,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.213229 [TensorRT] VERBOSE: Tactic: 0 Time: 0.352917 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.213229 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.325729 [TensorRT] VERBOSE: Tactic: 0 Time: 0.214114 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.214114 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.309479 [TensorRT] VERBOSE: Tactic: 0 Time: 0.172032 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.172032 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.256875 [TensorRT] VERBOSE: Tactic: 0 Time: 0.315469 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.256875 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.196302 [TensorRT] VERBOSE: Tactic: 0 Time: 0.316614 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.196302 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.264323 [TensorRT] VERBOSE: Tactic: 0 Time: 0.369219 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.264323 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(6400,1600:32,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.260834 [TensorRT] VERBOSE: Tactic: 0 Time: 0.359063 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.260834 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(6400,1600:32,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.197708 [TensorRT] VERBOSE: Tactic: 0 Time: 0.356458 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.197708 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(6400,1600:32,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.211979 [TensorRT] VERBOSE: Tactic: 0 Time: 0.360885 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.211979 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(6400,1600:32,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.263073 [TensorRT] VERBOSE: Tactic: 0 Time: 0.412448 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.263073 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.328854 [TensorRT] VERBOSE: Tactic: 0 Time: 0.181771 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.181771 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.186198 [TensorRT] VERBOSE: Tactic: 0 Time: 0.318281 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.186198 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.184323 [TensorRT] VERBOSE: Tactic: 0 Time: 0.169792 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.169792 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.250313 [TensorRT] VERBOSE: Tactic: 0 Time: 0.147657 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.147657 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.188333 [TensorRT] VERBOSE: Tactic: 0 Time: 0.362239 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.188333 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.360364 [TensorRT] VERBOSE: Tactic: 0 Time: 0.144531 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.144531 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,1600,40,1), Float(204800,1600,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.510261 [TensorRT] VERBOSE: Tactic: 1 Time: 0.455521 [TensorRT] VERBOSE: Tactic: 2 Time: 0.584375 [TensorRT] VERBOSE: Tactic: 4 Time: 30.5893 [TensorRT] VERBOSE: Tactic: 5 Time: 1.25026 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.455521 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 0.238073 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TensorRT] VERBOSE: Tactic: 1698681053543049347 Time: 0.207344 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 0.193958 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 0.181927 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 0.194323 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TensorRT] VERBOSE: Tactic: 5326823351883942011 Time: 0.180104 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TensorRT] VERBOSE: Tactic: 5500448035057547314 Time: 0.184166 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 0.176302 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 0.218646 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 0.188281 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TensorRT] VERBOSE: Tactic: -6576203419454146580 Time: 0.2125 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 0.220677 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 0.212344 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 0.187292 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 0.185885 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 0.187969 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TensorRT] VERBOSE: Tactic: -377491875521947884 Time: 0.184739 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TensorRT] VERBOSE: Tactic: -37215280111360163 Time: 0.170572 [TensorRT] VERBOSE: Fastest Tactic: -37215280111360163 Time: 0.170572 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,1,1280,32), Float(204800,1,5120,128) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TensorRT] VERBOSE: Tactic: 3886731678879822788 Time: 0.243021 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TensorRT] VERBOSE: Tactic: 6629944304117643200 Time: 0.692448 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TensorRT] VERBOSE: Tactic: -9153228964338181824 Time: 0.697396 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TensorRT] VERBOSE: Tactic: -7394439838318485025 Time: 0.248646 [TensorRT] VERBOSE: Fastest Tactic: 3886731678879822788 Time: 0.243021 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(51200,1600,40,1), Half(204800,1600,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.422916 [TensorRT] VERBOSE: Tactic: 1 Time: 0.426354 [TensorRT] VERBOSE: Tactic: 2 Time: 0.454114 [TensorRT] VERBOSE: Tactic: 4 Time: 30.6447 [TensorRT] VERBOSE: Tactic: 5 Time: 1.14979 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.422916 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(25600,1600:2,40,1), Half(102400,1600:2,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TensorRT] VERBOSE: Tactic: 3066127711859985668 Time: 0.135729 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TensorRT] VERBOSE: Tactic: 3564772625446233998 Time: 0.140417 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TensorRT] VERBOSE: Tactic: 5319956359050645452 Time: 0.136094 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TensorRT] VERBOSE: Tactic: 7205456024582378848 Time: 0.109427 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TensorRT] VERBOSE: Tactic: 8163473458334948789 Time: 0.107031 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TensorRT] VERBOSE: Tactic: -4212163711445252890 Time: 0.110104 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TensorRT] VERBOSE: Tactic: -3898373634979201110 Time: 0.106302 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TensorRT] VERBOSE: Tactic: -2409163523992614473 Time: 0.104584 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/add_1 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TensorRT] VERBOSE: Tactic: -1716393687483585322 Time: 0.104322 [TensorRT] VERBOSE: Fastest Tactic: -1716393687483585322 Time: 0.104322 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1716393687483585322 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1152,9,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1152,1,384,128) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_4/depthwise (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_4/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(1152,9,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(576,9:2,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_4/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(3200,25,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(3200,1,640,128) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_3/depthwise (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_3/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(3200,25,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(1600,25:2,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_3/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(3200,25,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(3200,1,640,128) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_3/depthwise (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_3/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(3200,25,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(1600,25:2,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_3/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,400,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,1,2560,128) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_1/depthwise (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_1/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(51200,400,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(25600,400:2,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_1/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2400,100,10,1) -> Float(2400,1,240,24) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2400,100,10,1) -> Float(100,100:32,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2400,100,10,1) -> Half(2400,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2400,100,10,1) -> Half(1200,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2400,1,240,24) -> Float(2400,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2400,1,240,24) -> Float(100,100:32,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2400,1,240,24) -> Half(2400,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2400,1,240,24) -> Half(1200,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(100,100:32,10,1) -> Float(2400,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(100,100:32,10,1) -> Float(2400,1,240,24) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(100,100:32,10,1) -> Half(2400,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(100,100:32,10,1) -> Half(1200,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(2400,100,10,1) -> Float(2400,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(2400,100,10,1) -> Float(2400,1,240,24) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(2400,100,10,1) -> Float(100,100:32,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(2400,100,10,1) -> Half(1200,100:2,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1200,100:2,10,1) -> Float(2400,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1200,100:2,10,1) -> Float(2400,1,240,24) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1200,100:2,10,1) -> Float(100,100:32,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1200,100:2,10,1) -> Half(2400,100,10,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(2400,100,10,1) -> Float(2400,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2__1556 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_5 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.007864 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007864 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(2400,1,240,24) -> Float(1,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2__1556 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_5 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.007812 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007812 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(100,100:32,10,1) -> Float(2400:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2__1556 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_5 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.194323 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.194323 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(2400,100,10,1) -> Half(2400,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2__1556 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_5 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.007812 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007812 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(1200,100:2,10,1) -> Half(2400:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_2__1556 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_5 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.010364 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.010364 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(204800,1600,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise (CudaDepthwiseConvolution) [TensorRT] VERBOSE: Tactic: -1 Time: 0.23526 [TensorRT] VERBOSE: Fastest Tactic: -1 Time: 0.23526 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.28302 [TensorRT] VERBOSE: Tactic: 1 Time: 0.284011 [TensorRT] VERBOSE: Tactic: 2 Time: 0.467969 [TensorRT] VERBOSE: Tactic: 4 Time: 74.4079 [TensorRT] VERBOSE: Tactic: 5 Time: 147.935 [TensorRT] VERBOSE: Tactic: 6 Time: 9.6088 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.28302 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 5.84062 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [TensorRT] VERBOSE: Tactic: 1754984623894446479 Time: 4.48516 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [TensorRT] VERBOSE: Tactic: 3611739942397549984 Time: 14.811 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724 [TensorRT] VERBOSE: Tactic: 3827454225649558724 Time: 14.428 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [TensorRT] VERBOSE: Tactic: 4337000649858996379 Time: 7.58641 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 14.0814 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 7.52385 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 14.6051 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896 [TensorRT] VERBOSE: Tactic: 5921334924264294896 Time: 10.1135 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 7.50828 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 4.25943 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038 [TensorRT] VERBOSE: Tactic: 7852627285308570038 Time: 15.4524 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [TensorRT] VERBOSE: Tactic: -9137461792520977713 Time: 14.6282 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509 [TensorRT] VERBOSE: Tactic: -8776506421218919509 Time: 14.0496 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 14.9652 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [TensorRT] VERBOSE: Tactic: -8133971918129952780 Time: 7.33214 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [TensorRT] VERBOSE: Tactic: -6092040395344634144 Time: 5.88198 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 4.45245 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 5.52443 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239 [TensorRT] VERBOSE: Tactic: -2318106587342035239 Time: 14.7627 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657 [TensorRT] VERBOSE: Tactic: -1343271414618805657 Time: 9.95115 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 7.12458 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 6.95302 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 13.8525 [TensorRT] VERBOSE: Fastest Tactic: 7144526460361122478 Time: 4.25943 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(204800,1,5120,128) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(204800,1600,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.11125 [TensorRT] VERBOSE: Tactic: 1 Time: 0.112448 [TensorRT] VERBOSE: Tactic: 2 Time: 11.6829 [TensorRT] VERBOSE: Tactic: 4 Time: 74.6026 [TensorRT] VERBOSE: Tactic: 5 Time: 148.24 [TensorRT] VERBOSE: Tactic: 6 Time: 59.9461 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.11125 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(102400,1600:2,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1152,9,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1152,1,384,128) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(1152,9,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(576,9:2,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_4 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_4/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(576,9:2,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.014896 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005573 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005573 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.102292 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.010261 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.014791 [TensorRT] VERBOSE: Tactic: 0 Time: 0.00552 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00552 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.010261 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.008021 [TensorRT] VERBOSE: Tactic: 0 Time: 0.00552 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00552 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.105156 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.010208 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.019531 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.010105 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005468 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005468 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.010104 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.012448 [TensorRT] VERBOSE: Tactic: 0 Time: 0.003489 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.003489 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(3200,25,5,1) -> Float(600,25,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 Time: 0.028645 [TensorRT] VERBOSE: Tactic: 655359 Time: 0.023907 [TensorRT] VERBOSE: Tactic: 786431 Time: 0.019323 [TensorRT] VERBOSE: Tactic: 851967 Time: 0.01698 [TensorRT] VERBOSE: Tactic: 1179647 Time: 0.0125 [TensorRT] VERBOSE: Tactic: 1310719 Time: 0.056563 [TensorRT] VERBOSE: Tactic: 1376255 Time: 0.035573 [TensorRT] VERBOSE: Tactic: 1441791 Time: 0.014688 [TensorRT] VERBOSE: Tactic: 1507327 Time: 0.026302 [TensorRT] VERBOSE: Tactic: 1638399 Time: 0.0125 [TensorRT] VERBOSE: Tactic: 1835007 Time: 0.017031 [TensorRT] VERBOSE: Tactic: 1900543 Time: 0.040156 [TensorRT] VERBOSE: Tactic: 2097151 Time: 0.012395 [TensorRT] VERBOSE: Tactic: 2162687 Time: 0.037865 [TensorRT] VERBOSE: Tactic: 2293759 Time: 0.033333 [TensorRT] VERBOSE: Tactic: 2359295 Time: 0.02625 [TensorRT] VERBOSE: Tactic: 2686975 Time: 0.033177 [TensorRT] VERBOSE: Tactic: 3080191 Time: 0.016979 [TensorRT] VERBOSE: Tactic: 3342335 Time: 0.023907 [TensorRT] VERBOSE: Tactic: 3407871 Time: 0.023958 [TensorRT] VERBOSE: Tactic: 3538943 Time: 0.014896 [TensorRT] VERBOSE: Tactic: 3670015 Time: 0.040157 [TensorRT] VERBOSE: Tactic: 3932159 Time: 0.030989 [TensorRT] VERBOSE: Tactic: 3997695 Time: 0.012604 [TensorRT] VERBOSE: Tactic: 4063231 Time: 0.017083 [TensorRT] VERBOSE: Tactic: 4194303 Time: 0.021614 [TensorRT] VERBOSE: Tactic: 4259839 Time: 0.0125 [TensorRT] VERBOSE: Tactic: 4325375 Time: 0.017031 [TensorRT] VERBOSE: Tactic: 4521983 Time: 0.03349 [TensorRT] VERBOSE: Tactic: 4587519 Time: 0.012604 [TensorRT] VERBOSE: Tactic: 4653055 Time: 0.014739 [TensorRT] VERBOSE: Tactic: 4915199 Time: 0.014635 [TensorRT] VERBOSE: Tactic: 4980735 Time: 0.024271 [TensorRT] VERBOSE: Tactic: 5177343 Time: 0.016979 [TensorRT] VERBOSE: Tactic: 5242879 Time: 0.021562 [TensorRT] VERBOSE: Tactic: 5373951 Time: 0.012657 [TensorRT] VERBOSE: Tactic: 5439487 Time: 0.017083 [TensorRT] VERBOSE: Tactic: 5570559 Time: 0.02177 [TensorRT] VERBOSE: Tactic: 5636095 Time: 0.017135 [TensorRT] VERBOSE: Tactic: 5701631 Time: 0.033229 [TensorRT] VERBOSE: Tactic: 5767167 Time: 0.019323 [TensorRT] VERBOSE: Tactic: 5832703 Time: 0.021666 [TensorRT] VERBOSE: Tactic: 5898239 Time: 0.014687 [TensorRT] VERBOSE: Tactic: 6029311 Time: 0.033333 [TensorRT] VERBOSE: Tactic: 6225919 Time: 0.014635 [TensorRT] VERBOSE: Tactic: 6291455 Time: 0.012552 [TensorRT] VERBOSE: Tactic: 6422527 Time: 0.019323 [TensorRT] VERBOSE: Tactic: 6750207 Time: 0.0125 [TensorRT] VERBOSE: Tactic: 6815743 Time: 0.021719 [TensorRT] VERBOSE: Tactic: 6946815 Time: 0.021667 [TensorRT] VERBOSE: Tactic: 7012351 Time: 0.012448 [TensorRT] VERBOSE: Tactic: 7077887 Time: 0.014687 [TensorRT] VERBOSE: Tactic: 7143423 Time: 0.019375 [TensorRT] VERBOSE: Tactic: 7208959 Time: 0.024011 [TensorRT] VERBOSE: Tactic: 7340031 Time: 0.014739 [TensorRT] VERBOSE: Tactic: 7405567 Time: 0.014792 [TensorRT] VERBOSE: Tactic: 7536639 Time: 0.019323 [TensorRT] VERBOSE: Tactic: 7602175 Time: 0.019635 [TensorRT] VERBOSE: Tactic: 7733247 Time: 0.01698 [TensorRT] VERBOSE: Tactic: 7798783 Time: 0.019375 [TensorRT] VERBOSE: Tactic: 8191999 Time: 0.017031 [TensorRT] VERBOSE: Tactic: 8257535 Time: 0.012448 [TensorRT] VERBOSE: Tactic: 8323071 Time: 0.017031 [TensorRT] VERBOSE: Tactic: 8650751 Time: 0.021615 [TensorRT] VERBOSE: Tactic: 8716287 Time: 0.01474 [TensorRT] VERBOSE: Tactic: 9109503 Time: 0.012396 [TensorRT] VERBOSE: Tactic: 9568255 Time: 0.014635 [TensorRT] VERBOSE: Tactic: 9895935 Time: 0.021667 [TensorRT] VERBOSE: Tactic: 10223615 Time: 0.033177 [TensorRT] VERBOSE: Tactic: 10354687 Time: 0.012395 [TensorRT] VERBOSE: Tactic: 10551295 Time: 0.021666 [TensorRT] VERBOSE: Tactic: 10747903 Time: 0.017031 [TensorRT] VERBOSE: Tactic: 10944511 Time: 0.026354 [TensorRT] VERBOSE: Fastest Tactic: 2097151 Time: 0.012395 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.034427 [TensorRT] VERBOSE: Tactic: 1 Time: 0.030729 [TensorRT] VERBOSE: Tactic: 2 Time: 0.09823 [TensorRT] VERBOSE: Tactic: 4 Time: 0.828802 [TensorRT] VERBOSE: Tactic: 5 Time: 0.287344 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.030729 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 0.031145 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TensorRT] VERBOSE: Tactic: 1698681053543049347 Time: 0.022396 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 0.035677 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 0.02651 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 0.035521 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TensorRT] VERBOSE: Tactic: 5326823351883942011 Time: 0.035729 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TensorRT] VERBOSE: Tactic: 5500448035057547314 Time: 0.031146 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 0.02875 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 0.024167 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 0.037917 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TensorRT] VERBOSE: Tactic: -6576203419454146580 Time: 0.028802 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 0.02651 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 0.028698 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 0.031146 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 0.031042 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 0.035781 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TensorRT] VERBOSE: Tactic: -377491875521947884 Time: 0.035781 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TensorRT] VERBOSE: Tactic: -37215280111360163 Time: 0.026823 [TensorRT] VERBOSE: Fastest Tactic: 1698681053543049347 Time: 0.022396 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 2097151 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(3200,1,640,128) -> Float(600,1,120,24) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TensorRT] VERBOSE: Tactic: 3886731678879822788 Time: 0.021927 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TensorRT] VERBOSE: Tactic: 6629944304117643200 Time: 0.01724 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TensorRT] VERBOSE: Tactic: -9153228964338181824 Time: 0.017031 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TensorRT] VERBOSE: Tactic: -7394439838318485025 Time: 0.021823 [TensorRT] VERBOSE: Fastest Tactic: -9153228964338181824 Time: 0.017031 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9153228964338181824 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(3200,25,5,1) -> Half(600,25,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.034167 [TensorRT] VERBOSE: Tactic: 1 Time: 0.033281 [TensorRT] VERBOSE: Tactic: 2 Time: 0.097031 [TensorRT] VERBOSE: Tactic: 4 Time: 0.841927 [TensorRT] VERBOSE: Tactic: 5 Time: 0.285364 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.033281 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(1600,25:2,5,1) -> Half(600,25,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(1600,25:2,5,1) -> Half(300,25:2,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 Time: 0.019896 [TensorRT] VERBOSE: Tactic: 655359 Time: 0.02625 [TensorRT] VERBOSE: Tactic: 786431 Time: 0.017136 [TensorRT] VERBOSE: Tactic: 851967 Time: 0.014583 [TensorRT] VERBOSE: Tactic: 1179647 Time: 0.010105 [TensorRT] VERBOSE: Tactic: 1310719 Time: 0.044688 [TensorRT] VERBOSE: Tactic: 1376255 Time: 0.021823 [TensorRT] VERBOSE: Tactic: 1441791 Time: 0.012552 [TensorRT] VERBOSE: Tactic: 1507327 Time: 0.019271 [TensorRT] VERBOSE: Tactic: 1638399 Time: 0.010104 [TensorRT] VERBOSE: Tactic: 1835007 Time: 0.014739 [TensorRT] VERBOSE: Tactic: 1900543 Time: 0.02875 [TensorRT] VERBOSE: Tactic: 2097151 Time: 0.010104 [TensorRT] VERBOSE: Tactic: 2162687 Time: 0.026302 [TensorRT] VERBOSE: Tactic: 2293759 Time: 0.02151 [TensorRT] VERBOSE: Tactic: 2359295 Time: 0.019375 [TensorRT] VERBOSE: Tactic: 2686975 Time: 0.033125 [TensorRT] VERBOSE: Tactic: 3080191 Time: 0.016927 [TensorRT] VERBOSE: Tactic: 3342335 Time: 0.017084 [TensorRT] VERBOSE: Tactic: 3407871 Time: 0.014844 [TensorRT] VERBOSE: Tactic: 3538943 Time: 0.012344 [TensorRT] VERBOSE: Tactic: 3670015 Time: 0.042656 [TensorRT] VERBOSE: Tactic: 3932159 Time: 0.014791 [TensorRT] VERBOSE: Tactic: 3997695 Time: 0.010104 [TensorRT] VERBOSE: Tactic: 4063231 Time: 0.014636 [TensorRT] VERBOSE: Tactic: 4194303 Time: 0.016979 [TensorRT] VERBOSE: Tactic: 4259839 Time: 0.010156 [TensorRT] VERBOSE: Tactic: 4325375 Time: 0.012396 [TensorRT] VERBOSE: Tactic: 4521983 Time: 0.024167 [TensorRT] VERBOSE: Tactic: 4587519 Time: 0.010156 [TensorRT] VERBOSE: Tactic: 4653055 Time: 0.012396 [TensorRT] VERBOSE: Tactic: 4915199 Time: 0.010417 [TensorRT] VERBOSE: Tactic: 4980735 Time: 0.017239 [TensorRT] VERBOSE: Tactic: 5177343 Time: 0.012396 [TensorRT] VERBOSE: Tactic: 5242879 Time: 0.014739 [TensorRT] VERBOSE: Tactic: 5373951 Time: 0.010104 [TensorRT] VERBOSE: Tactic: 5439487 Time: 0.012344 [TensorRT] VERBOSE: Tactic: 5570559 Time: 0.017344 [TensorRT] VERBOSE: Tactic: 5636095 Time: 0.014688 [TensorRT] VERBOSE: Tactic: 5701631 Time: 0.019323 [TensorRT] VERBOSE: Tactic: 5767167 Time: 0.012396 [TensorRT] VERBOSE: Tactic: 5832703 Time: 0.014739 [TensorRT] VERBOSE: Tactic: 5898239 Time: 0.012395 [TensorRT] VERBOSE: Tactic: 6029311 Time: 0.019375 [TensorRT] VERBOSE: Tactic: 6225919 Time: 0.010053 [TensorRT] VERBOSE: Tactic: 6291455 Time: 0.010052 [TensorRT] VERBOSE: Tactic: 6422527 Time: 0.014687 [TensorRT] VERBOSE: Tactic: 6750207 Time: 0.010156 [TensorRT] VERBOSE: Tactic: 6815743 Time: 0.012448 [TensorRT] VERBOSE: Tactic: 6946815 Time: 0.012396 [TensorRT] VERBOSE: Tactic: 7012351 Time: 0.010104 [TensorRT] VERBOSE: Tactic: 7077887 Time: 0.010052 [TensorRT] VERBOSE: Tactic: 7143423 Time: 0.012552 [TensorRT] VERBOSE: Tactic: 7208959 Time: 0.014688 [TensorRT] VERBOSE: Tactic: 7340031 Time: 0.012396 [TensorRT] VERBOSE: Tactic: 7405567 Time: 0.010104 [TensorRT] VERBOSE: Tactic: 7536639 Time: 0.017239 [TensorRT] VERBOSE: Tactic: 7602175 Time: 0.012552 [TensorRT] VERBOSE: Tactic: 7733247 Time: 0.012344 [TensorRT] VERBOSE: Tactic: 7798783 Time: 0.017031 [TensorRT] VERBOSE: Tactic: 8191999 Time: 0.010104 [TensorRT] VERBOSE: Tactic: 8257535 Time: 0.010104 [TensorRT] VERBOSE: Tactic: 8323071 Time: 0.012448 [TensorRT] VERBOSE: Tactic: 8650751 Time: 0.012448 [TensorRT] VERBOSE: Tactic: 8716287 Time: 0.010052 [TensorRT] VERBOSE: Tactic: 9109503 Time: 0.010156 [TensorRT] VERBOSE: Tactic: 9568255 Time: 0.012396 [TensorRT] VERBOSE: Tactic: 9895935 Time: 0.017031 [TensorRT] VERBOSE: Tactic: 10223615 Time: 0.03323 [TensorRT] VERBOSE: Tactic: 10354687 Time: 0.010156 [TensorRT] VERBOSE: Tactic: 10551295 Time: 0.01474 [TensorRT] VERBOSE: Tactic: 10747903 Time: 0.012396 [TensorRT] VERBOSE: Tactic: 10944511 Time: 0.017291 [TensorRT] VERBOSE: Fastest Tactic: 6291455 Time: 0.010052 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TensorRT] VERBOSE: Tactic: 3066127711859985668 Time: 0.019531 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TensorRT] VERBOSE: Tactic: 3564772625446233998 Time: 0.021875 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TensorRT] VERBOSE: Tactic: 5319956359050645452 Time: 0.019323 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TensorRT] VERBOSE: Tactic: 7205456024582378848 Time: 0.019479 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TensorRT] VERBOSE: Tactic: 8163473458334948789 Time: 0.017188 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TensorRT] VERBOSE: Tactic: -4212163711445252890 Time: 0.021875 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TensorRT] VERBOSE: Tactic: -3898373634979201110 Time: 0.021875 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TensorRT] VERBOSE: Tactic: -2409163523992614473 Time: 0.017135 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TensorRT] VERBOSE: Tactic: -1716393687483585322 Time: 0.021927 [TensorRT] VERBOSE: Fastest Tactic: -2409163523992614473 Time: 0.017135 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 6291455 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,25,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(3200,1,640,128) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(3200,25,5,1) -> Half(1600,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Float(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Float(3200,1,640,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1600,25:2,5,1) -> Half(3200,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(3200,25,5,1) -> Float(600,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(3200,1,640,128) -> Float(600,1,120,24) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(3200,25,5,1) -> Half(600,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(1600,25:2,5,1) -> Half(600,25,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(1600,25:2,5,1) -> Half(300,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,400,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,1,2560,128) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(51200,400,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(25600,400:2,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_1/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(25600,400:2,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(204800,1600,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 1.16724 [TensorRT] VERBOSE: Tactic: 1 Time: 0.724115 [TensorRT] VERBOSE: Tactic: 2 Time: 0.911042 [TensorRT] ERROR: Tactic Device request: 533MB Available: 488MB. Device memory is insufficient to use tactic. [TensorRT] WARNING: Skipping tactic 3 due to oom error on requested size of 533 detected for tactic 4. Try decreasing the workspace size with IBuilderConfig::setMaxWorkspaceSize(). [TensorRT] VERBOSE: Tactic: 5 Time: 2.62026 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.724115 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 0.466407 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TensorRT] VERBOSE: Tactic: 1698681053543049347 Time: 0.422031 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 0.356822 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 0.34823 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 0.358282 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TensorRT] VERBOSE: Tactic: 5326823351883942011 Time: 0.347292 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TensorRT] VERBOSE: Tactic: 5500448035057547314 Time: 0.377396 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 0.360833 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 0.467708 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 0.365885 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TensorRT] VERBOSE: Tactic: -6576203419454146580 Time: 0.420312 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 0.487969 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 0.43375 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 0.395625 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 0.394271 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 0.355156 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TensorRT] VERBOSE: Tactic: -377491875521947884 Time: 0.359114 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TensorRT] VERBOSE: Tactic: -37215280111360163 Time: 0.342552 [TensorRT] VERBOSE: Fastest Tactic: -37215280111360163 Time: 0.342552 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(204800,1,5120,128) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TensorRT] VERBOSE: Tactic: 3886731678879822788 Time: 0.369115 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TensorRT] VERBOSE: Tactic: 6629944304117643200 Time: 0.812135 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TensorRT] VERBOSE: Tactic: -9153228964338181824 Time: 0.825521 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TensorRT] VERBOSE: Tactic: -7394439838318485025 Time: 0.385625 [TensorRT] VERBOSE: Fastest Tactic: 3886731678879822788 Time: 0.369115 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(204800,1600,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.835156 [TensorRT] VERBOSE: Tactic: 1 Time: 0.725156 [TensorRT] VERBOSE: Tactic: 2 Time: 0.827708 [TensorRT] ERROR: Tactic Device request: 532MB Available: 488MB. Device memory is insufficient to use tactic. [TensorRT] WARNING: Skipping tactic 3 due to oom error on requested size of 532 detected for tactic 4. Try decreasing the workspace size with IBuilderConfig::setMaxWorkspaceSize(). [TensorRT] VERBOSE: Tactic: 5 Time: 2.54818 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.725156 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(102400,1600:2,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(102400,1600:2,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 (FusedConvActConvolution) [TensorRT] VERBOSE: FusedConvActConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TensorRT] VERBOSE: Tactic: 3066127711859985668 Time: 0.241406 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TensorRT] VERBOSE: Tactic: 3564772625446233998 Time: 0.259792 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TensorRT] VERBOSE: Tactic: 5319956359050645452 Time: 0.247604 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TensorRT] VERBOSE: Tactic: 7205456024582378848 Time: 0.197604 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TensorRT] VERBOSE: Tactic: 8163473458334948789 Time: 0.192709 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TensorRT] VERBOSE: Tactic: -4212163711445252890 Time: 0.190104 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TensorRT] VERBOSE: Tactic: -3898373634979201110 Time: 0.194948 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TensorRT] VERBOSE: Tactic: -2409163523992614473 Time: 0.194427 [TensorRT] VERBOSE: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d + StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1/Relu6 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TensorRT] VERBOSE: Tactic: -1716393687483585322 Time: 0.18823 [TensorRT] VERBOSE: Fastest Tactic: -1716393687483585322 Time: 0.18823 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1716393687483585322 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(600,25,5,1) -> Float(600,1,120,24) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.0125 [TensorRT] VERBOSE: Tactic: 0 Time: 0.00552 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00552 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(600,25,5,1) -> Float(25,25:32,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.012604 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(600,25,5,1) -> Half(600,25,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.02401 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005468 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005468 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(600,25,5,1) -> Half(300,25:2,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.007865 [TensorRT] VERBOSE: Tactic: 0 Time: 0.003177 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.003177 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(600,1,120,24) -> Float(600,25,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.014791 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005573 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005573 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(600,1,120,24) -> Float(25,25:32,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.014636 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(600,1,120,24) -> Half(600,25,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.008021 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005572 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005572 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(600,1,120,24) -> Half(300,25:2,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.007917 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25,25:32,5,1) -> Float(600,25,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.01276 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005468 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005468 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25,25:32,5,1) -> Float(600,1,120,24) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.01474 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25,25:32,5,1) -> Half(600,25,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.007917 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25,25:32,5,1) -> Half(300,25:2,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.007917 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(600,25,5,1) -> Float(600,25,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.024011 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(600,25,5,1) -> Float(600,1,120,24) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.008021 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(600,25,5,1) -> Float(25,25:32,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.007864 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005573 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005573 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(600,25,5,1) -> Half(300,25:2,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.010104 [TensorRT] VERBOSE: Tactic: 0 Time: 0.003229 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.003229 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(300,25:2,5,1) -> Float(600,25,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.010104 [TensorRT] VERBOSE: Tactic: 0 Time: 0.003229 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.003229 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(300,25:2,5,1) -> Float(600,1,120,24) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.010052 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(300,25:2,5,1) -> Float(25,25:32,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.010052 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(300,25:2,5,1) -> Half(600,25,5,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.010104 [TensorRT] VERBOSE: Tactic: 0 Time: 0.003177 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.003177 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(600,25,5,1) -> Float(600,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3__1459 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(600,1,120,24) -> Float(1,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3__1459 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(25,25:32,5,1) -> Float(600:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3__1459 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.047136 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.047136 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(600,25,5,1) -> Half(600,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3__1459 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(300,25:2,5,1) -> Half(600:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_3__1459 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.00552 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00552 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1152,9,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1152,1,384,128) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_4/depthwise (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_4/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(1152,9,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(576,9:2,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_4/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1152,9,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1152,1,384,128) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_4/depthwise (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_4/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(1152,9,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(576,9:2,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_4/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,400,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,1,2560,128) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_1/depthwise (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_1/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(51200,400,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(25600,400:2,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_1/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(600,25,5,1) -> Float(600,1,120,24) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(600,25,5,1) -> Float(25,25:32,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(600,25,5,1) -> Half(600,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(600,25,5,1) -> Half(300,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(600,1,120,24) -> Float(600,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(600,1,120,24) -> Float(25,25:32,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(600,1,120,24) -> Half(600,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(600,1,120,24) -> Half(300,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25,25:32,5,1) -> Float(600,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25,25:32,5,1) -> Float(600,1,120,24) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25,25:32,5,1) -> Half(600,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(25,25:32,5,1) -> Half(300,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(600,25,5,1) -> Float(600,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(600,25,5,1) -> Float(600,1,120,24) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(600,25,5,1) -> Float(25,25:32,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(600,25,5,1) -> Half(300,25:2,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(300,25:2,5,1) -> Float(600,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(300,25:2,5,1) -> Float(600,1,120,24) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(300,25:2,5,1) -> Float(25,25:32,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(300,25:2,5,1) -> Half(600,25,5,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(600,25,5,1) -> Float(600,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3__1440 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_6 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_7 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(600,1,120,24) -> Float(1,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3__1440 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_6 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_7 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(25,25:32,5,1) -> Float(600:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3__1440 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_6 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_7 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.047135 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.047135 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(600,25,5,1) -> Half(600,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3__1440 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_6 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_7 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.00552 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00552 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(300,25:2,5,1) -> Half(600:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3__1440 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_6 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_7 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(204800,1600,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(204800,1,5120,128) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d/depthwise (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(204800,1600,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(102400,1600:2,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1152,9,3,1) -> Float(216,9,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 Time: 0.028594 [TensorRT] VERBOSE: Tactic: 655359 Time: 0.024114 [TensorRT] VERBOSE: Tactic: 786431 Time: 0.019427 [TensorRT] VERBOSE: Tactic: 851967 Time: 0.014688 [TensorRT] VERBOSE: Tactic: 1179647 Time: 0.010052 [TensorRT] VERBOSE: Tactic: 1310719 Time: 0.056458 [TensorRT] VERBOSE: Tactic: 1376255 Time: 0.035573 [TensorRT] VERBOSE: Tactic: 1441791 Time: 0.0125 [TensorRT] VERBOSE: Tactic: 1507327 Time: 0.024114 [TensorRT] VERBOSE: Tactic: 1638399 Time: 0.0125 [TensorRT] VERBOSE: Tactic: 1835007 Time: 0.017187 [TensorRT] VERBOSE: Tactic: 1900543 Time: 0.040313 [TensorRT] VERBOSE: Tactic: 2097151 Time: 0.010157 [TensorRT] VERBOSE: Tactic: 2162687 Time: 0.037761 [TensorRT] VERBOSE: Tactic: 2293759 Time: 0.035573 [TensorRT] VERBOSE: Tactic: 2359295 Time: 0.02625 [TensorRT] VERBOSE: Tactic: 2686975 Time: 0.033334 [TensorRT] VERBOSE: Tactic: 3080191 Time: 0.017032 [TensorRT] VERBOSE: Tactic: 3342335 Time: 0.024011 [TensorRT] VERBOSE: Tactic: 3407871 Time: 0.021667 [TensorRT] VERBOSE: Tactic: 3538943 Time: 0.014688 [TensorRT] VERBOSE: Tactic: 3670015 Time: 0.040208 [TensorRT] VERBOSE: Tactic: 3932159 Time: 0.028698 [TensorRT] VERBOSE: Tactic: 3997695 Time: 0.012448 [TensorRT] VERBOSE: Tactic: 4063231 Time: 0.01474 [TensorRT] VERBOSE: Tactic: 4194303 Time: 0.019375 [TensorRT] VERBOSE: Tactic: 4259839 Time: 0.010052 [TensorRT] VERBOSE: Tactic: 4325375 Time: 0.014688 [TensorRT] VERBOSE: Tactic: 4521983 Time: 0.033698 [TensorRT] VERBOSE: Tactic: 4587519 Time: 0.012344 [TensorRT] VERBOSE: Tactic: 4653055 Time: 0.012344 [TensorRT] VERBOSE: Tactic: 4915199 Time: 0.012396 [TensorRT] VERBOSE: Tactic: 4980735 Time: 0.024062 [TensorRT] VERBOSE: Tactic: 5177343 Time: 0.010157 [TensorRT] VERBOSE: Tactic: 5242879 Time: 0.019323 [TensorRT] VERBOSE: Tactic: 5373951 Time: 0.010104 [TensorRT] VERBOSE: Tactic: 5439487 Time: 0.017084 [TensorRT] VERBOSE: Tactic: 5570559 Time: 0.017188 [TensorRT] VERBOSE: Tactic: 5636095 Time: 0.014635 [TensorRT] VERBOSE: Tactic: 5701631 Time: 0.031146 [TensorRT] VERBOSE: Tactic: 5767167 Time: 0.017447 [TensorRT] VERBOSE: Tactic: 5832703 Time: 0.019531 [TensorRT] VERBOSE: Tactic: 5898239 Time: 0.012396 [TensorRT] VERBOSE: Tactic: 6029311 Time: 0.03099 [TensorRT] VERBOSE: Tactic: 6225919 Time: 0.012604 [TensorRT] VERBOSE: Tactic: 6291455 Time: 0.010156 [TensorRT] VERBOSE: Tactic: 6422527 Time: 0.019531 [TensorRT] VERBOSE: Tactic: 6750207 Time: 0.012395 [TensorRT] VERBOSE: Tactic: 6815743 Time: 0.019323 [TensorRT] VERBOSE: Tactic: 6946815 Time: 0.019323 [TensorRT] VERBOSE: Tactic: 7012351 Time: 0.010052 [TensorRT] VERBOSE: Tactic: 7077887 Time: 0.012552 [TensorRT] VERBOSE: Tactic: 7143423 Time: 0.019375 [TensorRT] VERBOSE: Tactic: 7208959 Time: 0.019479 [TensorRT] VERBOSE: Tactic: 7340031 Time: 0.012344 [TensorRT] VERBOSE: Tactic: 7405567 Time: 0.012447 [TensorRT] VERBOSE: Tactic: 7536639 Time: 0.019271 [TensorRT] VERBOSE: Tactic: 7602175 Time: 0.019375 [TensorRT] VERBOSE: Tactic: 7733247 Time: 0.014688 [TensorRT] VERBOSE: Tactic: 7798783 Time: 0.019584 [TensorRT] VERBOSE: Tactic: 8191999 Time: 0.017083 [TensorRT] VERBOSE: Tactic: 8257535 Time: 0.012396 [TensorRT] VERBOSE: Tactic: 8323071 Time: 0.017136 [TensorRT] VERBOSE: Tactic: 8650751 Time: 0.019375 [TensorRT] VERBOSE: Tactic: 8716287 Time: 0.012552 [TensorRT] VERBOSE: Tactic: 9109503 Time: 0.010104 [TensorRT] VERBOSE: Tactic: 9568255 Time: 0.012448 [TensorRT] VERBOSE: Tactic: 9895935 Time: 0.019531 [TensorRT] VERBOSE: Tactic: 10223615 Time: 0.033282 [TensorRT] VERBOSE: Tactic: 10354687 Time: 0.010208 [TensorRT] VERBOSE: Tactic: 10551295 Time: 0.021614 [TensorRT] VERBOSE: Tactic: 10747903 Time: 0.014687 [TensorRT] VERBOSE: Tactic: 10944511 Time: 0.024219 [TensorRT] VERBOSE: Fastest Tactic: 1179647 Time: 0.010052 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.034739 [TensorRT] VERBOSE: Tactic: 1 Time: 0.030885 [TensorRT] VERBOSE: Tactic: 2 Time: 0.095885 [TensorRT] VERBOSE: Tactic: 4 Time: 0.82651 [TensorRT] VERBOSE: Tactic: 5 Time: 0.271406 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.030885 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 0.033489 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TensorRT] VERBOSE: Tactic: 1698681053543049347 Time: 0.022292 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 0.035781 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 0.026302 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 0.03573 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TensorRT] VERBOSE: Tactic: 5326823351883942011 Time: 0.035782 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TensorRT] VERBOSE: Tactic: 5500448035057547314 Time: 0.029427 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 0.028802 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 0.024115 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 0.036094 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TensorRT] VERBOSE: Tactic: -6576203419454146580 Time: 0.028906 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 0.024427 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 0.028802 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 0.031145 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 0.030938 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 0.035677 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TensorRT] VERBOSE: Tactic: -377491875521947884 Time: 0.035729 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TensorRT] VERBOSE: Tactic: -37215280111360163 Time: 0.026563 [TensorRT] VERBOSE: Fastest Tactic: 1698681053543049347 Time: 0.022292 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 1179647 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1152,1,384,128) -> Float(216,1,72,24) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TensorRT] VERBOSE: Tactic: 3886731678879822788 Time: 0.021927 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TensorRT] VERBOSE: Tactic: 6629944304117643200 Time: 0.017344 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TensorRT] VERBOSE: Tactic: -9153228964338181824 Time: 0.017239 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TensorRT] VERBOSE: Tactic: -7394439838318485025 Time: 0.021771 [TensorRT] VERBOSE: Fastest Tactic: -9153228964338181824 Time: 0.017239 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9153228964338181824 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(1152,9,3,1) -> Half(216,9,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.032135 [TensorRT] VERBOSE: Tactic: 1 Time: 0.033021 [TensorRT] VERBOSE: Tactic: 2 Time: 0.094479 [TensorRT] VERBOSE: Tactic: 4 Time: 0.842031 [TensorRT] VERBOSE: Tactic: 5 Time: 0.271822 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.032135 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(576,9:2,3,1) -> Half(216,9,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(576,9:2,3,1) -> Half(108,9:2,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 Time: 0.021771 [TensorRT] VERBOSE: Tactic: 655359 Time: 0.024948 [TensorRT] VERBOSE: Tactic: 786431 Time: 0.01698 [TensorRT] VERBOSE: Tactic: 851967 Time: 0.010312 [TensorRT] VERBOSE: Tactic: 1179647 Time: 0.00802 [TensorRT] VERBOSE: Tactic: 1310719 Time: 0.044791 [TensorRT] VERBOSE: Tactic: 1376255 Time: 0.021667 [TensorRT] VERBOSE: Tactic: 1441791 Time: 0.010052 [TensorRT] VERBOSE: Tactic: 1507327 Time: 0.017135 [TensorRT] VERBOSE: Tactic: 1638399 Time: 0.01026 [TensorRT] VERBOSE: Tactic: 1835007 Time: 0.01474 [TensorRT] VERBOSE: Tactic: 1900543 Time: 0.028593 [TensorRT] VERBOSE: Tactic: 2097151 Time: 0.007864 [TensorRT] VERBOSE: Tactic: 2162687 Time: 0.024062 [TensorRT] VERBOSE: Tactic: 2293759 Time: 0.021666 [TensorRT] VERBOSE: Tactic: 2359295 Time: 0.019323 [TensorRT] VERBOSE: Tactic: 2686975 Time: 0.033229 [TensorRT] VERBOSE: Tactic: 3080191 Time: 0.014688 [TensorRT] VERBOSE: Tactic: 3342335 Time: 0.017031 [TensorRT] VERBOSE: Tactic: 3407871 Time: 0.014791 [TensorRT] VERBOSE: Tactic: 3538943 Time: 0.01026 [TensorRT] VERBOSE: Tactic: 3670015 Time: 0.042448 [TensorRT] VERBOSE: Tactic: 3932159 Time: 0.012552 [TensorRT] VERBOSE: Tactic: 3997695 Time: 0.010104 [TensorRT] VERBOSE: Tactic: 4063231 Time: 0.012396 [TensorRT] VERBOSE: Tactic: 4194303 Time: 0.017084 [TensorRT] VERBOSE: Tactic: 4259839 Time: 0.007813 [TensorRT] VERBOSE: Tactic: 4325375 Time: 0.010573 [TensorRT] VERBOSE: Tactic: 4521983 Time: 0.024063 [TensorRT] VERBOSE: Tactic: 4587519 Time: 0.01026 [TensorRT] VERBOSE: Tactic: 4653055 Time: 0.010261 [TensorRT] VERBOSE: Tactic: 4915199 Time: 0.010104 [TensorRT] VERBOSE: Tactic: 4980735 Time: 0.017292 [TensorRT] VERBOSE: Tactic: 5177343 Time: 0.007813 [TensorRT] VERBOSE: Tactic: 5242879 Time: 0.012396 [TensorRT] VERBOSE: Tactic: 5373951 Time: 0.007865 [TensorRT] VERBOSE: Tactic: 5439487 Time: 0.012343 [TensorRT] VERBOSE: Tactic: 5570559 Time: 0.017084 [TensorRT] VERBOSE: Tactic: 5636095 Time: 0.012343 [TensorRT] VERBOSE: Tactic: 5701631 Time: 0.019427 [TensorRT] VERBOSE: Tactic: 5767167 Time: 0.012396 [TensorRT] VERBOSE: Tactic: 5832703 Time: 0.012864 [TensorRT] VERBOSE: Tactic: 5898239 Time: 0.010104 [TensorRT] VERBOSE: Tactic: 6029311 Time: 0.019427 [TensorRT] VERBOSE: Tactic: 6225919 Time: 0.010156 [TensorRT] VERBOSE: Tactic: 6291455 Time: 0.007916 [TensorRT] VERBOSE: Tactic: 6422527 Time: 0.014739 [TensorRT] VERBOSE: Tactic: 6750207 Time: 0.010157 [TensorRT] VERBOSE: Tactic: 6815743 Time: 0.012344 [TensorRT] VERBOSE: Tactic: 6946815 Time: 0.012448 [TensorRT] VERBOSE: Tactic: 7012351 Time: 0.007865 [TensorRT] VERBOSE: Tactic: 7077887 Time: 0.010052 [TensorRT] VERBOSE: Tactic: 7143423 Time: 0.012343 [TensorRT] VERBOSE: Tactic: 7208959 Time: 0.01474 [TensorRT] VERBOSE: Tactic: 7340031 Time: 0.010052 [TensorRT] VERBOSE: Tactic: 7405567 Time: 0.010156 [TensorRT] VERBOSE: Tactic: 7536639 Time: 0.015 [TensorRT] VERBOSE: Tactic: 7602175 Time: 0.012448 [TensorRT] VERBOSE: Tactic: 7733247 Time: 0.012396 [TensorRT] VERBOSE: Tactic: 7798783 Time: 0.017083 [TensorRT] VERBOSE: Tactic: 8191999 Time: 0.010104 [TensorRT] VERBOSE: Tactic: 8257535 Time: 0.010156 [TensorRT] VERBOSE: Tactic: 8323071 Time: 0.012395 [TensorRT] VERBOSE: Tactic: 8650751 Time: 0.012448 [TensorRT] VERBOSE: Tactic: 8716287 Time: 0.010052 [TensorRT] VERBOSE: Tactic: 9109503 Time: 0.007812 [TensorRT] VERBOSE: Tactic: 9568255 Time: 0.010104 [TensorRT] VERBOSE: Tactic: 9895935 Time: 0.015052 [TensorRT] VERBOSE: Tactic: 10223615 Time: 0.033177 [TensorRT] VERBOSE: Tactic: 10354687 Time: 0.008073 [TensorRT] VERBOSE: Tactic: 10551295 Time: 0.01474 [TensorRT] VERBOSE: Tactic: 10747903 Time: 0.0125 [TensorRT] VERBOSE: Tactic: 10944511 Time: 0.017083 [TensorRT] VERBOSE: Fastest Tactic: 9109503 Time: 0.007812 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TensorRT] VERBOSE: Tactic: 3066127711859985668 Time: 0.019584 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TensorRT] VERBOSE: Tactic: 3564772625446233998 Time: 0.021667 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TensorRT] VERBOSE: Tactic: 5319956359050645452 Time: 0.019427 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TensorRT] VERBOSE: Tactic: 7205456024582378848 Time: 0.019583 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TensorRT] VERBOSE: Tactic: 8163473458334948789 Time: 0.017604 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TensorRT] VERBOSE: Tactic: -4212163711445252890 Time: 0.021615 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TensorRT] VERBOSE: Tactic: -3898373634979201110 Time: 0.021666 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TensorRT] VERBOSE: Tactic: -2409163523992614473 Time: 0.017135 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TensorRT] VERBOSE: Tactic: -1716393687483585322 Time: 0.021927 [TensorRT] VERBOSE: Fastest Tactic: -2409163523992614473 Time: 0.017135 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 9109503 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,9,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1152,1,384,128) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(1152,9,3,1) -> Half(576,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Float(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Float(1152,1,384,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(576,9:2,3,1) -> Half(1152,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1152,9,3,1) -> Float(216,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1152,1,384,128) -> Float(216,1,72,24) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(1152,9,3,1) -> Half(216,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(576,9:2,3,1) -> Half(216,9,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(576,9:2,3,1) -> Half(108,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,400,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,1,2560,128) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(51200,400,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(25600,400:2,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_1 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_1/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(25600,400:2,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(204800,1600,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(204800,1,5120,128) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(204800,1600,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(102400,1600:2,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/activation_0/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(102400,1600:2,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(216,9,3,1) -> Float(216,1,72,24) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.012448 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(216,9,3,1) -> Float(9,9:32,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.012447 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(216,9,3,1) -> Half(216,9,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.023906 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(216,9,3,1) -> Half(108,9:2,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.007812 [TensorRT] VERBOSE: Tactic: 0 Time: 0.003177 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.003177 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(216,1,72,24) -> Float(216,9,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.012396 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(216,1,72,24) -> Float(9,9:32,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.014843 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(216,1,72,24) -> Half(216,9,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.007813 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(216,1,72,24) -> Half(108,9:2,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.007917 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(9,9:32,3,1) -> Float(216,9,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.0125 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(9,9:32,3,1) -> Float(216,1,72,24) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.014687 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(9,9:32,3,1) -> Half(216,9,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.007813 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(9,9:32,3,1) -> Half(108,9:2,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.007813 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005573 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005573 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(216,9,3,1) -> Float(216,9,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.024062 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(216,9,3,1) -> Float(216,1,72,24) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.007968 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(216,9,3,1) -> Float(9,9:32,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.00776 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(216,9,3,1) -> Half(108,9:2,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.010105 [TensorRT] VERBOSE: Tactic: 0 Time: 0.003177 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.003177 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(108,9:2,3,1) -> Float(216,9,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.007761 [TensorRT] VERBOSE: Tactic: 0 Time: 0.003177 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.003177 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(108,9:2,3,1) -> Float(216,1,72,24) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.007864 [TensorRT] VERBOSE: Tactic: 0 Time: 0.005573 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005573 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(108,9:2,3,1) -> Float(9,9:32,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.007864 [TensorRT] VERBOSE: Tactic: 0 Time: 0.00552 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00552 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(108,9:2,3,1) -> Half(216,9,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.010104 [TensorRT] VERBOSE: Tactic: 0 Time: 0.003177 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.003177 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(216,9,3,1) -> Float(216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4__1360 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(216,1,72,24) -> Float(1,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4__1360 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(9,9:32,3,1) -> Float(216:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4__1360 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.019531 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.019531 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(216,9,3,1) -> Half(216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4__1360 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.004114 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.004114 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(108,9:2,3,1) -> Half(216:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_4__1360 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.005468 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005468 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,400,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,1,2560,128) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/depthwise (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(51200,400,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(25600,400:2,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,400,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,1,2560,128) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_1/depthwise (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_1/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(51200,400,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(25600,400:2,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_1/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(216,9,3,1) -> Float(216,1,72,24) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(216,9,3,1) -> Float(9,9:32,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(216,9,3,1) -> Half(216,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(216,9,3,1) -> Half(108,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(216,1,72,24) -> Float(216,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(216,1,72,24) -> Float(9,9:32,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(216,1,72,24) -> Half(216,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(216,1,72,24) -> Half(108,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(9,9:32,3,1) -> Float(216,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(9,9:32,3,1) -> Float(216,1,72,24) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(9,9:32,3,1) -> Half(216,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(9,9:32,3,1) -> Half(108,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(216,9,3,1) -> Float(216,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(216,9,3,1) -> Float(216,1,72,24) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(216,9,3,1) -> Float(9,9:32,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(216,9,3,1) -> Half(108,9:2,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(108,9:2,3,1) -> Float(216,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(108,9:2,3,1) -> Float(216,1,72,24) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(108,9:2,3,1) -> Float(9,9:32,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(108,9:2,3,1) -> Half(216,9,3,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(216,9,3,1) -> Float(216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4__1341 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_8 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_9 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005521 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(216,1,72,24) -> Float(1,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4__1341 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_8 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_9 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(9,9:32,3,1) -> Float(216:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4__1341 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_8 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_9 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.019375 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.019375 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(216,9,3,1) -> Half(216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4__1341 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_8 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_9 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005469 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(108,9:2,3,1) -> Half(216:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_4__1341 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_8 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_9 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.005468 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.005468 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(204800,1600,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(204800,1,5120,128) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/depthwise (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(204800,1600,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(102400,1600:2,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,400,20,1) -> Float(9600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 Time: 0.06625 [TensorRT] VERBOSE: Tactic: 655359 Time: 0.137396 [TensorRT] VERBOSE: Tactic: 786431 Time: 0.068021 [TensorRT] VERBOSE: Tactic: 851967 Time: 0.153698 [TensorRT] VERBOSE: Tactic: 1179647 Time: 0.105208 [TensorRT] VERBOSE: Tactic: 1310719 Time: 0.119791 [TensorRT] VERBOSE: Tactic: 1376255 Time: 0.102188 [TensorRT] VERBOSE: Tactic: 1441791 Time: 0.100573 [TensorRT] VERBOSE: Tactic: 1507327 Time: 0.146875 [TensorRT] VERBOSE: Tactic: 1638399 Time: 0.070729 [TensorRT] VERBOSE: Tactic: 1835007 Time: 0.068177 [TensorRT] VERBOSE: Tactic: 1900543 Time: 0.163125 [TensorRT] VERBOSE: Tactic: 2097151 Time: 0.075833 [TensorRT] VERBOSE: Tactic: 2162687 Time: 0.079636 [TensorRT] VERBOSE: Tactic: 2293759 Time: 0.100417 [TensorRT] VERBOSE: Tactic: 2359295 Time: 0.084479 [TensorRT] VERBOSE: Tactic: 2686975 Time: 0.077187 [TensorRT] VERBOSE: Tactic: 3080191 Time: 0.137553 [TensorRT] VERBOSE: Tactic: 3342335 Time: 0.167812 [TensorRT] VERBOSE: Tactic: 3407871 Time: 0.096041 [TensorRT] VERBOSE: Tactic: 3538943 Time: 0.091822 [TensorRT] VERBOSE: Tactic: 3670015 Time: 0.109636 [TensorRT] VERBOSE: Tactic: 3932159 Time: 0.135156 [TensorRT] VERBOSE: Tactic: 3997695 Time: 0.070365 [TensorRT] VERBOSE: Tactic: 4063231 Time: 0.169844 [TensorRT] VERBOSE: Tactic: 4194303 Time: 0.068281 [TensorRT] VERBOSE: Tactic: 4259839 Time: 0.079844 [TensorRT] VERBOSE: Tactic: 4325375 Time: 0.066927 [TensorRT] VERBOSE: Tactic: 4521983 Time: 0.07026 [TensorRT] VERBOSE: Tactic: 4587519 Time: 0.086458 [TensorRT] VERBOSE: Tactic: 4653055 Time: 0.130417 [TensorRT] VERBOSE: Tactic: 4915199 Time: 0.065677 [TensorRT] VERBOSE: Tactic: 4980735 Time: 0.066042 [TensorRT] VERBOSE: Tactic: 5177343 Time: 0.088854 [TensorRT] VERBOSE: Tactic: 5242879 Time: 0.084479 [TensorRT] VERBOSE: Tactic: 5373951 Time: 0.105625 [TensorRT] VERBOSE: Tactic: 5439487 Time: 0.073229 [TensorRT] VERBOSE: Tactic: 5570559 Time: 0.121407 [TensorRT] VERBOSE: Tactic: 5636095 Time: 0.169896 [TensorRT] VERBOSE: Tactic: 5701631 Time: 0.096354 [TensorRT] VERBOSE: Tactic: 5767167 Time: 0.096771 [TensorRT] VERBOSE: Tactic: 5832703 Time: 0.093542 [TensorRT] VERBOSE: Tactic: 5898239 Time: 0.082032 [TensorRT] VERBOSE: Tactic: 6029311 Time: 0.091875 [TensorRT] VERBOSE: Tactic: 6225919 Time: 0.080729 [TensorRT] VERBOSE: Tactic: 6291455 Time: 0.105209 [TensorRT] VERBOSE: Tactic: 6422527 Time: 0.135364 [TensorRT] VERBOSE: Tactic: 6750207 Time: 0.070573 [TensorRT] VERBOSE: Tactic: 6815743 Time: 0.089375 [TensorRT] VERBOSE: Tactic: 6946815 Time: 0.086771 [TensorRT] VERBOSE: Tactic: 7012351 Time: 0.077447 [TensorRT] VERBOSE: Tactic: 7077887 Time: 0.089114 [TensorRT] VERBOSE: Tactic: 7143423 Time: 0.095782 [TensorRT] VERBOSE: Tactic: 7208959 Time: 0.086562 [TensorRT] VERBOSE: Tactic: 7340031 Time: 0.082083 [TensorRT] VERBOSE: Tactic: 7405567 Time: 0.098698 [TensorRT] VERBOSE: Tactic: 7536639 Time: 0.091563 [TensorRT] VERBOSE: Tactic: 7602175 Time: 0.084479 [TensorRT] VERBOSE: Tactic: 7733247 Time: 0.082865 [TensorRT] VERBOSE: Tactic: 7798783 Time: 0.067239 [TensorRT] VERBOSE: Tactic: 8191999 Time: 0.09599 [TensorRT] VERBOSE: Tactic: 8257535 Time: 0.066354 [TensorRT] VERBOSE: Tactic: 8323071 Time: 0.069791 [TensorRT] VERBOSE: Tactic: 8650751 Time: 0.084792 [TensorRT] VERBOSE: Tactic: 8716287 Time: 0.086875 [TensorRT] VERBOSE: Tactic: 9109503 Time: 0.075573 [TensorRT] VERBOSE: Tactic: 9568255 Time: 0.065677 [TensorRT] VERBOSE: Tactic: 9895935 Time: 0.068125 [TensorRT] VERBOSE: Tactic: 10223615 Time: 0.077604 [TensorRT] VERBOSE: Tactic: 10354687 Time: 0.075157 [TensorRT] VERBOSE: Tactic: 10551295 Time: 0.0775 [TensorRT] VERBOSE: Tactic: 10747903 Time: 0.084218 [TensorRT] VERBOSE: Tactic: 10944511 Time: 0.06625 [TensorRT] VERBOSE: Fastest Tactic: 4915199 Time: 0.065677 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.067448 [TensorRT] VERBOSE: Tactic: 1 Time: 0.058802 [TensorRT] VERBOSE: Tactic: 2 Time: 0.234271 [TensorRT] VERBOSE: Tactic: 4 Time: 3.53651 [TensorRT] VERBOSE: Tactic: 5 Time: 0.403177 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.058802 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 0.045208 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TensorRT] VERBOSE: Tactic: 1698681053543049347 Time: 0.040989 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 0.112136 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 0.061719 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 0.112917 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TensorRT] VERBOSE: Tactic: 5326823351883942011 Time: 0.106302 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TensorRT] VERBOSE: Tactic: 5500448035057547314 Time: 0.06401 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 0.064479 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 0.042604 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 0.112917 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TensorRT] VERBOSE: Tactic: -6576203419454146580 Time: 0.042708 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 0.045052 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 0.042396 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 0.065885 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 0.064896 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 0.110052 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TensorRT] VERBOSE: Tactic: -377491875521947884 Time: 0.108177 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TensorRT] VERBOSE: Tactic: -37215280111360163 Time: 0.062709 [TensorRT] VERBOSE: Fastest Tactic: 1698681053543049347 Time: 0.040989 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1698681053543049347 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,1,2560,128) -> Float(9600,1,480,24) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TensorRT] VERBOSE: Tactic: 3886731678879822788 Time: 0.061094 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TensorRT] VERBOSE: Tactic: 6629944304117643200 Time: 0.060417 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TensorRT] VERBOSE: Tactic: -9153228964338181824 Time: 0.060312 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TensorRT] VERBOSE: Tactic: -7394439838318485025 Time: 0.062031 [TensorRT] VERBOSE: Fastest Tactic: -9153228964338181824 Time: 0.060312 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -9153228964338181824 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(51200,400,20,1) -> Half(9600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.072292 [TensorRT] VERBOSE: Tactic: 1 Time: 0.067813 [TensorRT] VERBOSE: Tactic: 2 Time: 0.209062 [TensorRT] VERBOSE: Tactic: 4 Time: 3.595 [TensorRT] VERBOSE: Tactic: 5 Time: 0.390729 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.067813 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(25600,400:2,20,1) -> Half(9600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(25600,400:2,20,1) -> Half(4800,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 Time: 0.033542 [TensorRT] VERBOSE: Tactic: 655359 Time: 0.091354 [TensorRT] VERBOSE: Tactic: 786431 Time: 0.040209 [TensorRT] VERBOSE: Tactic: 851967 Time: 0.100364 [TensorRT] VERBOSE: Tactic: 1179647 Time: 0.063542 [TensorRT] VERBOSE: Tactic: 1310719 Time: 0.06625 [TensorRT] VERBOSE: Tactic: 1376255 Time: 0.054479 [TensorRT] VERBOSE: Tactic: 1441791 Time: 0.063281 [TensorRT] VERBOSE: Tactic: 1507327 Time: 0.088802 [TensorRT] VERBOSE: Tactic: 1638399 Time: 0.040157 [TensorRT] VERBOSE: Tactic: 1835007 Time: 0.040208 [TensorRT] VERBOSE: Tactic: 1900543 Time: 0.091354 [TensorRT] VERBOSE: Tactic: 2097151 Time: 0.056406 [TensorRT] VERBOSE: Tactic: 2162687 Time: 0.041093 [TensorRT] VERBOSE: Tactic: 2293759 Time: 0.056615 [TensorRT] VERBOSE: Tactic: 2359295 Time: 0.047396 [TensorRT] VERBOSE: Tactic: 2686975 Time: 0.052448 [TensorRT] VERBOSE: Tactic: 3080191 Time: 0.091094 [TensorRT] VERBOSE: Tactic: 3342335 Time: 0.10276 [TensorRT] VERBOSE: Tactic: 3407871 Time: 0.054479 [TensorRT] VERBOSE: Tactic: 3538943 Time: 0.05901 [TensorRT] VERBOSE: Tactic: 3670015 Time: 0.064739 [TensorRT] VERBOSE: Tactic: 3932159 Time: 0.068697 [TensorRT] VERBOSE: Tactic: 3997695 Time: 0.042708 [TensorRT] VERBOSE: Tactic: 4063231 Time: 0.107448 [TensorRT] VERBOSE: Tactic: 4194303 Time: 0.040261 [TensorRT] VERBOSE: Tactic: 4259839 Time: 0.056355 [TensorRT] VERBOSE: Tactic: 4325375 Time: 0.037916 [TensorRT] VERBOSE: Tactic: 4521983 Time: 0.034115 [TensorRT] VERBOSE: Tactic: 4587519 Time: 0.056563 [TensorRT] VERBOSE: Tactic: 4653055 Time: 0.084167 [TensorRT] VERBOSE: Tactic: 4915199 Time: 0.0425 [TensorRT] VERBOSE: Tactic: 4980735 Time: 0.037917 [TensorRT] VERBOSE: Tactic: 5177343 Time: 0.054219 [TensorRT] VERBOSE: Tactic: 5242879 Time: 0.047239 [TensorRT] VERBOSE: Tactic: 5373951 Time: 0.065729 [TensorRT] VERBOSE: Tactic: 5439487 Time: 0.047395 [TensorRT] VERBOSE: Tactic: 5570559 Time: 0.086719 [TensorRT] VERBOSE: Tactic: 5636095 Time: 0.109739 [TensorRT] VERBOSE: Tactic: 5701631 Time: 0.047135 [TensorRT] VERBOSE: Tactic: 5767167 Time: 0.05177 [TensorRT] VERBOSE: Tactic: 5832703 Time: 0.049583 [TensorRT] VERBOSE: Tactic: 5898239 Time: 0.06349 [TensorRT] VERBOSE: Tactic: 6029311 Time: 0.049479 [TensorRT] VERBOSE: Tactic: 6225919 Time: 0.049584 [TensorRT] VERBOSE: Tactic: 6291455 Time: 0.063386 [TensorRT] VERBOSE: Tactic: 6422527 Time: 0.084219 [TensorRT] VERBOSE: Tactic: 6750207 Time: 0.0425 [TensorRT] VERBOSE: Tactic: 6815743 Time: 0.051771 [TensorRT] VERBOSE: Tactic: 6946815 Time: 0.04724 [TensorRT] VERBOSE: Tactic: 7012351 Time: 0.05651 [TensorRT] VERBOSE: Tactic: 7077887 Time: 0.051823 [TensorRT] VERBOSE: Tactic: 7143423 Time: 0.049583 [TensorRT] VERBOSE: Tactic: 7208959 Time: 0.047135 [TensorRT] VERBOSE: Tactic: 7340031 Time: 0.065729 [TensorRT] VERBOSE: Tactic: 7405567 Time: 0.060989 [TensorRT] VERBOSE: Tactic: 7536639 Time: 0.054271 [TensorRT] VERBOSE: Tactic: 7602175 Time: 0.044895 [TensorRT] VERBOSE: Tactic: 7733247 Time: 0.051771 [TensorRT] VERBOSE: Tactic: 7798783 Time: 0.040261 [TensorRT] VERBOSE: Tactic: 8191999 Time: 0.052083 [TensorRT] VERBOSE: Tactic: 8257535 Time: 0.040156 [TensorRT] VERBOSE: Tactic: 8323071 Time: 0.044844 [TensorRT] VERBOSE: Tactic: 8650751 Time: 0.044843 [TensorRT] VERBOSE: Tactic: 8716287 Time: 0.049688 [TensorRT] VERBOSE: Tactic: 9109503 Time: 0.054115 [TensorRT] VERBOSE: Tactic: 9568255 Time: 0.040208 [TensorRT] VERBOSE: Tactic: 9895935 Time: 0.04026 [TensorRT] VERBOSE: Tactic: 10223615 Time: 0.0525 [TensorRT] VERBOSE: Tactic: 10354687 Time: 0.054062 [TensorRT] VERBOSE: Tactic: 10551295 Time: 0.042552 [TensorRT] VERBOSE: Tactic: 10747903 Time: 0.051771 [TensorRT] VERBOSE: Tactic: 10944511 Time: 0.037865 [TensorRT] VERBOSE: Fastest Tactic: 589823 Time: 0.033542 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TensorRT] VERBOSE: Tactic: 3066127711859985668 Time: 0.02651 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TensorRT] VERBOSE: Tactic: 3564772625446233998 Time: 0.028698 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TensorRT] VERBOSE: Tactic: 5319956359050645452 Time: 0.026354 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TensorRT] VERBOSE: Tactic: 7205456024582378848 Time: 0.038125 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TensorRT] VERBOSE: Tactic: 8163473458334948789 Time: 0.035781 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TensorRT] VERBOSE: Tactic: -4212163711445252890 Time: 0.061198 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TensorRT] VERBOSE: Tactic: -3898373634979201110 Time: 0.06125 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TensorRT] VERBOSE: Tactic: -2409163523992614473 Time: 0.037865 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1 Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TensorRT] VERBOSE: Tactic: -1716393687483585322 Time: 0.058958 [TensorRT] VERBOSE: Fastest Tactic: 5319956359050645452 Time: 0.026354 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5319956359050645452 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,400,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51200,1,2560,128) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51200,400,20,1) -> Half(25600,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Float(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Float(51200,1,2560,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(25600,400:2,20,1) -> Half(51200,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,400,20,1) -> Float(9600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51200,1,2560,128) -> Float(9600,1,480,24) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(51200,400,20,1) -> Half(9600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(25600,400:2,20,1) -> Half(9600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(25600,400:2,20,1) -> Half(4800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(204800,1600,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(204800,1,5120,128) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(204800,1600,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(102400,1600:2,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/activation_0/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(102400,1600:2,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(9600,400,20,1) -> Float(9600,1,480,24) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.035677 [TensorRT] VERBOSE: Tactic: 0 Time: 0.019323 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.019323 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(9600,400,20,1) -> Float(400,400:32,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.03552 [TensorRT] VERBOSE: Tactic: 0 Time: 0.03323 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.03323 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(9600,400,20,1) -> Half(9600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.241614 [TensorRT] VERBOSE: Tactic: 0 Time: 0.012604 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012604 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(9600,400,20,1) -> Half(4800,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.019427 [TensorRT] VERBOSE: Tactic: 0 Time: 0.012448 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.012448 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(9600,1,480,24) -> Float(9600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.04474 [TensorRT] VERBOSE: Tactic: 0 Time: 0.021406 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.021406 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(9600,1,480,24) -> Float(400,400:32,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.024062 [TensorRT] VERBOSE: Tactic: 0 Time: 0.047187 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.024062 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(9600,1,480,24) -> Half(9600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.021563 [TensorRT] VERBOSE: Tactic: 0 Time: 0.021459 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.021459 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(9600,1,480,24) -> Half(4800,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.024063 [TensorRT] VERBOSE: Tactic: 0 Time: 0.024167 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.024063 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(400,400:32,20,1) -> Float(9600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.044688 [TensorRT] VERBOSE: Tactic: 0 Time: 0.024063 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.024063 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(400,400:32,20,1) -> Float(9600,1,480,24) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.024115 [TensorRT] VERBOSE: Tactic: 0 Time: 0.024011 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.024011 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(400,400:32,20,1) -> Half(9600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.023959 [TensorRT] VERBOSE: Tactic: 0 Time: 0.023958 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.023958 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(400,400:32,20,1) -> Half(4800,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.024062 [TensorRT] VERBOSE: Tactic: 0 Time: 0.026666 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.024062 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(9600,400,20,1) -> Float(9600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.299792 [TensorRT] VERBOSE: Tactic: 0 Time: 0.013802 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.013802 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(9600,400,20,1) -> Float(9600,1,480,24) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.021563 [TensorRT] VERBOSE: Tactic: 0 Time: 0.021614 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.021563 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(9600,400,20,1) -> Float(400,400:32,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.021302 [TensorRT] VERBOSE: Tactic: 0 Time: 0.039687 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.021302 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(9600,400,20,1) -> Half(4800,400:2,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.02401 [TensorRT] VERBOSE: Tactic: 0 Time: 0.013698 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.013698 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(4800,400:2,20,1) -> Float(9600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.024062 [TensorRT] VERBOSE: Tactic: 0 Time: 0.011406 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.011406 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(4800,400:2,20,1) -> Float(9600,1,480,24) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.021406 [TensorRT] VERBOSE: Tactic: 0 Time: 0.024115 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.021406 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(4800,400:2,20,1) -> Float(400,400:32,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.02151 [TensorRT] VERBOSE: Tactic: 0 Time: 0.041927 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.02151 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(4800,400:2,20,1) -> Half(9600,400,20,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.049844 [TensorRT] VERBOSE: Tactic: 0 Time: 0.011198 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.011198 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(9600,400,20,1) -> Float(9600,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1__1709 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.021354 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.021354 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(9600,1,480,24) -> Float(1,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1__1709 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.021406 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.021406 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(400,400:32,20,1) -> Float(9600:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1__1709 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.968073 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.968073 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(9600,400,20,1) -> Half(9600,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1__1709 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.01901 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.01901 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(4800,400:2,20,1) -> Half(9600:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd_1__1709 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.039479 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.039479 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(204800,1600,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(204800,1,5120,128) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d/depthwise (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(204800,1600,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(102400,1600:2,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(9600,400,20,1) -> Float(9600,1,480,24) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(9600,400,20,1) -> Float(400,400:32,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(9600,400,20,1) -> Half(9600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(9600,400,20,1) -> Half(4800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(9600,1,480,24) -> Float(9600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(9600,1,480,24) -> Float(400,400:32,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(9600,1,480,24) -> Half(9600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(9600,1,480,24) -> Half(4800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(400,400:32,20,1) -> Float(9600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(400,400:32,20,1) -> Float(9600,1,480,24) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(400,400:32,20,1) -> Half(9600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(400,400:32,20,1) -> Half(4800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(9600,400,20,1) -> Float(9600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(9600,400,20,1) -> Float(9600,1,480,24) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(9600,400,20,1) -> Float(400,400:32,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(9600,400,20,1) -> Half(4800,400:2,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(4800,400:2,20,1) -> Float(9600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(4800,400:2,20,1) -> Float(9600,1,480,24) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(4800,400:2,20,1) -> Float(400,400:32,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(4800,400:2,20,1) -> Half(9600,400,20,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(9600,400,20,1) -> Float(9600,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1__1690 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.021458 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.021458 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(9600,1,480,24) -> Float(1,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1__1690 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.021459 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.021459 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(400,400:32,20,1) -> Float(9600:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1__1690 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.960521 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.960521 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(9600,400,20,1) -> Half(9600,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1__1690 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.018906 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.018906 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(4800,400:2,20,1) -> Half(9600:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_1__1690 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_2 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.039479 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.039479 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(204800,1600,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(204800,1,5120,128) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(204800,1600,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(102400,1600:2,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/activation_0/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(102400,1600:2,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(204800,1600,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(204800,1,5120,128) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d/depthwise (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(204800,1600,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(102400,1600:2,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(204800,1600,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(204800,1,5120,128) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(204800,1600,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(102400,1600:2,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/activation_0/Relu6 (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(102400,1600:2,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.244687 [TensorRT] VERBOSE: Tactic: 0 Time: 0.390261 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.244687 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.393907 [TensorRT] VERBOSE: Tactic: 0 Time: 0.256302 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.256302 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.372656 [TensorRT] VERBOSE: Tactic: 0 Time: 0.206667 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.206667 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.29974 [TensorRT] VERBOSE: Tactic: 0 Time: 0.373073 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.29974 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.237708 [TensorRT] VERBOSE: Tactic: 0 Time: 0.374479 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.237708 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.318645 [TensorRT] VERBOSE: Tactic: 0 Time: 0.433386 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.318645 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.398021 [TensorRT] VERBOSE: Tactic: 0 Time: 0.219271 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.219271 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.224219 [TensorRT] VERBOSE: Tactic: 0 Time: 0.379323 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.224219 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.218125 [TensorRT] VERBOSE: Tactic: 0 Time: 0.206459 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.206459 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.301979 [TensorRT] VERBOSE: Tactic: 0 Time: 0.178073 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.178073 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.227135 [TensorRT] VERBOSE: Tactic: 0 Time: 0.436614 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.227135 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.435052 [TensorRT] VERBOSE: Tactic: 0 Time: 0.174687 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.174687 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(204800,1600,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(204800,1,5120,128) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d/depthwise (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(204800,1600,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(102400,1600:2,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(204800,1600,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(204800,1,5120,128) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d/depthwise (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(204800,1600,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(102400,1600:2,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d/depthwise (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(204800,1600,40,1) -> Float(38400,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (CudaDepthwiseConvolution) [TensorRT] VERBOSE: CudaDepthwiseConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 Time: 0.332553 [TensorRT] VERBOSE: Tactic: 655359 Time: 0.563958 [TensorRT] VERBOSE: Tactic: 786431 Time: 0.332239 [TensorRT] VERBOSE: Tactic: 851967 Time: 0.8175 [TensorRT] VERBOSE: Tactic: 1179647 Time: 0.456303 [TensorRT] VERBOSE: Tactic: 1310719 Time: 0.532031 [TensorRT] VERBOSE: Tactic: 1376255 Time: 0.346875 [TensorRT] VERBOSE: Tactic: 1441791 Time: 0.514219 [TensorRT] VERBOSE: Tactic: 1507327 Time: 0.767916 [TensorRT] VERBOSE: Tactic: 1638399 Time: 0.340782 [TensorRT] VERBOSE: Tactic: 1835007 Time: 0.331615 [TensorRT] VERBOSE: Tactic: 1900543 Time: 0.73776 [TensorRT] VERBOSE: Tactic: 2097151 Time: 0.376511 [TensorRT] VERBOSE: Tactic: 2162687 Time: 0.370677 [TensorRT] VERBOSE: Tactic: 2293759 Time: 0.360052 [TensorRT] VERBOSE: Tactic: 2359295 Time: 0.392396 [TensorRT] VERBOSE: Tactic: 2686975 Time: 0.330729 [TensorRT] VERBOSE: Tactic: 3080191 Time: 0.710417 [TensorRT] VERBOSE: Tactic: 3342335 Time: 0.769219 [TensorRT] VERBOSE: Tactic: 3407871 Time: 0.382604 [TensorRT] VERBOSE: Tactic: 3538943 Time: 0.390729 [TensorRT] VERBOSE: Tactic: 3670015 Time: 0.505208 [TensorRT] VERBOSE: Tactic: 3932159 Time: 0.666771 [TensorRT] VERBOSE: Tactic: 3997695 Time: 0.3225 [TensorRT] VERBOSE: Tactic: 4063231 Time: 0.883021 [TensorRT] VERBOSE: Tactic: 4194303 Time: 0.333645 [TensorRT] VERBOSE: Tactic: 4259839 Time: 0.35224 [TensorRT] VERBOSE: Tactic: 4325375 Time: 0.328021 [TensorRT] VERBOSE: Tactic: 4521983 Time: 0.305417 [TensorRT] VERBOSE: Tactic: 4587519 Time: 0.369427 [TensorRT] VERBOSE: Tactic: 4653055 Time: 0.571927 [TensorRT] VERBOSE: Tactic: 4915199 Time: 0.33375 [TensorRT] VERBOSE: Tactic: 4980735 Time: 0.329844 [TensorRT] VERBOSE: Tactic: 5177343 Time: 0.457917 [TensorRT] VERBOSE: Tactic: 5242879 Time: 0.398125 [TensorRT] VERBOSE: Tactic: 5373951 Time: 0.600781 [TensorRT] VERBOSE: Tactic: 5439487 Time: 0.491407 [TensorRT] VERBOSE: Tactic: 5570559 Time: 0.621094 [TensorRT] VERBOSE: Tactic: 5636095 Time: 0.889063 [TensorRT] VERBOSE: Tactic: 5701631 Time: 0.376562 [TensorRT] VERBOSE: Tactic: 5767167 Time: 1.06271 [TensorRT] VERBOSE: Tactic: 5832703 Time: 0.368386 [TensorRT] VERBOSE: Tactic: 5898239 Time: 0.449531 [TensorRT] VERBOSE: Tactic: 6029311 Time: 0.419739 [TensorRT] VERBOSE: Tactic: 6225919 Time: 0.434428 [TensorRT] VERBOSE: Tactic: 6291455 Time: 0.502813 [TensorRT] VERBOSE: Tactic: 6422527 Time: 0.761406 [TensorRT] VERBOSE: Tactic: 6750207 Time: 0.383855 [TensorRT] VERBOSE: Tactic: 6815743 Time: 0.598593 [TensorRT] VERBOSE: Tactic: 6946815 Time: 0.533281 [TensorRT] VERBOSE: Tactic: 7012351 Time: 0.421406 [TensorRT] VERBOSE: Tactic: 7077887 Time: 0.408541 [TensorRT] VERBOSE: Tactic: 7143423 Time: 0.556302 [TensorRT] VERBOSE: Tactic: 7208959 Time: 0.437031 [TensorRT] VERBOSE: Tactic: 7340031 Time: 0.448802 [TensorRT] VERBOSE: Tactic: 7405567 Time: 0.538334 [TensorRT] VERBOSE: Tactic: 7536639 Time: 0.541458 [TensorRT] VERBOSE: Tactic: 7602175 Time: 0.402291 [TensorRT] VERBOSE: Tactic: 7733247 Time: 0.45401 [TensorRT] VERBOSE: Tactic: 7798783 Time: 0.369792 [TensorRT] VERBOSE: Tactic: 8191999 Time: 0.49974 [TensorRT] VERBOSE: Tactic: 8257535 Time: 0.371771 [TensorRT] VERBOSE: Tactic: 8323071 Time: 0.384636 [TensorRT] VERBOSE: Tactic: 8650751 Time: 0.420052 [TensorRT] VERBOSE: Tactic: 8716287 Time: 0.585104 [TensorRT] VERBOSE: Tactic: 9109503 Time: 0.432917 [TensorRT] VERBOSE: Tactic: 9568255 Time: 0.357604 [TensorRT] VERBOSE: Tactic: 9895935 Time: 0.370625 [TensorRT] VERBOSE: Tactic: 10223615 Time: 0.3675 [TensorRT] VERBOSE: Tactic: 10354687 Time: 0.379167 [TensorRT] VERBOSE: Tactic: 10551295 Time: 0.347552 [TensorRT] VERBOSE: Tactic: 10747903 Time: 0.458645 [TensorRT] VERBOSE: Tactic: 10944511 Time: 0.370677 [TensorRT] VERBOSE: Fastest Tactic: 4521983 Time: 0.305417 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 1.28969 [TensorRT] VERBOSE: Tactic: 1 Time: 0.238334 [TensorRT] VERBOSE: Tactic: 2 Time: 0.954896 [TensorRT] VERBOSE: Tactic: 4 Time: 22.0665 [TensorRT] VERBOSE: Tactic: 5 Time: 1.35448 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.238334 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TensorRT] VERBOSE: Tactic: 1062367460111450758 Time: 0.192553 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TensorRT] VERBOSE: Tactic: 1698681053543049347 Time: 0.163906 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TensorRT] VERBOSE: Tactic: 4501471010995462441 Time: 0.521511 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TensorRT] VERBOSE: Tactic: 5137655947464784826 Time: 0.261927 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TensorRT] VERBOSE: Tactic: 5288347012147084929 Time: 0.520833 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TensorRT] VERBOSE: Tactic: 5326823351883942011 Time: 0.492812 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TensorRT] VERBOSE: Tactic: 5500448035057547314 Time: 0.273125 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TensorRT] VERBOSE: Tactic: 6645123197870846056 Time: 0.266979 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TensorRT] VERBOSE: Tactic: 7144526460361122478 Time: 0.176094 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TensorRT] VERBOSE: Tactic: -8262349710178828730 Time: 0.523177 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TensorRT] VERBOSE: Tactic: -6576203419454146580 Time: 0.172187 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TensorRT] VERBOSE: Tactic: -4787320710726427159 Time: 0.184792 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TensorRT] VERBOSE: Tactic: -3456450830548107839 Time: 0.178646 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TensorRT] VERBOSE: Tactic: -1218658103698133241 Time: 0.284531 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TensorRT] VERBOSE: Tactic: -836875257600482091 Time: 0.278594 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TensorRT] VERBOSE: Tactic: -410470605513481746 Time: 0.514062 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TensorRT] VERBOSE: Tactic: -377491875521947884 Time: 0.501146 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TensorRT] VERBOSE: Tactic: -37215280111360163 Time: 0.261302 [TensorRT] VERBOSE: Fastest Tactic: 1698681053543049347 Time: 0.163906 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1698681053543049347 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(204800,1,5120,128) -> Float(38400,1,960,24) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TensorRT] VERBOSE: Tactic: 3886731678879822788 Time: 0.273125 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TensorRT] VERBOSE: Tactic: 6629944304117643200 Time: 0.284635 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TensorRT] VERBOSE: Tactic: -9153228964338181824 Time: 0.289115 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TensorRT] VERBOSE: Tactic: -7394439838318485025 Time: 0.273906 [TensorRT] VERBOSE: Fastest Tactic: 3886731678879822788 Time: 0.273125 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(204800,1600,40,1) -> Half(38400,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (CudnnConvolution) [TensorRT] VERBOSE: Tactic: 0 Time: 0.28599 [TensorRT] VERBOSE: Tactic: 1 Time: 0.247917 [TensorRT] VERBOSE: Tactic: 2 Time: 0.953281 [TensorRT] VERBOSE: Tactic: 4 Time: 22.3876 [TensorRT] VERBOSE: Tactic: 5 Time: 1.35026 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.247917 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(102400,1600:2,40,1) -> Half(38400,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(102400,1600:2,40,1) -> Half(19200,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (FusedConvActConvolution) [TensorRT] VERBOSE: Tactic: 589823 Time: 0.174583 [TensorRT] VERBOSE: Tactic: 655359 Time: 0.450729 [TensorRT] VERBOSE: Tactic: 786431 Time: 0.231355 [TensorRT] VERBOSE: Tactic: 851967 Time: 0.623282 [TensorRT] VERBOSE: Tactic: 1179647 Time: 0.315573 [TensorRT] VERBOSE: Tactic: 1310719 Time: 0.303125 [TensorRT] VERBOSE: Tactic: 1376255 Time: 0.206979 [TensorRT] VERBOSE: Tactic: 1441791 Time: 0.381354 [TensorRT] VERBOSE: Tactic: 1507327 Time: 0.548334 [TensorRT] VERBOSE: Tactic: 1638399 Time: 0.216458 [TensorRT] VERBOSE: Tactic: 1835007 Time: 0.228437 [TensorRT] VERBOSE: Tactic: 1900543 Time: 0.499583 [TensorRT] VERBOSE: Tactic: 2097151 Time: 0.311459 [TensorRT] VERBOSE: Tactic: 2162687 Time: 0.228489 [TensorRT] VERBOSE: Tactic: 2293759 Time: 0.238177 [TensorRT] VERBOSE: Tactic: 2359295 Time: 0.259062 [TensorRT] VERBOSE: Tactic: 2686975 Time: 0.333073 [TensorRT] VERBOSE: Tactic: 3080191 Time: 0.54401 [TensorRT] VERBOSE: Tactic: 3342335 Time: 0.546771 [TensorRT] VERBOSE: Tactic: 3407871 Time: 0.255208 [TensorRT] VERBOSE: Tactic: 3538943 Time: 0.28125 [TensorRT] VERBOSE: Tactic: 3670015 Time: 0.380938 [TensorRT] VERBOSE: Tactic: 3932159 Time: 0.392292 [TensorRT] VERBOSE: Tactic: 3997695 Time: 0.246093 [TensorRT] VERBOSE: Tactic: 4063231 Time: 0.67026 [TensorRT] VERBOSE: Tactic: 4194303 Time: 0.223593 [TensorRT] VERBOSE: Tactic: 4259839 Time: 0.259948 [TensorRT] VERBOSE: Tactic: 4325375 Time: 0.193855 [TensorRT] VERBOSE: Tactic: 4521983 Time: 0.186563 [TensorRT] VERBOSE: Tactic: 4587519 Time: 0.260521 [TensorRT] VERBOSE: Tactic: 4653055 Time: 0.430885 [TensorRT] VERBOSE: Tactic: 4915199 Time: 0.226093 [TensorRT] VERBOSE: Tactic: 4980735 Time: 0.200468 [TensorRT] VERBOSE: Tactic: 5177343 Time: 0.312605 [TensorRT] VERBOSE: Tactic: 5242879 Time: 0.250209 [TensorRT] VERBOSE: Tactic: 5373951 Time: 0.328907 [TensorRT] VERBOSE: Tactic: 5439487 Time: 0.30375 [TensorRT] VERBOSE: Tactic: 5570559 Time: 0.570052 [TensorRT] VERBOSE: Tactic: 5636095 Time: 0.672188 [TensorRT] VERBOSE: Tactic: 5701631 Time: 0.210104 [TensorRT] VERBOSE: Tactic: 5767167 Time: 0.572344 [TensorRT] VERBOSE: Tactic: 5832703 Time: 0.234479 [TensorRT] VERBOSE: Tactic: 5898239 Time: 0.382084 [TensorRT] VERBOSE: Tactic: 6029311 Time: 0.242292 [TensorRT] VERBOSE: Tactic: 6225919 Time: 0.27 [TensorRT] VERBOSE: Tactic: 6291455 Time: 0.317084 [TensorRT] VERBOSE: Tactic: 6422527 Time: 0.490885 [TensorRT] VERBOSE: Tactic: 6750207 Time: 0.228646 [TensorRT] VERBOSE: Tactic: 6815743 Time: 0.32026 [TensorRT] VERBOSE: Tactic: 6946815 Time: 0.277448 [TensorRT] VERBOSE: Tactic: 7012351 Time: 0.310521 [TensorRT] VERBOSE: Tactic: 7077887 Time: 0.24948 [TensorRT] VERBOSE: Tactic: 7143423 Time: 0.283334 [TensorRT] VERBOSE: Tactic: 7208959 Time: 0.241719 [TensorRT] VERBOSE: Tactic: 7340031 Time: 0.376875 [TensorRT] VERBOSE: Tactic: 7405567 Time: 0.343906 [TensorRT] VERBOSE: Tactic: 7536639 Time: 0.294375 [TensorRT] VERBOSE: Tactic: 7602175 Time: 0.205364 [TensorRT] VERBOSE: Tactic: 7733247 Time: 0.304218 [TensorRT] VERBOSE: Tactic: 7798783 Time: 0.228854 [TensorRT] VERBOSE: Tactic: 8191999 Time: 0.263437 [TensorRT] VERBOSE: Tactic: 8257535 Time: 0.218802 [TensorRT] VERBOSE: Tactic: 8323071 Time: 0.226354 [TensorRT] VERBOSE: Tactic: 8650751 Time: 0.22349 [TensorRT] VERBOSE: Tactic: 8716287 Time: 0.319011 [TensorRT] VERBOSE: Tactic: 9109503 Time: 0.309792 [TensorRT] VERBOSE: Tactic: 9568255 Time: 0.226979 [TensorRT] VERBOSE: Tactic: 9895935 Time: 0.224843 [TensorRT] VERBOSE: Tactic: 10223615 Time: 0.33448 [TensorRT] VERBOSE: Tactic: 10354687 Time: 0.263125 [TensorRT] VERBOSE: Tactic: 10551295 Time: 0.179219 [TensorRT] VERBOSE: Tactic: 10747903 Time: 0.298698 [TensorRT] VERBOSE: Tactic: 10944511 Time: 0.19875 [TensorRT] VERBOSE: Fastest Tactic: 589823 Time: 0.174583 [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (CudnnConvolution) [TensorRT] VERBOSE: CudnnConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (CublasConvolution) [TensorRT] VERBOSE: CublasConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd (CaskConvolution) [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TensorRT] VERBOSE: Tactic: 3066127711859985668 Time: 0.112761 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TensorRT] VERBOSE: Tactic: 3564772625446233998 Time: 0.124635 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TensorRT] VERBOSE: Tactic: 5319956359050645452 Time: 0.118646 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TensorRT] VERBOSE: Tactic: 7205456024582378848 Time: 0.173229 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TensorRT] VERBOSE: Tactic: 8163473458334948789 Time: 0.165833 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TensorRT] VERBOSE: Tactic: -4212163711445252890 Time: 0.312344 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TensorRT] VERBOSE: Tactic: -3898373634979201110 Time: 0.317656 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TensorRT] VERBOSE: Tactic: -2409163523992614473 Time: 0.168229 [TensorRT] VERBOSE: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TensorRT] VERBOSE: Tactic: -1716393687483585322 Time: 0.305677 [TensorRT] VERBOSE: Fastest Tactic: 3066127711859985668 Time: 0.112761 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3066127711859985668 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1600,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(204800,1,5120,128) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(204800,1600,40,1) -> Half(102400,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Float(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Float(204800,1,5120,128) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(102400,1600:2,40,1) -> Half(204800,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(204800,1600,40,1) -> Float(38400,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(204800,1,5120,128) -> Float(38400,1,960,24) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(204800,1600,40,1) -> Half(38400,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Half(102400,1600:2,40,1) -> Half(38400,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd (CaskConvolution) [TensorRT] VERBOSE: CaskConvolution has no valid tactics for this config, skipping [TensorRT] VERBOSE: *************** Autotuning format combination: Half(102400,1600:2,40,1) -> Half(19200,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1600,40,1) -> Float(38400,1,960,24) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.184115 [TensorRT] VERBOSE: Tactic: 0 Time: 0.102239 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.102239 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1600,40,1) -> Float(1600,1600:32,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.185104 [TensorRT] VERBOSE: Tactic: 0 Time: 0.203489 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.185104 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1600,40,1) -> Half(38400,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.108906 [TensorRT] VERBOSE: Tactic: 0 Time: 0.073021 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.073021 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1600,40,1) -> Half(19200,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.100521 [TensorRT] VERBOSE: Tactic: 0 Time: 0.058021 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.058021 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1,960,24) -> Float(38400,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.187864 [TensorRT] VERBOSE: Tactic: 0 Time: 0.09401 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.09401 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1,960,24) -> Float(1600,1600:32,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.098177 [TensorRT] VERBOSE: Tactic: 0 Time: 0.268958 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.098177 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1,960,24) -> Half(38400,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.099583 [TensorRT] VERBOSE: Tactic: 0 Time: 0.094948 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.094948 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1,960,24) -> Half(19200,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.099636 [TensorRT] VERBOSE: Tactic: 0 Time: 0.1125 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.099636 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1600,1600:32,40,1) -> Float(38400,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.188594 [TensorRT] VERBOSE: Tactic: 0 Time: 0.109948 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.109948 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1600,1600:32,40,1) -> Float(38400,1,960,24) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.109114 [TensorRT] VERBOSE: Tactic: 0 Time: 0.117656 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.109114 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1600,1600:32,40,1) -> Half(38400,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.100833 [TensorRT] VERBOSE: Tactic: 0 Time: 0.111562 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.100833 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1600,1600:32,40,1) -> Half(19200,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.101458 [TensorRT] VERBOSE: Tactic: 0 Time: 0.130052 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.101458 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,1600,40,1) -> Float(38400,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.110365 [TensorRT] VERBOSE: Tactic: 0 Time: 0.062084 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.062084 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,1600,40,1) -> Float(38400,1,960,24) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.092812 [TensorRT] VERBOSE: Tactic: 0 Time: 0.103854 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.092812 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,1600,40,1) -> Float(1600,1600:32,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.082291 [TensorRT] VERBOSE: Tactic: 0 Time: 0.202812 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.082291 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,1600,40,1) -> Half(19200,1600:2,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.079271 [TensorRT] VERBOSE: Tactic: 0 Time: 0.057812 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.057812 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(19200,1600:2,40,1) -> Float(38400,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.097552 [TensorRT] VERBOSE: Tactic: 0 Time: 0.050156 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.050156 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(19200,1600:2,40,1) -> Float(38400,1,960,24) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.096458 [TensorRT] VERBOSE: Tactic: 0 Time: 0.120729 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.096458 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(19200,1600:2,40,1) -> Float(1600,1600:32,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.086562 [TensorRT] VERBOSE: Tactic: 0 Time: 0.202708 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.086562 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(19200,1600:2,40,1) -> Half(38400,1600,40,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.241979 [TensorRT] VERBOSE: Tactic: 0 Time: 0.049063 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.049063 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(38400,1600,40,1) -> Float(38400,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd__1830 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.097656 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.097656 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(38400,1,960,24) -> Float(1,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd__1830 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.10401 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.10401 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1600,1600:32,40,1) -> Float(38400:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd__1830 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 4.83891 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 4.83891 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(38400,1600,40,1) -> Half(38400,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd__1830 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.089687 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.089687 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(19200,1600:2,40,1) -> Half(38400:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd__1830 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.203593 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.203593 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1600,40,1) -> Float(38400,1,960,24) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1600,40,1) -> Float(1600,1600:32,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1600,40,1) -> Half(38400,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1600,40,1) -> Half(19200,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1,960,24) -> Float(38400,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1,960,24) -> Float(1600,1600:32,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1,960,24) -> Half(38400,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,1,960,24) -> Half(19200,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1600,1600:32,40,1) -> Float(38400,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1600,1600:32,40,1) -> Float(38400,1,960,24) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1600,1600:32,40,1) -> Half(38400,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1600,1600:32,40,1) -> Half(19200,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,1600,40,1) -> Float(38400,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,1600,40,1) -> Float(38400,1,960,24) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,1600,40,1) -> Float(1600,1600:32,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,1600,40,1) -> Half(19200,1600:2,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(19200,1600:2,40,1) -> Float(38400,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(19200,1600:2,40,1) -> Float(38400,1,960,24) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(19200,1600:2,40,1) -> Float(1600,1600:32,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(19200,1600:2,40,1) -> Half(38400,1600,40,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(38400,1600,40,1) -> Float(38400,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd__1807 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.097552 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.097552 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(38400,1,960,24) -> Float(1,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd__1807 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.104063 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.104063 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(1600,1600:32,40,1) -> Float(38400:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd__1807 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 4.89589 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 4.89589 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(38400,1600,40,1) -> Half(38400,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd__1807 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.088386 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.088386 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(19200,1600:2,40,1) -> Half(38400:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd__1807 + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape + StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1 (Shuffle) [TensorRT] VERBOSE: Tactic: 0 Time: 0.202968 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.202968 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.087812 [TensorRT] VERBOSE: Tactic: 0 Time: 0.094219 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.087812 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,4,1) -> Float(51216:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 3.97828 [TensorRT] VERBOSE: Tactic: 0 Time: 0.16849 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.16849 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,4,1) -> Half(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.086197 [TensorRT] VERBOSE: Tactic: 0 Time: 0.096094 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.086197 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,4,1) -> Half(51216:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.488386 [TensorRT] VERBOSE: Tactic: 0 Time: 0.114011 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.114011 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.102865 [TensorRT] VERBOSE: Tactic: 0 Time: 0.094166 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.094166 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1,4,1) -> Float(51216:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.26307 [TensorRT] VERBOSE: Tactic: 0 Time: 0.166875 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.166875 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1,4,1) -> Half(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.102917 [TensorRT] VERBOSE: Tactic: 0 Time: 0.094114 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.094114 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1,4,1) -> Half(51216:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.233594 [TensorRT] VERBOSE: Tactic: 0 Time: 0.113021 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.113021 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400:32,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 3.97229 [TensorRT] VERBOSE: Tactic: 0 Time: 0.136511 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.136511 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400:32,4,1) -> Float(51216:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.42714 [TensorRT] VERBOSE: Tactic: 0 Time: 0.276459 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.276459 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400:32,4,1) -> Half(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.99156 [TensorRT] VERBOSE: Tactic: 0 Time: 0.135052 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.135052 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400:32,4,1) -> Half(51216:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.235938 [TensorRT] VERBOSE: Tactic: 0 Time: 0.141823 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.141823 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.087917 [TensorRT] VERBOSE: Tactic: 0 Time: 0.096458 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.087917 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,4,1) -> Float(51216:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.91792 [TensorRT] VERBOSE: Tactic: 0 Time: 0.169844 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.169844 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,4,1) -> Half(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.065417 [TensorRT] VERBOSE: Tactic: 0 Time: 0.084375 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.065417 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,4,1) -> Half(51216:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.180104 [TensorRT] VERBOSE: Tactic: 0 Time: 0.100416 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.100416 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400:2,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.95453 [TensorRT] VERBOSE: Tactic: 0 Time: 0.112084 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.112084 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400:2,4,1) -> Float(51216:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.87661 [TensorRT] VERBOSE: Tactic: 0 Time: 0.169844 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.169844 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400:2,4,1) -> Half(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 5.10208 [TensorRT] VERBOSE: Tactic: 0 Time: 0.102448 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.102448 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400:2,4,1) -> Half(51216:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.89776 [TensorRT] VERBOSE: Tactic: 0 Time: 0.121198 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.121198 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(9600,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.028489 [TensorRT] VERBOSE: Tactic: 0 Time: 0.028073 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.028073 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(9600,4,1) -> Float(51216:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.997292 [TensorRT] VERBOSE: Tactic: 0 Time: 0.046771 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.046771 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(9600,4,1) -> Half(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.026146 [TensorRT] VERBOSE: Tactic: 0 Time: 0.028021 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.026146 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(9600,4,1) -> Half(51216:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.128437 [TensorRT] VERBOSE: Tactic: 0 Time: 0.03401 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.03401 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.03125 [TensorRT] VERBOSE: Tactic: 0 Time: 0.028021 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.028021 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1,4,1) -> Float(51216:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.569271 [TensorRT] VERBOSE: Tactic: 0 Time: 0.047032 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.047032 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1,4,1) -> Half(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.031562 [TensorRT] VERBOSE: Tactic: 0 Time: 0.028021 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.028021 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1,4,1) -> Half(51216:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.063385 [TensorRT] VERBOSE: Tactic: 0 Time: 0.031823 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.031823 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(9600:32,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.997552 [TensorRT] VERBOSE: Tactic: 0 Time: 0.039895 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.039895 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(9600:32,4,1) -> Float(51216:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.6125 [TensorRT] VERBOSE: Tactic: 0 Time: 0.074792 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.074792 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(9600:32,4,1) -> Half(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.503385 [TensorRT] VERBOSE: Tactic: 0 Time: 0.039583 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.039583 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(9600:32,4,1) -> Half(51216:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.065625 [TensorRT] VERBOSE: Tactic: 0 Time: 0.045157 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.045157 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(9600,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.028437 [TensorRT] VERBOSE: Tactic: 0 Time: 0.027969 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.027969 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(9600,4,1) -> Float(51216:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.484063 [TensorRT] VERBOSE: Tactic: 0 Time: 0.046719 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.046719 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(9600,4,1) -> Half(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.023073 [TensorRT] VERBOSE: Tactic: 0 Time: 0.025209 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.023073 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(9600,4,1) -> Half(51216:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.052344 [TensorRT] VERBOSE: Tactic: 0 Time: 0.031302 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.031302 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(9600:2,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.494271 [TensorRT] VERBOSE: Tactic: 0 Time: 0.031823 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.031823 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(9600:2,4,1) -> Float(51216:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.474792 [TensorRT] VERBOSE: Tactic: 0 Time: 0.049271 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.049271 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(9600:2,4,1) -> Half(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.28177 [TensorRT] VERBOSE: Tactic: 0 Time: 0.030938 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.030938 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(9600:2,4,1) -> Half(51216:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_1:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.478958 [TensorRT] VERBOSE: Tactic: 0 Time: 0.033906 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.033906 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2400,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.013489 [TensorRT] VERBOSE: Tactic: 0 Time: 0.010365 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.010365 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2400,4,1) -> Float(51216:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.259062 [TensorRT] VERBOSE: Tactic: 0 Time: 0.017136 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.017136 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2400,4,1) -> Half(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.013854 [TensorRT] VERBOSE: Tactic: 0 Time: 0.010313 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.010313 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2400,4,1) -> Half(51216:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.037135 [TensorRT] VERBOSE: Tactic: 0 Time: 0.013229 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.013229 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.01625 [TensorRT] VERBOSE: Tactic: 0 Time: 0.010313 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.010313 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1,4,1) -> Float(51216:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.148542 [TensorRT] VERBOSE: Tactic: 0 Time: 0.017656 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.017656 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1,4,1) -> Half(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.01349 [TensorRT] VERBOSE: Tactic: 0 Time: 0.010417 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.010417 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1,4,1) -> Half(51216:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.022136 [TensorRT] VERBOSE: Tactic: 0 Time: 0.013177 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.013177 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2400:32,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.256719 [TensorRT] VERBOSE: Tactic: 0 Time: 0.017292 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.017292 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2400:32,4,1) -> Float(51216:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.160521 [TensorRT] VERBOSE: Tactic: 0 Time: 0.025156 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.025156 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2400:32,4,1) -> Half(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.132083 [TensorRT] VERBOSE: Tactic: 0 Time: 0.016875 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.016875 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2400:32,4,1) -> Half(51216:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.022812 [TensorRT] VERBOSE: Tactic: 0 Time: 0.01776 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.01776 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(2400,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.013385 [TensorRT] VERBOSE: Tactic: 0 Time: 0.010469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.010469 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(2400,4,1) -> Float(51216:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.128281 [TensorRT] VERBOSE: Tactic: 0 Time: 0.01776 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.01776 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(2400,4,1) -> Half(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.013333 [TensorRT] VERBOSE: Tactic: 0 Time: 0.010208 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.010208 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(2400,4,1) -> Half(51216:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.019271 [TensorRT] VERBOSE: Tactic: 0 Time: 0.013177 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.013177 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(2400:2,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.128802 [TensorRT] VERBOSE: Tactic: 0 Time: 0.013281 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.013281 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(2400:2,4,1) -> Float(51216:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.124427 [TensorRT] VERBOSE: Tactic: 0 Time: 0.01724 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.01724 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(2400:2,4,1) -> Half(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.327916 [TensorRT] VERBOSE: Tactic: 0 Time: 0.013125 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.013125 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(2400:2,4,1) -> Half(51216:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_2:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.125365 [TensorRT] VERBOSE: Tactic: 0 Time: 0.013177 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.013177 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(600,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.010416 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007343 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007343 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(600,4,1) -> Float(51216:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.075104 [TensorRT] VERBOSE: Tactic: 0 Time: 0.01026 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.01026 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(600,4,1) -> Half(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.010677 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007292 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007292 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(600,4,1) -> Half(51216:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.016198 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007344 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007344 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.01052 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007291 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007291 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1,4,1) -> Float(51216:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.048854 [TensorRT] VERBOSE: Tactic: 0 Time: 0.010365 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.010365 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1,4,1) -> Half(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.010625 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007292 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007292 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1,4,1) -> Half(51216:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.013229 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007292 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007292 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(600:32,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.075364 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007396 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007396 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(600:32,4,1) -> Float(51216:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.049896 [TensorRT] VERBOSE: Tactic: 0 Time: 0.010209 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.010209 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(600:32,4,1) -> Half(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.03802 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007396 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007396 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(600:32,4,1) -> Half(51216:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.016094 [TensorRT] VERBOSE: Tactic: 0 Time: 0.010208 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.010208 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(600,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.01026 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007344 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007344 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(600,4,1) -> Float(51216:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.037291 [TensorRT] VERBOSE: Tactic: 0 Time: 0.010312 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.010312 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(600,4,1) -> Half(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.01349 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007292 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007292 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(600,4,1) -> Half(51216:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.016146 [TensorRT] VERBOSE: Tactic: 0 Time: 0.00724 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00724 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(600:2,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.037032 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007291 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007291 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(600:2,4,1) -> Float(51216:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.036823 [TensorRT] VERBOSE: Tactic: 0 Time: 0.010261 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.010261 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(600:2,4,1) -> Half(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.089687 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007343 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007343 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(600:2,4,1) -> Half(51216:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_3:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.03677 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007292 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007292 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(216,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.028073 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007292 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007292 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(216,4,1) -> Float(51216:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.040156 [TensorRT] VERBOSE: Tactic: 0 Time: 0.03125 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.03125 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(216,4,1) -> Half(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.017083 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007448 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007448 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(216,4,1) -> Half(51216:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.013177 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007344 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007344 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.031146 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007292 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007292 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1,4,1) -> Float(51216:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.025104 [TensorRT] VERBOSE: Tactic: 0 Time: 0.031302 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.025104 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1,4,1) -> Half(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.019739 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007292 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007292 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1,4,1) -> Half(51216:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.013177 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007291 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007291 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(216:32,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.039791 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007239 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007239 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(216:32,4,1) -> Float(51216:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.025156 [TensorRT] VERBOSE: Tactic: 0 Time: 0.034166 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.025156 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(216:32,4,1) -> Half(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.019739 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007292 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007292 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(216:32,4,1) -> Half(51216:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.013178 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007239 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007239 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(216,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.016146 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007292 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007292 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(216,4,1) -> Float(51216:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.016667 [TensorRT] VERBOSE: Tactic: 0 Time: 0.031302 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.016667 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(216,4,1) -> Half(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.016302 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007343 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007343 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(216,4,1) -> Half(51216:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.016094 [TensorRT] VERBOSE: Tactic: 0 Time: 0.00724 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00724 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(216:2,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.019115 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007292 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007292 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(216:2,4,1) -> Float(51216:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.019115 [TensorRT] VERBOSE: Tactic: 0 Time: 0.031198 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.019115 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(216:2,4,1) -> Half(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.038698 [TensorRT] VERBOSE: Tactic: 0 Time: 0.00724 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00724 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(216:2,4,1) -> Half(51216:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/Reshape_4:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.019271 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007291 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007291 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.088594 [TensorRT] VERBOSE: Tactic: 0 Time: 0.094792 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.088594 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.102813 [TensorRT] VERBOSE: Tactic: 0 Time: 0.095261 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.095261 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38400:32,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 3.98271 [TensorRT] VERBOSE: Tactic: 0 Time: 0.135572 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.135572 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.087917 [TensorRT] VERBOSE: Tactic: 0 Time: 0.096146 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.087917 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38400:2,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_1:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 1.95292 [TensorRT] VERBOSE: Tactic: 0 Time: 0.112709 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.112709 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(9600,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.028489 [TensorRT] VERBOSE: Tactic: 0 Time: 0.028073 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.028073 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.031406 [TensorRT] VERBOSE: Tactic: 0 Time: 0.028125 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.028125 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(9600:32,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.996093 [TensorRT] VERBOSE: Tactic: 0 Time: 0.040729 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.040729 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(9600,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.028438 [TensorRT] VERBOSE: Tactic: 0 Time: 0.028021 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.028021 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(9600:2,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_3:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.494427 [TensorRT] VERBOSE: Tactic: 0 Time: 0.031198 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.031198 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2400,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_5:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.013386 [TensorRT] VERBOSE: Tactic: 0 Time: 0.010468 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.010468 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_5:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.014062 [TensorRT] VERBOSE: Tactic: 0 Time: 0.010364 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.010364 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(2400:32,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_5:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.258854 [TensorRT] VERBOSE: Tactic: 0 Time: 0.017031 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.017031 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(2400,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_5:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.013281 [TensorRT] VERBOSE: Tactic: 0 Time: 0.010521 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.010521 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(2400:2,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_5:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.129427 [TensorRT] VERBOSE: Tactic: 0 Time: 0.013229 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.013229 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(600,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_7:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.010312 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007291 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007291 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_7:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.010677 [TensorRT] VERBOSE: Tactic: 0 Time: 0.00724 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00724 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(600:32,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_7:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.075156 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007344 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007344 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(600,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_7:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.010312 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007343 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007343 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(600:2,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_7:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.037292 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007291 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007291 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(216,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_9:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.028125 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007292 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007292 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(1,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_9:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.031302 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007239 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007239 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(216:32,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_9:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.039843 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007343 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007343 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(216,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_9:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.016093 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007292 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007292 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(216:2,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/Reshape_9:0 copy (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.019114 [TensorRT] VERBOSE: Tactic: 0 Time: 0.007292 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.007292 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning format combination: -> Float(4,4,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: -> Half(4,4,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51216,4,1) -> Float(51216:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 5.6788 [TensorRT] VERBOSE: Tactic: 0 Time: 6.55115 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 5.6788 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51216,4,1) -> Half(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.115 [TensorRT] VERBOSE: Tactic: 0 Time: 0.096198 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.096198 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51216,4,1) -> Half(51216:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.686615 [TensorRT] VERBOSE: Tactic: 0 Time: 0.147031 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.147031 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51216:32,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 5.30401 [TensorRT] VERBOSE: Tactic: 0 Time: 0.18 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.18 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51216:32,4,1) -> Half(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.65177 [TensorRT] VERBOSE: Tactic: 0 Time: 0.175521 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.175521 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51216:32,4,1) -> Half(51216:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.328594 [TensorRT] VERBOSE: Tactic: 0 Time: 0.296927 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.296927 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51216,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.116771 [TensorRT] VERBOSE: Tactic: 0 Time: 0.08125 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.08125 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51216,4,1) -> Float(51216:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.39141 [TensorRT] VERBOSE: Tactic: 0 Time: 6.53729 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 2.39141 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51216,4,1) -> Half(51216:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.261041 [TensorRT] VERBOSE: Tactic: 0 Time: 0.145105 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.145105 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51216:2,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.6038 [TensorRT] VERBOSE: Tactic: 0 Time: 0.057917 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.057917 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51216:2,4,1) -> Float(51216:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 2.06891 [TensorRT] VERBOSE: Tactic: 0 Time: 5.94672 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 2.06891 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51216:2,4,1) -> Half(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 6.04203 [TensorRT] VERBOSE: Tactic: 0 Time: 0.057083 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.057083 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(4,4,1) -> Float(4:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.018125 [TensorRT] VERBOSE: Tactic: 0 Time: 0.006771 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006771 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(4,4,1) -> Half(4,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.009792 [TensorRT] VERBOSE: Tactic: 0 Time: 0.006719 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006719 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(4,4,1) -> Half(4:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.012396 [TensorRT] VERBOSE: Tactic: 0 Time: 0.006666 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006666 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(4:32,4,1) -> Float(4,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.018438 [TensorRT] VERBOSE: Tactic: 0 Time: 0.006771 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006771 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(4:32,4,1) -> Half(4,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.012396 [TensorRT] VERBOSE: Tactic: 0 Time: 0.006771 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006771 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(4:32,4,1) -> Half(4:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.012291 [TensorRT] VERBOSE: Tactic: 0 Time: 0.00677 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00677 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(4,4,1) -> Float(4,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.012343 [TensorRT] VERBOSE: Tactic: 0 Time: 0.006667 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006667 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(4,4,1) -> Float(4:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.012344 [TensorRT] VERBOSE: Tactic: 0 Time: 0.006771 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006771 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(4,4,1) -> Half(4:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.015156 [TensorRT] VERBOSE: Tactic: 0 Time: 0.006666 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006666 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(4:2,4,1) -> Float(4,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.01224 [TensorRT] VERBOSE: Tactic: 0 Time: 0.006719 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.006719 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(4:2,4,1) -> Float(4:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.012604 [TensorRT] VERBOSE: Tactic: 0 Time: 0.00677 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.00677 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(4:2,4,1) -> Half(4,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.015312 [TensorRT] VERBOSE: Tactic: 0 Time: 0.004167 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.004167 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51216,4,1), Float(4,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/scale (ElementWise) [TensorRT] VERBOSE: Tactic: 1 Time: 0.075261 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.075261 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51216:32,4,1), Float(4:32,4,1) -> Float(51216:32,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/scale (ElementWise) [TensorRT] VERBOSE: Tactic: 1 Time: 2.19958 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 2.19958 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(51216,4,1), Half(4,4,1) -> Half(51216,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/scale (ElementWise) [TensorRT] VERBOSE: Tactic: 1 Time: 0.035677 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.035677 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning format combination: Half(51216:2,4,1), Half(4:2,4,1) -> Half(51216:2,4,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/scale (ElementWise) [TensorRT] VERBOSE: Tactic: 1 Time: 0.064375 [TensorRT] VERBOSE: Fastest Tactic: 1 Time: 0.064375 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 1 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51216,4,1) -> Float(38412,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/slicer (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.937552 [TensorRT] VERBOSE: Tactic: 0 Time: 0.087864 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.087864 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51216,4,1) -> Half(38412,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/slicer (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.057083 [TensorRT] VERBOSE: Tactic: 0 Time: 0.087709 [TensorRT] VERBOSE: Fastest Tactic: 1002 Time: 0.057083 [TensorRT] VERBOSE: >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 1002 [TensorRT] VERBOSE: *************** Autotuning format combination: -> Float(51216,4,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: -> Half(51216,4,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51216,4,1) -> Half(51216,4,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51216:32,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51216:32,4,1) -> Half(51216,4,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51216,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51216:2,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51216:2,4,1) -> Half(51216,4,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(38412,3,1) -> Half(38412,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.076459 [TensorRT] VERBOSE: Tactic: 0 Time: 0.064583 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.064583 [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(38412,3,1) -> Float(38412,3,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: Optimizer Reformat (Reformat) [TensorRT] VERBOSE: Tactic: 1002 Time: 0.078542 [TensorRT] VERBOSE: Tactic: 0 Time: 0.055469 [TensorRT] VERBOSE: Fastest Tactic: 0 Time: 0.055469 [TensorRT] VERBOSE: *************** Autotuning Reformat:Float(51216,4,1) -> Half(51216,4,1) *************** [TensorRT] VERBOSE: *************** Autotuning Reformat:Half(51216,4,1) -> Float(51216,4,1) *************** [TensorRT] VERBOSE: *************** Autotuning format combination: Float(51216,4,1), Float(38412,3,1), Float(51216,4,1) -> Int32(1,1), Float(400,4,1), Float(100,1), Int32(100,1) *************** [TensorRT] VERBOSE: --------------- Timing Runner: nms/non_maximum_suppression (PluginV2) [TensorRT] VERBOSE: Deleting timing cache: 916 entries, 1828 hits [TensorRT] INFO: [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +0, now: CPU 904, GPU 1824 (MiB) [TensorRT] ERROR: 2: [pluginV2DynamicExtRunner.cpp::execute::115] Error Code 2: Internal Error (Assertion status == kSTATUS_SUCCESS failed.) Traceback (most recent call last): File "build_engine.py", line 259, in main(args) File "build_engine.py", line 231, in main args.calib_batch_size) File "build_engine.py", line 222, in create_engine with self.builder.build_engine(self.network, self.config) as engine, open(engine_path, "wb") as f: AttributeError: __enter__