&&&& FAILED TensorRT.trtexec # ./trtexec --onnx=/home/sesa/target/model.onnx --explicitBatch --verbose --workspace=1024 --exportTimes=trace.json --savedEngine=/home/sesa/target/model.trt &&&& RUNNING TensorRT.trtexec # ./trtexec --onnx=/home/sesa/target/model.onnx --explicitBatch --verbose --workspace=1024 --exportTimes=trace.json --saveEngine=/home/sesa/target/model.trt [04/19/2021-12:43:19] [I] === Model Options === [04/19/2021-12:43:19] [I] Format: ONNX [04/19/2021-12:43:19] [I] Model: /home/sesa/target/model.onnx [04/19/2021-12:43:19] [I] Output: [04/19/2021-12:43:19] [I] === Build Options === [04/19/2021-12:43:19] [I] Max batch: explicit [04/19/2021-12:43:19] [I] Workspace: 1024 MB [04/19/2021-12:43:19] [I] minTiming: 1 [04/19/2021-12:43:19] [I] avgTiming: 8 [04/19/2021-12:43:19] [I] Precision: FP32 [04/19/2021-12:43:19] [I] Calibration: [04/19/2021-12:43:19] [I] Safe mode: Disabled [04/19/2021-12:43:19] [I] Save engine: /home/sesa/target/model.trt [04/19/2021-12:43:19] [I] Load engine: [04/19/2021-12:43:19] [I] Builder Cache: Enabled [04/19/2021-12:43:19] [I] NVTX verbosity: 0 [04/19/2021-12:43:19] [I] Inputs format: fp32:CHW [04/19/2021-12:43:19] [I] Outputs format: fp32:CHW [04/19/2021-12:43:19] [I] Input build shapes: model [04/19/2021-12:43:19] [I] Input calibration shapes: model [04/19/2021-12:43:19] [I] === System Options === [04/19/2021-12:43:19] [I] Device: 0 [04/19/2021-12:43:19] [I] DLACore: [04/19/2021-12:43:19] [I] Plugins: [04/19/2021-12:43:19] [I] === Inference Options === [04/19/2021-12:43:19] [I] Batch: Explicit [04/19/2021-12:43:19] [I] Input inference shapes: model [04/19/2021-12:43:19] [I] Iterations: 10 [04/19/2021-12:43:19] [I] Duration: 3s (+ 200ms warm up) [04/19/2021-12:43:19] [I] Sleep time: 0ms [04/19/2021-12:43:19] [I] Streams: 1 [04/19/2021-12:43:19] [I] ExposeDMA: Disabled [04/19/2021-12:43:19] [I] Spin-wait: Disabled [04/19/2021-12:43:19] [I] Multithreading: Disabled [04/19/2021-12:43:19] [I] CUDA Graph: Disabled [04/19/2021-12:43:19] [I] Skip inference: Disabled [04/19/2021-12:43:19] [I] Inputs: [04/19/2021-12:43:19] [I] === Reporting Options === [04/19/2021-12:43:19] [I] Verbose: Enabled [04/19/2021-12:43:19] [I] Averages: 10 inferences [04/19/2021-12:43:19] [I] Percentile: 99 [04/19/2021-12:43:19] [I] Dump output: Disabled [04/19/2021-12:43:19] [I] Profile: Disabled [04/19/2021-12:43:19] [I] Export timing to JSON file: trace.json [04/19/2021-12:43:19] [I] Export output to JSON file: [04/19/2021-12:43:19] [I] Export profile to JSON file: [04/19/2021-12:43:19] [I] [04/19/2021-12:43:19] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1 [04/19/2021-12:43:19] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1 [04/19/2021-12:43:19] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1 [04/19/2021-12:43:19] [V] [TRT] Registered plugin creator - ::Region_TRT version 1 [04/19/2021-12:43:19] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1 [04/19/2021-12:43:19] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1 [04/19/2021-12:43:19] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1 [04/19/2021-12:43:19] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1 [04/19/2021-12:43:19] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1 [04/19/2021-12:43:19] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1 [04/19/2021-12:43:19] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1 [04/19/2021-12:43:19] [V] [TRT] Registered plugin creator - ::CropAndResize version 1 [04/19/2021-12:43:19] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1 [04/19/2021-12:43:19] [V] [TRT] Registered plugin creator - ::Proposal version 1 [04/19/2021-12:43:19] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1 [04/19/2021-12:43:19] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1 [04/19/2021-12:43:19] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1 [04/19/2021-12:43:19] [V] [TRT] Registered plugin creator - ::Split version 1 [04/19/2021-12:43:19] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1 [04/19/2021-12:43:19] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1 [04/19/2021-12:43:48] [04/19/2021-12:43:48] [04/19/2021-12:43:48] [04/19/2021-12:43:48] &&&& FAILED TensorRT.trtexec # ./trtexec --onnx=/home/sesa/target/model.onnx --explicitBatch --verbose --workspace=1024 --exportTimes=trace.json --saveEngine=/home/sesa/target/model.trt &&&& RUNNING TensorRT.trtexec # ./trtexec --onnx=/home/sesa/model.onnx --explicitBatch --verbose --workspace=1024 --exportTimes=trace.json --saveEngine=/home/sesa/target/model.trt [04/19/2021-12:44:17] [I] === Model Options === [04/19/2021-12:44:17] [I] Format: ONNX [04/19/2021-12:44:17] [I] Model: /home/sesa/model.onnx [04/19/2021-12:44:17] [I] Output: [04/19/2021-12:44:17] [I] === Build Options === [04/19/2021-12:44:17] [I] Max batch: explicit [04/19/2021-12:44:17] [I] Workspace: 1024 MB [04/19/2021-12:44:17] [I] minTiming: 1 [04/19/2021-12:44:17] [I] avgTiming: 8 [04/19/2021-12:44:17] [I] Precision: FP32 [04/19/2021-12:44:17] [I] Calibration: [04/19/2021-12:44:17] [I] Safe mode: Disabled [04/19/2021-12:44:17] [I] Save engine: /home/sesa/target/model.trt [04/19/2021-12:44:17] [I] Load engine: [04/19/2021-12:44:17] [I] Builder Cache: Enabled [04/19/2021-12:44:17] [I] NVTX verbosity: 0 [04/19/2021-12:44:17] [I] Inputs format: fp32:CHW [04/19/2021-12:44:17] [I] Outputs format: fp32:CHW [04/19/2021-12:44:17] [I] Input build shapes: model [04/19/2021-12:44:17] [I] Input calibration shapes: model [04/19/2021-12:44:17] [I] === System Options === [04/19/2021-12:44:17] [I] Device: 0 [04/19/2021-12:44:17] [I] DLACore: [04/19/2021-12:44:17] [I] Plugins: [04/19/2021-12:44:17] [I] === Inference Options === [04/19/2021-12:44:17] [I] Batch: Explicit [04/19/2021-12:44:17] [I] Input inference shapes: model [04/19/2021-12:44:17] [I] Iterations: 10 [04/19/2021-12:44:17] [I] Duration: 3s (+ 200ms warm up) [04/19/2021-12:44:17] [I] Sleep time: 0ms [04/19/2021-12:44:17] [I] Streams: 1 [04/19/2021-12:44:17] [I] ExposeDMA: Disabled [04/19/2021-12:44:17] [I] Spin-wait: Disabled [04/19/2021-12:44:17] [I] Multithreading: Disabled [04/19/2021-12:44:17] [I] CUDA Graph: Disabled [04/19/2021-12:44:17] [I] Skip inference: Disabled [04/19/2021-12:44:17] [I] Inputs: [04/19/2021-12:44:17] [I] === Reporting Options === [04/19/2021-12:44:17] [I] Verbose: Enabled [04/19/2021-12:44:17] [I] Averages: 10 inferences [04/19/2021-12:44:17] [I] Percentile: 99 [04/19/2021-12:44:17] [I] Dump output: Disabled [04/19/2021-12:44:17] [I] Profile: Disabled [04/19/2021-12:44:17] [I] Export timing to JSON file: trace.json [04/19/2021-12:44:17] [I] Export output to JSON file: [04/19/2021-12:44:17] [I] Export profile to JSON file: [04/19/2021-12:44:17] [I] [04/19/2021-12:44:17] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1 [04/19/2021-12:44:17] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1 [04/19/2021-12:44:17] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1 [04/19/2021-12:44:17] [V] [TRT] Registered plugin creator - ::Region_TRT version 1 [04/19/2021-12:44:17] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1 [04/19/2021-12:44:17] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1 [04/19/2021-12:44:17] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1 [04/19/2021-12:44:17] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1 [04/19/2021-12:44:17] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1 [04/19/2021-12:44:17] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1 [04/19/2021-12:44:17] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1 [04/19/2021-12:44:17] [V] [TRT] Registered plugin creator - ::CropAndResize version 1 [04/19/2021-12:44:17] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1 [04/19/2021-12:44:17] [V] [TRT] Registered plugin creator - ::Proposal version 1 [04/19/2021-12:44:17] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1 [04/19/2021-12:44:17] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1 [04/19/2021-12:44:17] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1 [04/19/2021-12:44:17] [V] [TRT] Registered plugin creator - ::Split version 1 [04/19/2021-12:44:17] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1 [04/19/2021-12:44:17] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1 ---------------------------------------------------------------- Input filename: /home/sesa/model.onnx ONNX IR version: 0.0.7 Opset version: 13 Producer name: tf2onnx Producer version: 1.8.4 Domain: Model version: 0 Doc string: ---------------------------------------------------------------- [04/19/2021-12:44:19] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT version 1 [04/19/2021-12:44:19] [V] [TRT] Plugin creator already registered - ::NMS_TRT version 1 [04/19/2021-12:44:19] [V] [TRT] Plugin creator already registered - ::Reorg_TRT version 1 [04/19/2021-12:44:19] [V] [TRT] Plugin creator already registered - ::Region_TRT version 1 [04/19/2021-12:44:19] [V] [TRT] Plugin creator already registered - ::Clip_TRT version 1 [04/19/2021-12:44:19] [V] [TRT] Plugin creator already registered - ::LReLU_TRT version 1 [04/19/2021-12:44:19] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT version 1 [04/19/2021-12:44:19] [V] [TRT] Plugin creator already registered - ::Normalize_TRT version 1 [04/19/2021-12:44:19] [V] [TRT] Plugin creator already registered - ::RPROI_TRT version 1 [04/19/2021-12:44:19] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT version 1 [04/19/2021-12:44:19] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT version 1 [04/19/2021-12:44:19] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1 [04/19/2021-12:44:19] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT version 1 [04/19/2021-12:44:19] [V] [TRT] Plugin creator already registered - ::Proposal version 1 [04/19/2021-12:44:19] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT version 1 [04/19/2021-12:44:19] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT version 1 [04/19/2021-12:44:19] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT version 1 [04/19/2021-12:44:19] [V] [TRT] Plugin creator already registered - ::Split version 1 [04/19/2021-12:44:19] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT version 1 [04/19/2021-12:44:19] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 1 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:202: Adding network input: input_1:0 with dtype: float32, dimensions: (1, 224, 224, 3) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: input_1:0 for ONNX tensor: input_1:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: new_shape__509 [04/19/2021-12:44:19] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: new_shape__507 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: new_shape__506 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: new_shape__504 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: new_shape__499 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: new_shape__498 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: new_shape__495 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: const_fold_opt__540 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: const_fold_opt__538 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: const_fold_opt__526 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: const_fold_opt__525 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: const_fold_opt__520 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: const_fold_opt__513 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: const_fold_opt__511 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/top_bn/ReadVariableOp_1:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/top_bn/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/top_bn/FusedBatchNormV3/ReadVariableOp_1:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/top_bn/FusedBatchNormV3/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/probs/MatMul/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/probs/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block7a_se_expand/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block7a_se_expand/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block7a_project_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block7a_project_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block7a_expand_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block7a_expand_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6d_se_expand/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6d_se_expand/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6d_project_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6d_project_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6d_expand_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6d_expand_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6d_dwconv/depthwise_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6d_dwconv/depthwise_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6c_se_expand/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6c_se_expand/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6c_project_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6c_project_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6c_expand_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6c_expand_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6c_dwconv/depthwise_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6c_dwconv/depthwise_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6b_expand_bn/ReadVariableOp_1:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6b_expand_bn/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6b_expand_bn/FusedBatchNormV3/ReadVariableOp_1:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6b_expand_bn/FusedBatchNormV3/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6b_dwconv/depthwise_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6b_dwconv/depthwise_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6a_se_expand/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6a_se_expand/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6a_project_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6a_project_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6a_expand_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6a_expand_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6a_dwconv/depthwise_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block6a_dwconv/depthwise_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block5c_se_expand/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block5c_se_expand/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block5c_project_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block5c_project_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block5c_expand_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block5c_expand_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block5c_dwconv/depthwise_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block5c_dwconv/depthwise_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block5b_expand_bn/ReadVariableOp_1:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block5b_expand_bn/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block5b_expand_bn/FusedBatchNormV3/ReadVariableOp_1:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block5b_expand_bn/FusedBatchNormV3/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block5b_dwconv/depthwise_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block5b_dwconv/depthwise_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block5a_se_expand/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block5a_se_expand/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block5a_expand_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block5a_expand_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block5a_dwconv/depthwise_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block5a_dwconv/depthwise_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block4c_se_expand/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block4c_se_expand/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block4c_project_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block4c_project_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block4c_expand_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block4c_expand_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block4c_dwconv/depthwise_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block4c_dwconv/depthwise_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block4b_expand_bn/ReadVariableOp_1:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block4b_expand_bn/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block4b_expand_bn/FusedBatchNormV3/ReadVariableOp_1:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block4b_expand_bn/FusedBatchNormV3/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block4a_se_expand/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block4a_se_expand/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block4a_expand_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block4a_expand_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block4a_dwconv/depthwise_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block4a_dwconv/depthwise_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block3b_expand_bn/ReadVariableOp_1:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block3b_expand_bn/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block3b_expand_bn/FusedBatchNormV3/ReadVariableOp_1:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block3b_expand_bn/FusedBatchNormV3/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block3b_dwconv/depthwise_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block3b_dwconv/depthwise_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block3a_se_expand/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block3a_se_expand/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block3a_expand_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block3a_expand_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block3a_dwconv/depthwise_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block3a_dwconv/depthwise_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block2b_expand_bn/ReadVariableOp_1:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block2b_expand_bn/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block2b_expand_bn/FusedBatchNormV3/ReadVariableOp_1:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block2b_expand_bn/FusedBatchNormV3/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block2a_expand_bn/ReadVariableOp_1:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block2a_expand_bn/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block2a_expand_bn/FusedBatchNormV3/ReadVariableOp_1:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block2a_expand_bn/FusedBatchNormV3/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block2a_dwconv/depthwise_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block2a_dwconv/depthwise_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:90: Importing initializer: StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D__23 [Transpose] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: input_1:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D__23 [Transpose] inputs: [input_1:0 -> (1, 224, 224, 3)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D__23 for ONNX node: StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D__23 [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D__23:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D__23:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D__23 [Transpose] outputs: [StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D__23:0 -> (1, 3, 224, 224)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D__23:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D__23:0 -> (1, 3, 224, 224)], [StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D_weights_fused_bn -> (32, 3, 3, 3)], [StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D_bias_fused_bn -> (32)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 3, 224, 224) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D for ONNX node: StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (2, 2), prepadding: (0, 0), postpadding: (1, 1), dilations: (1, 1), numOutputs: 32 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 32, 112, 112) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/stem_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/stem_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/stem_bn/FusedBatchNormV3:0 -> (1, 32, 112, 112)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/stem_activation/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/stem_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/stem_activation/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/stem_bn/FusedBatchNormV3:0 -> (1, 32, 112, 112)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/stem_activation/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/stem_activation/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/stem_activation/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/stem_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/stem_activation/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/stem_activation/Sigmoid:0 -> (1, 32, 112, 112)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/stem_activation/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/stem_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/stem_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/stem_activation/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/stem_bn/FusedBatchNormV3:0 -> (1, 32, 112, 112)], [StatefulPartitionedCall/efficientnet-b0/stem_activation/Sigmoid:0 -> (1, 32, 112, 112)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/stem_activation/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/stem_activation/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/stem_activation/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/stem_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/stem_activation/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/stem_activation/mul:0 -> (1, 32, 112, 112)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/stem_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/stem_activation/mul:0 -> (1, 32, 112, 112)], [StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise_weights_fused_bn -> (32, 1, 3, 3)], [StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise_bias_fused_bn -> (32)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 32, 112, 112) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise for ONNX node: StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 32 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 32, 112, 112) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block1a_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block1a_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block1a_bn/FusedBatchNormV3:0 -> (1, 32, 112, 112)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block1a_activation/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block1a_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block1a_activation/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block1a_bn/FusedBatchNormV3:0 -> (1, 32, 112, 112)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block1a_activation/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block1a_activation/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block1a_activation/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block1a_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block1a_activation/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block1a_activation/Sigmoid:0 -> (1, 32, 112, 112)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block1a_activation/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block1a_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block1a_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block1a_activation/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block1a_bn/FusedBatchNormV3:0 -> (1, 32, 112, 112)], [StatefulPartitionedCall/efficientnet-b0/block1a_activation/Sigmoid:0 -> (1, 32, 112, 112)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block1a_activation/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block1a_activation/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block1a_activation/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block1a_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block1a_activation/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block1a_activation/mul:0 -> (1, 32, 112, 112)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block1a_se_squeeze/Mean [ReduceMean] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block1a_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block1a_se_squeeze/Mean [ReduceMean] inputs: [StatefulPartitionedCall/efficientnet-b0/block1a_activation/mul:0 -> (1, 32, 112, 112)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block1a_se_squeeze/Mean for ONNX node: StatefulPartitionedCall/efficientnet-b0/block1a_se_squeeze/Mean [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block1a_se_squeeze/Mean:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block1a_se_squeeze/Mean:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block1a_se_squeeze/Mean [ReduceMean] outputs: [StatefulPartitionedCall/efficientnet-b0/block1a_se_squeeze/Mean:0 -> (1, 32)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block1a_se_reshape/Reshape [Reshape] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block1a_se_squeeze/Mean:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__526 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block1a_se_reshape/Reshape [Reshape] inputs: [StatefulPartitionedCall/efficientnet-b0/block1a_se_squeeze/Mean:0 -> (1, 32)], [const_fold_opt__526 -> (4)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block1a_se_reshape/Reshape for ONNX node: StatefulPartitionedCall/efficientnet-b0/block1a_se_reshape/Reshape [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block1a_se_reshape/Reshape:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block1a_se_reshape/Reshape:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block1a_se_reshape/Reshape [Reshape] outputs: [StatefulPartitionedCall/efficientnet-b0/block1a_se_reshape/Reshape:0 -> (1, 1, 1, 32)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd__35 [Reshape] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block1a_se_reshape/Reshape:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: new_shape__498 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd__35 [Reshape] inputs: [StatefulPartitionedCall/efficientnet-b0/block1a_se_reshape/Reshape:0 -> (1, 1, 1, 32)], [new_shape__498 -> (4)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd__35 for ONNX node: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd__35 [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd__35:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd__35:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd__35 [Reshape] outputs: [StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd__35:0 -> (1, 32, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd__35:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd__35:0 -> (1, 32, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/Conv2D/ReadVariableOp:0 -> (8, 32, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd/ReadVariableOp:0 -> (8)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 32, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd for ONNX node: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 8 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 8, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd:0 -> (1, 8, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd:0 -> (1, 8, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/Sigmoid:0 -> (1, 8, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd:0 -> (1, 8, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/Sigmoid:0 -> (1, 8, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/mul:0 -> (1, 8, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/mul:0 -> (1, 8, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/Conv2D/ReadVariableOp:0 -> (32, 8, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd/ReadVariableOp:0 -> (32)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 8, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd for ONNX node: StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 32 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 32, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd:0 -> (1, 32, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd:0 -> (1, 32, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/Sigmoid:0 -> (1, 32, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block1a_se_excite/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block1a_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block1a_se_excite/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block1a_activation/mul:0 -> (1, 32, 112, 112)], [StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/Sigmoid:0 -> (1, 32, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block1a_se_excite/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block1a_se_excite/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block1a_se_excite/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block1a_se_excite/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block1a_se_excite/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block1a_se_excite/mul:0 -> (1, 32, 112, 112)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block1a_se_excite/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block1a_se_excite/mul:0 -> (1, 32, 112, 112)], [StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D_weights_fused_bn -> (16, 32, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D_bias_fused_bn -> (16)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 32, 112, 112) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D for ONNX node: StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 16 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 16, 112, 112) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block1a_project_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block1a_project_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block1a_project_bn/FusedBatchNormV3:0 -> (1, 16, 112, 112)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block1a_project_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block1a_project_bn/FusedBatchNormV3:0 -> (1, 16, 112, 112)], [StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D/ReadVariableOp:0 -> (96, 16, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 16, 112, 112) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D for ONNX node: StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 96 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 96, 112, 112) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D:0 -> (1, 96, 112, 112)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block2a_expand_bn/FusedBatchNormV3 [BatchNormalization] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2a_expand_bn/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2a_expand_bn/ReadVariableOp_1:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2a_expand_bn/FusedBatchNormV3/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2a_expand_bn/FusedBatchNormV3/ReadVariableOp_1:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block2a_expand_bn/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D:0 -> (1, 96, 112, 112)], [StatefulPartitionedCall/efficientnet-b0/block2a_expand_bn/ReadVariableOp:0 -> (96)], [StatefulPartitionedCall/efficientnet-b0/block2a_expand_bn/ReadVariableOp_1:0 -> (96)], [StatefulPartitionedCall/efficientnet-b0/block2a_expand_bn/FusedBatchNormV3/ReadVariableOp:0 -> (96)], [StatefulPartitionedCall/efficientnet-b0/block2a_expand_bn/FusedBatchNormV3/ReadVariableOp_1:0 -> (96)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block2a_expand_bn/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/efficientnet-b0/block2a_expand_bn/FusedBatchNormV3 [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block2a_expand_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block2a_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block2a_expand_bn/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/efficientnet-b0/block2a_expand_bn/FusedBatchNormV3:0 -> (1, 96, 112, 112)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block2a_expand_activation/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2a_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block2a_expand_activation/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block2a_expand_bn/FusedBatchNormV3:0 -> (1, 96, 112, 112)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block2a_expand_activation/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block2a_expand_activation/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block2a_expand_activation/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block2a_expand_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block2a_expand_activation/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block2a_expand_activation/Sigmoid:0 -> (1, 96, 112, 112)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block2a_expand_activation/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2a_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2a_expand_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block2a_expand_activation/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block2a_expand_bn/FusedBatchNormV3:0 -> (1, 96, 112, 112)], [StatefulPartitionedCall/efficientnet-b0/block2a_expand_activation/Sigmoid:0 -> (1, 96, 112, 112)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block2a_expand_activation/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block2a_expand_activation/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block2a_expand_activation/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block2a_expand_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block2a_expand_activation/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block2a_expand_activation/mul:0 -> (1, 96, 112, 112)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block2a_dwconv/depthwise [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2a_expand_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2a_dwconv/depthwise_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2a_dwconv/depthwise_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block2a_dwconv/depthwise [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block2a_expand_activation/mul:0 -> (1, 96, 112, 112)], [StatefulPartitionedCall/efficientnet-b0/block2a_dwconv/depthwise_weights_fused_bn -> (96, 1, 3, 3)], [StatefulPartitionedCall/efficientnet-b0/block2a_dwconv/depthwise_bias_fused_bn -> (96)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 96, 112, 112) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block2a_dwconv/depthwise for ONNX node: StatefulPartitionedCall/efficientnet-b0/block2a_dwconv/depthwise [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (2, 2), prepadding: (0, 0), postpadding: (1, 1), dilations: (1, 1), numOutputs: 96 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 96, 56, 56) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block2a_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block2a_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block2a_dwconv/depthwise [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block2a_bn/FusedBatchNormV3:0 -> (1, 96, 56, 56)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block2a_activation/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2a_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block2a_activation/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block2a_bn/FusedBatchNormV3:0 -> (1, 96, 56, 56)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block2a_activation/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block2a_activation/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block2a_activation/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block2a_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block2a_activation/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block2a_activation/Sigmoid:0 -> (1, 96, 56, 56)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block2a_activation/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2a_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2a_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block2a_activation/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block2a_bn/FusedBatchNormV3:0 -> (1, 96, 56, 56)], [StatefulPartitionedCall/efficientnet-b0/block2a_activation/Sigmoid:0 -> (1, 96, 56, 56)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block2a_activation/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block2a_activation/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block2a_activation/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block2a_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block2a_activation/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block2a_activation/mul:0 -> (1, 96, 56, 56)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block2a_se_squeeze/Mean [ReduceMean] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2a_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block2a_se_squeeze/Mean [ReduceMean] inputs: [StatefulPartitionedCall/efficientnet-b0/block2a_activation/mul:0 -> (1, 96, 56, 56)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block2a_se_squeeze/Mean for ONNX node: StatefulPartitionedCall/efficientnet-b0/block2a_se_squeeze/Mean [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block2a_se_squeeze/Mean:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block2a_se_squeeze/Mean:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block2a_se_squeeze/Mean [ReduceMean] outputs: [StatefulPartitionedCall/efficientnet-b0/block2a_se_squeeze/Mean:0 -> (1, 96)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block2a_se_reshape/Reshape [Reshape] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2a_se_squeeze/Mean:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__520 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block2a_se_reshape/Reshape [Reshape] inputs: [StatefulPartitionedCall/efficientnet-b0/block2a_se_squeeze/Mean:0 -> (1, 96)], [const_fold_opt__520 -> (4)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block2a_se_reshape/Reshape for ONNX node: StatefulPartitionedCall/efficientnet-b0/block2a_se_reshape/Reshape [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block2a_se_reshape/Reshape:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block2a_se_reshape/Reshape:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block2a_se_reshape/Reshape [Reshape] outputs: [StatefulPartitionedCall/efficientnet-b0/block2a_se_reshape/Reshape:0 -> (1, 1, 1, 96)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd__55 [Reshape] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2a_se_reshape/Reshape:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: new_shape__506 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd__55 [Reshape] inputs: [StatefulPartitionedCall/efficientnet-b0/block2a_se_reshape/Reshape:0 -> (1, 1, 1, 96)], [new_shape__506 -> (4)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd__55 for ONNX node: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd__55 [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd__55:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd__55:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd__55 [Reshape] outputs: [StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd__55:0 -> (1, 96, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd__55:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd__55:0 -> (1, 96, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/Conv2D/ReadVariableOp:0 -> (4, 96, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd/ReadVariableOp:0 -> (4)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 96, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd for ONNX node: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 4 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 4, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd:0 -> (1, 4, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd:0 -> (1, 4, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/Sigmoid:0 -> (1, 4, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd:0 -> (1, 4, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/Sigmoid:0 -> (1, 4, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/mul:0 -> (1, 4, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/mul:0 -> (1, 4, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/Conv2D/ReadVariableOp:0 -> (96, 4, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd/ReadVariableOp:0 -> (96)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 4, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd for ONNX node: StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 96 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 96, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd:0 -> (1, 96, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd:0 -> (1, 96, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/Sigmoid:0 -> (1, 96, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block2a_se_excite/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2a_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block2a_se_excite/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block2a_activation/mul:0 -> (1, 96, 56, 56)], [StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/Sigmoid:0 -> (1, 96, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block2a_se_excite/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block2a_se_excite/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block2a_se_excite/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block2a_se_excite/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block2a_se_excite/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block2a_se_excite/mul:0 -> (1, 96, 56, 56)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2a_se_excite/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block2a_se_excite/mul:0 -> (1, 96, 56, 56)], [StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D_weights_fused_bn -> (24, 96, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D_bias_fused_bn -> (24)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 96, 56, 56) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D for ONNX node: StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 24 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 24, 56, 56) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block2a_project_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block2a_project_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block2a_project_bn/FusedBatchNormV3:0 -> (1, 24, 56, 56)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2a_project_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block2a_project_bn/FusedBatchNormV3:0 -> (1, 24, 56, 56)], [StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D/ReadVariableOp:0 -> (144, 24, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 24, 56, 56) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D for ONNX node: StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 144 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 144, 56, 56) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D:0 -> (1, 144, 56, 56)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block2b_expand_bn/FusedBatchNormV3 [BatchNormalization] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2b_expand_bn/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2b_expand_bn/ReadVariableOp_1:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2b_expand_bn/FusedBatchNormV3/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2b_expand_bn/FusedBatchNormV3/ReadVariableOp_1:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block2b_expand_bn/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D:0 -> (1, 144, 56, 56)], [StatefulPartitionedCall/efficientnet-b0/block2b_expand_bn/ReadVariableOp:0 -> (144)], [StatefulPartitionedCall/efficientnet-b0/block2b_expand_bn/ReadVariableOp_1:0 -> (144)], [StatefulPartitionedCall/efficientnet-b0/block2b_expand_bn/FusedBatchNormV3/ReadVariableOp:0 -> (144)], [StatefulPartitionedCall/efficientnet-b0/block2b_expand_bn/FusedBatchNormV3/ReadVariableOp_1:0 -> (144)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block2b_expand_bn/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/efficientnet-b0/block2b_expand_bn/FusedBatchNormV3 [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block2b_expand_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block2b_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block2b_expand_bn/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/efficientnet-b0/block2b_expand_bn/FusedBatchNormV3:0 -> (1, 144, 56, 56)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block2b_expand_activation/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2b_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block2b_expand_activation/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block2b_expand_bn/FusedBatchNormV3:0 -> (1, 144, 56, 56)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block2b_expand_activation/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block2b_expand_activation/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block2b_expand_activation/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block2b_expand_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block2b_expand_activation/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block2b_expand_activation/Sigmoid:0 -> (1, 144, 56, 56)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block2b_expand_activation/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2b_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2b_expand_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block2b_expand_activation/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block2b_expand_bn/FusedBatchNormV3:0 -> (1, 144, 56, 56)], [StatefulPartitionedCall/efficientnet-b0/block2b_expand_activation/Sigmoid:0 -> (1, 144, 56, 56)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block2b_expand_activation/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block2b_expand_activation/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block2b_expand_activation/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block2b_expand_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block2b_expand_activation/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block2b_expand_activation/mul:0 -> (1, 144, 56, 56)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2b_expand_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block2b_expand_activation/mul:0 -> (1, 144, 56, 56)], [StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise_weights_fused_bn -> (144, 1, 3, 3)], [StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise_bias_fused_bn -> (144)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 144, 56, 56) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise for ONNX node: StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 144 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 144, 56, 56) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block2b_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block2b_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block2b_bn/FusedBatchNormV3:0 -> (1, 144, 56, 56)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block2b_activation/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2b_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block2b_activation/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block2b_bn/FusedBatchNormV3:0 -> (1, 144, 56, 56)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block2b_activation/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block2b_activation/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block2b_activation/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block2b_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block2b_activation/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block2b_activation/Sigmoid:0 -> (1, 144, 56, 56)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block2b_activation/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2b_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2b_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block2b_activation/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block2b_bn/FusedBatchNormV3:0 -> (1, 144, 56, 56)], [StatefulPartitionedCall/efficientnet-b0/block2b_activation/Sigmoid:0 -> (1, 144, 56, 56)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block2b_activation/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block2b_activation/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block2b_activation/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block2b_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block2b_activation/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block2b_activation/mul:0 -> (1, 144, 56, 56)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block2b_se_squeeze/Mean [ReduceMean] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2b_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block2b_se_squeeze/Mean [ReduceMean] inputs: [StatefulPartitionedCall/efficientnet-b0/block2b_activation/mul:0 -> (1, 144, 56, 56)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block2b_se_squeeze/Mean for ONNX node: StatefulPartitionedCall/efficientnet-b0/block2b_se_squeeze/Mean [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block2b_se_squeeze/Mean:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block2b_se_squeeze/Mean:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block2b_se_squeeze/Mean [ReduceMean] outputs: [StatefulPartitionedCall/efficientnet-b0/block2b_se_squeeze/Mean:0 -> (1, 144)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block2b_se_reshape/Reshape [Reshape] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2b_se_squeeze/Mean:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__538 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block2b_se_reshape/Reshape [Reshape] inputs: [StatefulPartitionedCall/efficientnet-b0/block2b_se_squeeze/Mean:0 -> (1, 144)], [const_fold_opt__538 -> (4)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block2b_se_reshape/Reshape for ONNX node: StatefulPartitionedCall/efficientnet-b0/block2b_se_reshape/Reshape [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block2b_se_reshape/Reshape:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block2b_se_reshape/Reshape:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block2b_se_reshape/Reshape [Reshape] outputs: [StatefulPartitionedCall/efficientnet-b0/block2b_se_reshape/Reshape:0 -> (1, 1, 1, 144)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd__75 [Reshape] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2b_se_reshape/Reshape:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: new_shape__507 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd__75 [Reshape] inputs: [StatefulPartitionedCall/efficientnet-b0/block2b_se_reshape/Reshape:0 -> (1, 1, 1, 144)], [new_shape__507 -> (4)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd__75 for ONNX node: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd__75 [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd__75:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd__75:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd__75 [Reshape] outputs: [StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd__75:0 -> (1, 144, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd__75:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd__75:0 -> (1, 144, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/Conv2D/ReadVariableOp:0 -> (6, 144, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd/ReadVariableOp:0 -> (6)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 144, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd for ONNX node: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 6 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 6, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd:0 -> (1, 6, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd:0 -> (1, 6, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/Sigmoid:0 -> (1, 6, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd:0 -> (1, 6, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/Sigmoid:0 -> (1, 6, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/mul:0 -> (1, 6, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/mul:0 -> (1, 6, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/Conv2D/ReadVariableOp:0 -> (144, 6, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd/ReadVariableOp:0 -> (144)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 6, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd for ONNX node: StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 144 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 144, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd:0 -> (1, 144, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd:0 -> (1, 144, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/Sigmoid:0 -> (1, 144, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block2b_se_excite/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2b_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block2b_se_excite/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block2b_activation/mul:0 -> (1, 144, 56, 56)], [StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/Sigmoid:0 -> (1, 144, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block2b_se_excite/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block2b_se_excite/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block2b_se_excite/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block2b_se_excite/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block2b_se_excite/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block2b_se_excite/mul:0 -> (1, 144, 56, 56)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2b_se_excite/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block2b_se_excite/mul:0 -> (1, 144, 56, 56)], [StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D_weights_fused_bn -> (24, 144, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D_bias_fused_bn -> (24)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 144, 56, 56) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D for ONNX node: StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 24 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 24, 56, 56) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block2b_project_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block2b_project_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block2b_project_bn/FusedBatchNormV3:0 -> (1, 24, 56, 56)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block2b_add/add [Add] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2b_project_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2a_project_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block2b_add/add [Add] inputs: [StatefulPartitionedCall/efficientnet-b0/block2b_project_bn/FusedBatchNormV3:0 -> (1, 24, 56, 56)], [StatefulPartitionedCall/efficientnet-b0/block2a_project_bn/FusedBatchNormV3:0 -> (1, 24, 56, 56)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block2b_add/add for ONNX node: StatefulPartitionedCall/efficientnet-b0/block2b_add/add [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block2b_add/add:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block2b_add/add:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block2b_add/add [Add] outputs: [StatefulPartitionedCall/efficientnet-b0/block2b_add/add:0 -> (1, 24, 56, 56)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block3a_expand_conv/Conv2D [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block2b_add/add:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3a_expand_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3a_expand_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block3a_expand_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block2b_add/add:0 -> (1, 24, 56, 56)], [StatefulPartitionedCall/efficientnet-b0/block3a_expand_conv/Conv2D_weights_fused_bn -> (144, 24, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block3a_expand_conv/Conv2D_bias_fused_bn -> (144)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 24, 56, 56) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block3a_expand_conv/Conv2D for ONNX node: StatefulPartitionedCall/efficientnet-b0/block3a_expand_conv/Conv2D [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 144 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 144, 56, 56) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block3a_expand_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block3a_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block3a_expand_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block3a_expand_bn/FusedBatchNormV3:0 -> (1, 144, 56, 56)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block3a_expand_activation/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3a_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block3a_expand_activation/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block3a_expand_bn/FusedBatchNormV3:0 -> (1, 144, 56, 56)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block3a_expand_activation/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block3a_expand_activation/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block3a_expand_activation/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block3a_expand_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block3a_expand_activation/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block3a_expand_activation/Sigmoid:0 -> (1, 144, 56, 56)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block3a_expand_activation/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3a_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3a_expand_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block3a_expand_activation/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block3a_expand_bn/FusedBatchNormV3:0 -> (1, 144, 56, 56)], [StatefulPartitionedCall/efficientnet-b0/block3a_expand_activation/Sigmoid:0 -> (1, 144, 56, 56)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block3a_expand_activation/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block3a_expand_activation/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block3a_expand_activation/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block3a_expand_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block3a_expand_activation/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block3a_expand_activation/mul:0 -> (1, 144, 56, 56)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block3a_dwconv/depthwise [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3a_expand_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3a_dwconv/depthwise_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3a_dwconv/depthwise_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block3a_dwconv/depthwise [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block3a_expand_activation/mul:0 -> (1, 144, 56, 56)], [StatefulPartitionedCall/efficientnet-b0/block3a_dwconv/depthwise_weights_fused_bn -> (144, 1, 5, 5)], [StatefulPartitionedCall/efficientnet-b0/block3a_dwconv/depthwise_bias_fused_bn -> (144)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 144, 56, 56) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block3a_dwconv/depthwise for ONNX node: StatefulPartitionedCall/efficientnet-b0/block3a_dwconv/depthwise [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (5, 5), strides: (2, 2), prepadding: (1, 1), postpadding: (2, 2), dilations: (1, 1), numOutputs: 144 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 144, 28, 28) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block3a_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block3a_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block3a_dwconv/depthwise [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block3a_bn/FusedBatchNormV3:0 -> (1, 144, 28, 28)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block3a_activation/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3a_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block3a_activation/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block3a_bn/FusedBatchNormV3:0 -> (1, 144, 28, 28)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block3a_activation/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block3a_activation/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block3a_activation/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block3a_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block3a_activation/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block3a_activation/Sigmoid:0 -> (1, 144, 28, 28)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block3a_activation/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3a_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3a_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block3a_activation/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block3a_bn/FusedBatchNormV3:0 -> (1, 144, 28, 28)], [StatefulPartitionedCall/efficientnet-b0/block3a_activation/Sigmoid:0 -> (1, 144, 28, 28)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block3a_activation/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block3a_activation/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block3a_activation/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block3a_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block3a_activation/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block3a_activation/mul:0 -> (1, 144, 28, 28)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block3a_se_squeeze/Mean [ReduceMean] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3a_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block3a_se_squeeze/Mean [ReduceMean] inputs: [StatefulPartitionedCall/efficientnet-b0/block3a_activation/mul:0 -> (1, 144, 28, 28)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block3a_se_squeeze/Mean for ONNX node: StatefulPartitionedCall/efficientnet-b0/block3a_se_squeeze/Mean [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block3a_se_squeeze/Mean:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block3a_se_squeeze/Mean:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block3a_se_squeeze/Mean [ReduceMean] outputs: [StatefulPartitionedCall/efficientnet-b0/block3a_se_squeeze/Mean:0 -> (1, 144)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block3a_se_reshape/Reshape [Reshape] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3a_se_squeeze/Mean:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__538 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block3a_se_reshape/Reshape [Reshape] inputs: [StatefulPartitionedCall/efficientnet-b0/block3a_se_squeeze/Mean:0 -> (1, 144)], [const_fold_opt__538 -> (4)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block3a_se_reshape/Reshape for ONNX node: StatefulPartitionedCall/efficientnet-b0/block3a_se_reshape/Reshape [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block3a_se_reshape/Reshape:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block3a_se_reshape/Reshape:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block3a_se_reshape/Reshape [Reshape] outputs: [StatefulPartitionedCall/efficientnet-b0/block3a_se_reshape/Reshape:0 -> (1, 1, 1, 144)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/BiasAdd__95 [Reshape] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3a_se_reshape/Reshape:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: new_shape__507 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/BiasAdd__95 [Reshape] inputs: [StatefulPartitionedCall/efficientnet-b0/block3a_se_reshape/Reshape:0 -> (1, 1, 1, 144)], [new_shape__507 -> (4)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/BiasAdd__95 for ONNX node: StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/BiasAdd__95 [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/BiasAdd__95:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/BiasAdd__95:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/BiasAdd__95 [Reshape] outputs: [StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/BiasAdd__95:0 -> (1, 144, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/BiasAdd [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/BiasAdd__95:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/BiasAdd [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/BiasAdd__95:0 -> (1, 144, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/Conv2D/ReadVariableOp:0 -> (6, 144, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/BiasAdd/ReadVariableOp:0 -> (6)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 144, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/BiasAdd for ONNX node: StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/BiasAdd [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 6 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 6, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/BiasAdd [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/BiasAdd:0 -> (1, 6, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/BiasAdd:0 -> (1, 6, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/Sigmoid:0 -> (1, 6, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/BiasAdd:0 -> (1, 6, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/Sigmoid:0 -> (1, 6, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/mul:0 -> (1, 6, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block3a_se_expand/BiasAdd [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3a_se_expand/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3a_se_expand/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block3a_se_expand/BiasAdd [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/mul:0 -> (1, 6, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block3a_se_expand/Conv2D/ReadVariableOp:0 -> (144, 6, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block3a_se_expand/BiasAdd/ReadVariableOp:0 -> (144)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 6, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block3a_se_expand/BiasAdd for ONNX node: StatefulPartitionedCall/efficientnet-b0/block3a_se_expand/BiasAdd [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 144 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 144, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block3a_se_expand/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block3a_se_expand/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block3a_se_expand/BiasAdd [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block3a_se_expand/BiasAdd:0 -> (1, 144, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block3a_se_expand/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3a_se_expand/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block3a_se_expand/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block3a_se_expand/BiasAdd:0 -> (1, 144, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block3a_se_expand/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block3a_se_expand/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block3a_se_expand/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block3a_se_expand/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block3a_se_expand/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block3a_se_expand/Sigmoid:0 -> (1, 144, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block3a_se_excite/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3a_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3a_se_expand/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block3a_se_excite/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block3a_activation/mul:0 -> (1, 144, 28, 28)], [StatefulPartitionedCall/efficientnet-b0/block3a_se_expand/Sigmoid:0 -> (1, 144, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block3a_se_excite/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block3a_se_excite/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block3a_se_excite/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block3a_se_excite/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block3a_se_excite/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block3a_se_excite/mul:0 -> (1, 144, 28, 28)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3a_se_excite/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block3a_se_excite/mul:0 -> (1, 144, 28, 28)], [StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D_weights_fused_bn -> (40, 144, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D_bias_fused_bn -> (40)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 144, 28, 28) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D for ONNX node: StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 40 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 40, 28, 28) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block3a_project_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block3a_project_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block3a_project_bn/FusedBatchNormV3:0 -> (1, 40, 28, 28)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3a_project_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block3a_project_bn/FusedBatchNormV3:0 -> (1, 40, 28, 28)], [StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D/ReadVariableOp:0 -> (240, 40, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 40, 28, 28) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D for ONNX node: StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 240 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 240, 28, 28) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D:0 -> (1, 240, 28, 28)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block3b_expand_bn/FusedBatchNormV3 [BatchNormalization] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3b_expand_bn/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3b_expand_bn/ReadVariableOp_1:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3b_expand_bn/FusedBatchNormV3/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3b_expand_bn/FusedBatchNormV3/ReadVariableOp_1:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block3b_expand_bn/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D:0 -> (1, 240, 28, 28)], [StatefulPartitionedCall/efficientnet-b0/block3b_expand_bn/ReadVariableOp:0 -> (240)], [StatefulPartitionedCall/efficientnet-b0/block3b_expand_bn/ReadVariableOp_1:0 -> (240)], [StatefulPartitionedCall/efficientnet-b0/block3b_expand_bn/FusedBatchNormV3/ReadVariableOp:0 -> (240)], [StatefulPartitionedCall/efficientnet-b0/block3b_expand_bn/FusedBatchNormV3/ReadVariableOp_1:0 -> (240)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block3b_expand_bn/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/efficientnet-b0/block3b_expand_bn/FusedBatchNormV3 [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block3b_expand_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block3b_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block3b_expand_bn/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/efficientnet-b0/block3b_expand_bn/FusedBatchNormV3:0 -> (1, 240, 28, 28)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block3b_expand_activation/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3b_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block3b_expand_activation/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block3b_expand_bn/FusedBatchNormV3:0 -> (1, 240, 28, 28)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block3b_expand_activation/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block3b_expand_activation/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block3b_expand_activation/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block3b_expand_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block3b_expand_activation/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block3b_expand_activation/Sigmoid:0 -> (1, 240, 28, 28)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block3b_expand_activation/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3b_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3b_expand_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block3b_expand_activation/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block3b_expand_bn/FusedBatchNormV3:0 -> (1, 240, 28, 28)], [StatefulPartitionedCall/efficientnet-b0/block3b_expand_activation/Sigmoid:0 -> (1, 240, 28, 28)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block3b_expand_activation/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block3b_expand_activation/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block3b_expand_activation/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block3b_expand_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block3b_expand_activation/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block3b_expand_activation/mul:0 -> (1, 240, 28, 28)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block3b_dwconv/depthwise [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3b_expand_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3b_dwconv/depthwise_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3b_dwconv/depthwise_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block3b_dwconv/depthwise [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block3b_expand_activation/mul:0 -> (1, 240, 28, 28)], [StatefulPartitionedCall/efficientnet-b0/block3b_dwconv/depthwise_weights_fused_bn -> (240, 1, 5, 5)], [StatefulPartitionedCall/efficientnet-b0/block3b_dwconv/depthwise_bias_fused_bn -> (240)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 240, 28, 28) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block3b_dwconv/depthwise for ONNX node: StatefulPartitionedCall/efficientnet-b0/block3b_dwconv/depthwise [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (5, 5), strides: (1, 1), prepadding: (2, 2), postpadding: (2, 2), dilations: (1, 1), numOutputs: 240 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 240, 28, 28) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block3b_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block3b_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block3b_dwconv/depthwise [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block3b_bn/FusedBatchNormV3:0 -> (1, 240, 28, 28)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block3b_activation/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3b_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block3b_activation/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block3b_bn/FusedBatchNormV3:0 -> (1, 240, 28, 28)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block3b_activation/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block3b_activation/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block3b_activation/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block3b_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block3b_activation/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block3b_activation/Sigmoid:0 -> (1, 240, 28, 28)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block3b_activation/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3b_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3b_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block3b_activation/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block3b_bn/FusedBatchNormV3:0 -> (1, 240, 28, 28)], [StatefulPartitionedCall/efficientnet-b0/block3b_activation/Sigmoid:0 -> (1, 240, 28, 28)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block3b_activation/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block3b_activation/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block3b_activation/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block3b_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block3b_activation/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block3b_activation/mul:0 -> (1, 240, 28, 28)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block3b_se_squeeze/Mean [ReduceMean] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3b_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block3b_se_squeeze/Mean [ReduceMean] inputs: [StatefulPartitionedCall/efficientnet-b0/block3b_activation/mul:0 -> (1, 240, 28, 28)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block3b_se_squeeze/Mean for ONNX node: StatefulPartitionedCall/efficientnet-b0/block3b_se_squeeze/Mean [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block3b_se_squeeze/Mean:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block3b_se_squeeze/Mean:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block3b_se_squeeze/Mean [ReduceMean] outputs: [StatefulPartitionedCall/efficientnet-b0/block3b_se_squeeze/Mean:0 -> (1, 240)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block3b_se_reshape/Reshape [Reshape] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3b_se_squeeze/Mean:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__540 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block3b_se_reshape/Reshape [Reshape] inputs: [StatefulPartitionedCall/efficientnet-b0/block3b_se_squeeze/Mean:0 -> (1, 240)], [const_fold_opt__540 -> (4)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block3b_se_reshape/Reshape for ONNX node: StatefulPartitionedCall/efficientnet-b0/block3b_se_reshape/Reshape [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block3b_se_reshape/Reshape:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block3b_se_reshape/Reshape:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block3b_se_reshape/Reshape [Reshape] outputs: [StatefulPartitionedCall/efficientnet-b0/block3b_se_reshape/Reshape:0 -> (1, 1, 1, 240)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd__115 [Reshape] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3b_se_reshape/Reshape:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: new_shape__504 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd__115 [Reshape] inputs: [StatefulPartitionedCall/efficientnet-b0/block3b_se_reshape/Reshape:0 -> (1, 1, 1, 240)], [new_shape__504 -> (4)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd__115 for ONNX node: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd__115 [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd__115:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd__115:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd__115 [Reshape] outputs: [StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd__115:0 -> (1, 240, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd__115:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd__115:0 -> (1, 240, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/Conv2D/ReadVariableOp:0 -> (10, 240, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd/ReadVariableOp:0 -> (10)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 240, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd for ONNX node: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 10 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 10, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd:0 -> (1, 10, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd:0 -> (1, 10, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/Sigmoid:0 -> (1, 10, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd:0 -> (1, 10, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/Sigmoid:0 -> (1, 10, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/mul:0 -> (1, 10, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/mul:0 -> (1, 10, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/Conv2D/ReadVariableOp:0 -> (240, 10, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd/ReadVariableOp:0 -> (240)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 10, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd for ONNX node: StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 240 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 240, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd:0 -> (1, 240, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd:0 -> (1, 240, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/Sigmoid:0 -> (1, 240, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block3b_se_excite/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3b_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block3b_se_excite/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block3b_activation/mul:0 -> (1, 240, 28, 28)], [StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/Sigmoid:0 -> (1, 240, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block3b_se_excite/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block3b_se_excite/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block3b_se_excite/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block3b_se_excite/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block3b_se_excite/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block3b_se_excite/mul:0 -> (1, 240, 28, 28)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3b_se_excite/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block3b_se_excite/mul:0 -> (1, 240, 28, 28)], [StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D_weights_fused_bn -> (40, 240, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D_bias_fused_bn -> (40)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 240, 28, 28) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D for ONNX node: StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 40 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 40, 28, 28) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block3b_project_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block3b_project_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block3b_project_bn/FusedBatchNormV3:0 -> (1, 40, 28, 28)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block3b_add/add [Add] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3b_project_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3a_project_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block3b_add/add [Add] inputs: [StatefulPartitionedCall/efficientnet-b0/block3b_project_bn/FusedBatchNormV3:0 -> (1, 40, 28, 28)], [StatefulPartitionedCall/efficientnet-b0/block3a_project_bn/FusedBatchNormV3:0 -> (1, 40, 28, 28)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block3b_add/add for ONNX node: StatefulPartitionedCall/efficientnet-b0/block3b_add/add [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block3b_add/add:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block3b_add/add:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block3b_add/add [Add] outputs: [StatefulPartitionedCall/efficientnet-b0/block3b_add/add:0 -> (1, 40, 28, 28)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4a_expand_conv/Conv2D [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block3b_add/add:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4a_expand_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4a_expand_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4a_expand_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block3b_add/add:0 -> (1, 40, 28, 28)], [StatefulPartitionedCall/efficientnet-b0/block4a_expand_conv/Conv2D_weights_fused_bn -> (240, 40, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block4a_expand_conv/Conv2D_bias_fused_bn -> (240)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 40, 28, 28) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4a_expand_conv/Conv2D for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4a_expand_conv/Conv2D [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 240 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 240, 28, 28) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4a_expand_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4a_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4a_expand_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block4a_expand_bn/FusedBatchNormV3:0 -> (1, 240, 28, 28)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4a_expand_activation/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4a_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4a_expand_activation/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block4a_expand_bn/FusedBatchNormV3:0 -> (1, 240, 28, 28)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4a_expand_activation/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4a_expand_activation/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4a_expand_activation/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4a_expand_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4a_expand_activation/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block4a_expand_activation/Sigmoid:0 -> (1, 240, 28, 28)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4a_expand_activation/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4a_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4a_expand_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4a_expand_activation/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block4a_expand_bn/FusedBatchNormV3:0 -> (1, 240, 28, 28)], [StatefulPartitionedCall/efficientnet-b0/block4a_expand_activation/Sigmoid:0 -> (1, 240, 28, 28)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4a_expand_activation/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4a_expand_activation/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4a_expand_activation/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4a_expand_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4a_expand_activation/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block4a_expand_activation/mul:0 -> (1, 240, 28, 28)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4a_dwconv/depthwise [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4a_expand_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4a_dwconv/depthwise_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4a_dwconv/depthwise_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4a_dwconv/depthwise [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block4a_expand_activation/mul:0 -> (1, 240, 28, 28)], [StatefulPartitionedCall/efficientnet-b0/block4a_dwconv/depthwise_weights_fused_bn -> (240, 1, 3, 3)], [StatefulPartitionedCall/efficientnet-b0/block4a_dwconv/depthwise_bias_fused_bn -> (240)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 240, 28, 28) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4a_dwconv/depthwise for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4a_dwconv/depthwise [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (2, 2), prepadding: (0, 0), postpadding: (1, 1), dilations: (1, 1), numOutputs: 240 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 240, 14, 14) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4a_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4a_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4a_dwconv/depthwise [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block4a_bn/FusedBatchNormV3:0 -> (1, 240, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4a_activation/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4a_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4a_activation/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block4a_bn/FusedBatchNormV3:0 -> (1, 240, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4a_activation/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4a_activation/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4a_activation/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4a_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4a_activation/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block4a_activation/Sigmoid:0 -> (1, 240, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4a_activation/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4a_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4a_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4a_activation/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block4a_bn/FusedBatchNormV3:0 -> (1, 240, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block4a_activation/Sigmoid:0 -> (1, 240, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4a_activation/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4a_activation/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4a_activation/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4a_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4a_activation/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block4a_activation/mul:0 -> (1, 240, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4a_se_squeeze/Mean [ReduceMean] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4a_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4a_se_squeeze/Mean [ReduceMean] inputs: [StatefulPartitionedCall/efficientnet-b0/block4a_activation/mul:0 -> (1, 240, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4a_se_squeeze/Mean for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4a_se_squeeze/Mean [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4a_se_squeeze/Mean:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4a_se_squeeze/Mean:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4a_se_squeeze/Mean [ReduceMean] outputs: [StatefulPartitionedCall/efficientnet-b0/block4a_se_squeeze/Mean:0 -> (1, 240)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4a_se_reshape/Reshape [Reshape] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4a_se_squeeze/Mean:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__540 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4a_se_reshape/Reshape [Reshape] inputs: [StatefulPartitionedCall/efficientnet-b0/block4a_se_squeeze/Mean:0 -> (1, 240)], [const_fold_opt__540 -> (4)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4a_se_reshape/Reshape for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4a_se_reshape/Reshape [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4a_se_reshape/Reshape:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4a_se_reshape/Reshape:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4a_se_reshape/Reshape [Reshape] outputs: [StatefulPartitionedCall/efficientnet-b0/block4a_se_reshape/Reshape:0 -> (1, 1, 1, 240)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/BiasAdd__135 [Reshape] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4a_se_reshape/Reshape:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: new_shape__504 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/BiasAdd__135 [Reshape] inputs: [StatefulPartitionedCall/efficientnet-b0/block4a_se_reshape/Reshape:0 -> (1, 1, 1, 240)], [new_shape__504 -> (4)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/BiasAdd__135 for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/BiasAdd__135 [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/BiasAdd__135:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/BiasAdd__135:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/BiasAdd__135 [Reshape] outputs: [StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/BiasAdd__135:0 -> (1, 240, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/BiasAdd [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/BiasAdd__135:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/BiasAdd [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/BiasAdd__135:0 -> (1, 240, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/Conv2D/ReadVariableOp:0 -> (10, 240, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/BiasAdd/ReadVariableOp:0 -> (10)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 240, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/BiasAdd for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/BiasAdd [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 10 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 10, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/BiasAdd [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/BiasAdd:0 -> (1, 10, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/BiasAdd:0 -> (1, 10, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/Sigmoid:0 -> (1, 10, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/BiasAdd:0 -> (1, 10, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/Sigmoid:0 -> (1, 10, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/mul:0 -> (1, 10, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4a_se_expand/BiasAdd [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4a_se_expand/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4a_se_expand/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4a_se_expand/BiasAdd [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/mul:0 -> (1, 10, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block4a_se_expand/Conv2D/ReadVariableOp:0 -> (240, 10, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block4a_se_expand/BiasAdd/ReadVariableOp:0 -> (240)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 10, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4a_se_expand/BiasAdd for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4a_se_expand/BiasAdd [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 240 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 240, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4a_se_expand/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4a_se_expand/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4a_se_expand/BiasAdd [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block4a_se_expand/BiasAdd:0 -> (1, 240, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4a_se_expand/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4a_se_expand/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4a_se_expand/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block4a_se_expand/BiasAdd:0 -> (1, 240, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4a_se_expand/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4a_se_expand/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4a_se_expand/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4a_se_expand/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4a_se_expand/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block4a_se_expand/Sigmoid:0 -> (1, 240, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4a_se_excite/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4a_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4a_se_expand/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4a_se_excite/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block4a_activation/mul:0 -> (1, 240, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block4a_se_expand/Sigmoid:0 -> (1, 240, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4a_se_excite/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4a_se_excite/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4a_se_excite/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4a_se_excite/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4a_se_excite/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block4a_se_excite/mul:0 -> (1, 240, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4a_se_excite/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block4a_se_excite/mul:0 -> (1, 240, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D_weights_fused_bn -> (80, 240, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D_bias_fused_bn -> (80)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 240, 14, 14) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 80 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 80, 14, 14) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4a_project_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4a_project_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block4a_project_bn/FusedBatchNormV3:0 -> (1, 80, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4a_project_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block4a_project_bn/FusedBatchNormV3:0 -> (1, 80, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D/ReadVariableOp:0 -> (480, 80, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 80, 14, 14) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 480 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 480, 14, 14) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D:0 -> (1, 480, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4b_expand_bn/FusedBatchNormV3 [BatchNormalization] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4b_expand_bn/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4b_expand_bn/ReadVariableOp_1:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4b_expand_bn/FusedBatchNormV3/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4b_expand_bn/FusedBatchNormV3/ReadVariableOp_1:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4b_expand_bn/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D:0 -> (1, 480, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block4b_expand_bn/ReadVariableOp:0 -> (480)], [StatefulPartitionedCall/efficientnet-b0/block4b_expand_bn/ReadVariableOp_1:0 -> (480)], [StatefulPartitionedCall/efficientnet-b0/block4b_expand_bn/FusedBatchNormV3/ReadVariableOp:0 -> (480)], [StatefulPartitionedCall/efficientnet-b0/block4b_expand_bn/FusedBatchNormV3/ReadVariableOp_1:0 -> (480)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4b_expand_bn/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4b_expand_bn/FusedBatchNormV3 [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4b_expand_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4b_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4b_expand_bn/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/efficientnet-b0/block4b_expand_bn/FusedBatchNormV3:0 -> (1, 480, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4b_expand_activation/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4b_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4b_expand_activation/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block4b_expand_bn/FusedBatchNormV3:0 -> (1, 480, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4b_expand_activation/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4b_expand_activation/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4b_expand_activation/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4b_expand_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4b_expand_activation/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block4b_expand_activation/Sigmoid:0 -> (1, 480, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4b_expand_activation/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4b_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4b_expand_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4b_expand_activation/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block4b_expand_bn/FusedBatchNormV3:0 -> (1, 480, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block4b_expand_activation/Sigmoid:0 -> (1, 480, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4b_expand_activation/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4b_expand_activation/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4b_expand_activation/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4b_expand_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4b_expand_activation/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block4b_expand_activation/mul:0 -> (1, 480, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4b_expand_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block4b_expand_activation/mul:0 -> (1, 480, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise_weights_fused_bn -> (480, 1, 3, 3)], [StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise_bias_fused_bn -> (480)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 480, 14, 14) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 480 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 480, 14, 14) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4b_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4b_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block4b_bn/FusedBatchNormV3:0 -> (1, 480, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4b_activation/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4b_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4b_activation/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block4b_bn/FusedBatchNormV3:0 -> (1, 480, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4b_activation/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4b_activation/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4b_activation/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4b_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4b_activation/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block4b_activation/Sigmoid:0 -> (1, 480, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4b_activation/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4b_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4b_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4b_activation/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block4b_bn/FusedBatchNormV3:0 -> (1, 480, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block4b_activation/Sigmoid:0 -> (1, 480, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4b_activation/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4b_activation/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4b_activation/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4b_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4b_activation/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block4b_activation/mul:0 -> (1, 480, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4b_se_squeeze/Mean [ReduceMean] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4b_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4b_se_squeeze/Mean [ReduceMean] inputs: [StatefulPartitionedCall/efficientnet-b0/block4b_activation/mul:0 -> (1, 480, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4b_se_squeeze/Mean for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4b_se_squeeze/Mean [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4b_se_squeeze/Mean:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4b_se_squeeze/Mean:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4b_se_squeeze/Mean [ReduceMean] outputs: [StatefulPartitionedCall/efficientnet-b0/block4b_se_squeeze/Mean:0 -> (1, 480)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4b_se_reshape/Reshape [Reshape] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4b_se_squeeze/Mean:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__513 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4b_se_reshape/Reshape [Reshape] inputs: [StatefulPartitionedCall/efficientnet-b0/block4b_se_squeeze/Mean:0 -> (1, 480)], [const_fold_opt__513 -> (4)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4b_se_reshape/Reshape for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4b_se_reshape/Reshape [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4b_se_reshape/Reshape:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4b_se_reshape/Reshape:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4b_se_reshape/Reshape [Reshape] outputs: [StatefulPartitionedCall/efficientnet-b0/block4b_se_reshape/Reshape:0 -> (1, 1, 1, 480)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd__155 [Reshape] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4b_se_reshape/Reshape:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: new_shape__509 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd__155 [Reshape] inputs: [StatefulPartitionedCall/efficientnet-b0/block4b_se_reshape/Reshape:0 -> (1, 1, 1, 480)], [new_shape__509 -> (4)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd__155 for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd__155 [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd__155:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd__155:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd__155 [Reshape] outputs: [StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd__155:0 -> (1, 480, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd__155:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd__155:0 -> (1, 480, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/Conv2D/ReadVariableOp:0 -> (20, 480, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd/ReadVariableOp:0 -> (20)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 480, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 20 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 20, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd:0 -> (1, 20, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd:0 -> (1, 20, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/Sigmoid:0 -> (1, 20, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd:0 -> (1, 20, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/Sigmoid:0 -> (1, 20, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/mul:0 -> (1, 20, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/mul:0 -> (1, 20, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/Conv2D/ReadVariableOp:0 -> (480, 20, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd/ReadVariableOp:0 -> (480)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 20, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 480 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 480, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd:0 -> (1, 480, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd:0 -> (1, 480, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/Sigmoid:0 -> (1, 480, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4b_se_excite/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4b_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4b_se_excite/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block4b_activation/mul:0 -> (1, 480, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/Sigmoid:0 -> (1, 480, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4b_se_excite/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4b_se_excite/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4b_se_excite/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4b_se_excite/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4b_se_excite/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block4b_se_excite/mul:0 -> (1, 480, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4b_se_excite/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block4b_se_excite/mul:0 -> (1, 480, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D_weights_fused_bn -> (80, 480, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D_bias_fused_bn -> (80)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 480, 14, 14) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 80 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 80, 14, 14) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4b_project_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4b_project_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block4b_project_bn/FusedBatchNormV3:0 -> (1, 80, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4b_add/add [Add] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4b_project_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4a_project_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4b_add/add [Add] inputs: [StatefulPartitionedCall/efficientnet-b0/block4b_project_bn/FusedBatchNormV3:0 -> (1, 80, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block4a_project_bn/FusedBatchNormV3:0 -> (1, 80, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4b_add/add for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4b_add/add [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4b_add/add:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4b_add/add:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4b_add/add [Add] outputs: [StatefulPartitionedCall/efficientnet-b0/block4b_add/add:0 -> (1, 80, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4c_expand_conv/Conv2D [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4b_add/add:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4c_expand_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4c_expand_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4c_expand_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block4b_add/add:0 -> (1, 80, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block4c_expand_conv/Conv2D_weights_fused_bn -> (480, 80, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block4c_expand_conv/Conv2D_bias_fused_bn -> (480)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 80, 14, 14) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4c_expand_conv/Conv2D for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4c_expand_conv/Conv2D [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 480 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 480, 14, 14) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4c_expand_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4c_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4c_expand_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block4c_expand_bn/FusedBatchNormV3:0 -> (1, 480, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4c_expand_activation/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4c_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4c_expand_activation/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block4c_expand_bn/FusedBatchNormV3:0 -> (1, 480, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4c_expand_activation/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4c_expand_activation/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4c_expand_activation/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4c_expand_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4c_expand_activation/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block4c_expand_activation/Sigmoid:0 -> (1, 480, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4c_expand_activation/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4c_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4c_expand_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4c_expand_activation/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block4c_expand_bn/FusedBatchNormV3:0 -> (1, 480, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block4c_expand_activation/Sigmoid:0 -> (1, 480, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4c_expand_activation/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4c_expand_activation/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4c_expand_activation/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4c_expand_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4c_expand_activation/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block4c_expand_activation/mul:0 -> (1, 480, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4c_dwconv/depthwise [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4c_expand_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4c_dwconv/depthwise_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4c_dwconv/depthwise_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4c_dwconv/depthwise [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block4c_expand_activation/mul:0 -> (1, 480, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block4c_dwconv/depthwise_weights_fused_bn -> (480, 1, 3, 3)], [StatefulPartitionedCall/efficientnet-b0/block4c_dwconv/depthwise_bias_fused_bn -> (480)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 480, 14, 14) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4c_dwconv/depthwise for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4c_dwconv/depthwise [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 480 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 480, 14, 14) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4c_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4c_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4c_dwconv/depthwise [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block4c_bn/FusedBatchNormV3:0 -> (1, 480, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4c_activation/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4c_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4c_activation/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block4c_bn/FusedBatchNormV3:0 -> (1, 480, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4c_activation/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4c_activation/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4c_activation/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4c_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4c_activation/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block4c_activation/Sigmoid:0 -> (1, 480, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4c_activation/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4c_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4c_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4c_activation/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block4c_bn/FusedBatchNormV3:0 -> (1, 480, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block4c_activation/Sigmoid:0 -> (1, 480, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4c_activation/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4c_activation/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4c_activation/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4c_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4c_activation/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block4c_activation/mul:0 -> (1, 480, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4c_se_squeeze/Mean [ReduceMean] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4c_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4c_se_squeeze/Mean [ReduceMean] inputs: [StatefulPartitionedCall/efficientnet-b0/block4c_activation/mul:0 -> (1, 480, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4c_se_squeeze/Mean for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4c_se_squeeze/Mean [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4c_se_squeeze/Mean:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4c_se_squeeze/Mean:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4c_se_squeeze/Mean [ReduceMean] outputs: [StatefulPartitionedCall/efficientnet-b0/block4c_se_squeeze/Mean:0 -> (1, 480)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4c_se_reshape/Reshape [Reshape] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4c_se_squeeze/Mean:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__513 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4c_se_reshape/Reshape [Reshape] inputs: [StatefulPartitionedCall/efficientnet-b0/block4c_se_squeeze/Mean:0 -> (1, 480)], [const_fold_opt__513 -> (4)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4c_se_reshape/Reshape for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4c_se_reshape/Reshape [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4c_se_reshape/Reshape:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4c_se_reshape/Reshape:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4c_se_reshape/Reshape [Reshape] outputs: [StatefulPartitionedCall/efficientnet-b0/block4c_se_reshape/Reshape:0 -> (1, 1, 1, 480)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/BiasAdd__175 [Reshape] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4c_se_reshape/Reshape:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: new_shape__509 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/BiasAdd__175 [Reshape] inputs: [StatefulPartitionedCall/efficientnet-b0/block4c_se_reshape/Reshape:0 -> (1, 1, 1, 480)], [new_shape__509 -> (4)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/BiasAdd__175 for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/BiasAdd__175 [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/BiasAdd__175:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/BiasAdd__175:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/BiasAdd__175 [Reshape] outputs: [StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/BiasAdd__175:0 -> (1, 480, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/BiasAdd [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/BiasAdd__175:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/BiasAdd [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/BiasAdd__175:0 -> (1, 480, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/Conv2D/ReadVariableOp:0 -> (20, 480, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/BiasAdd/ReadVariableOp:0 -> (20)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 480, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/BiasAdd for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/BiasAdd [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 20 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 20, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/BiasAdd [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/BiasAdd:0 -> (1, 20, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/BiasAdd:0 -> (1, 20, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/Sigmoid:0 -> (1, 20, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/BiasAdd:0 -> (1, 20, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/Sigmoid:0 -> (1, 20, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/mul:0 -> (1, 20, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4c_se_expand/BiasAdd [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4c_se_expand/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4c_se_expand/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4c_se_expand/BiasAdd [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/mul:0 -> (1, 20, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block4c_se_expand/Conv2D/ReadVariableOp:0 -> (480, 20, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block4c_se_expand/BiasAdd/ReadVariableOp:0 -> (480)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 20, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4c_se_expand/BiasAdd for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4c_se_expand/BiasAdd [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 480 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 480, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4c_se_expand/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4c_se_expand/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4c_se_expand/BiasAdd [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block4c_se_expand/BiasAdd:0 -> (1, 480, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4c_se_expand/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4c_se_expand/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4c_se_expand/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block4c_se_expand/BiasAdd:0 -> (1, 480, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4c_se_expand/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4c_se_expand/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4c_se_expand/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4c_se_expand/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4c_se_expand/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block4c_se_expand/Sigmoid:0 -> (1, 480, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4c_se_excite/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4c_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4c_se_expand/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4c_se_excite/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block4c_activation/mul:0 -> (1, 480, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block4c_se_expand/Sigmoid:0 -> (1, 480, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4c_se_excite/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4c_se_excite/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4c_se_excite/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4c_se_excite/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4c_se_excite/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block4c_se_excite/mul:0 -> (1, 480, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4c_project_conv/Conv2D [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4c_se_excite/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4c_project_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4c_project_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4c_project_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block4c_se_excite/mul:0 -> (1, 480, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block4c_project_conv/Conv2D_weights_fused_bn -> (80, 480, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block4c_project_conv/Conv2D_bias_fused_bn -> (80)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 480, 14, 14) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4c_project_conv/Conv2D for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4c_project_conv/Conv2D [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 80 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 80, 14, 14) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4c_project_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4c_project_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4c_project_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block4c_project_bn/FusedBatchNormV3:0 -> (1, 80, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block4c_add/add [Add] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4c_project_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4b_add/add:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block4c_add/add [Add] inputs: [StatefulPartitionedCall/efficientnet-b0/block4c_project_bn/FusedBatchNormV3:0 -> (1, 80, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block4b_add/add:0 -> (1, 80, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block4c_add/add for ONNX node: StatefulPartitionedCall/efficientnet-b0/block4c_add/add [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block4c_add/add:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block4c_add/add:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block4c_add/add [Add] outputs: [StatefulPartitionedCall/efficientnet-b0/block4c_add/add:0 -> (1, 80, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5a_expand_conv/Conv2D [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block4c_add/add:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5a_expand_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5a_expand_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5a_expand_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block4c_add/add:0 -> (1, 80, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block5a_expand_conv/Conv2D_weights_fused_bn -> (480, 80, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block5a_expand_conv/Conv2D_bias_fused_bn -> (480)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 80, 14, 14) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5a_expand_conv/Conv2D for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5a_expand_conv/Conv2D [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 480 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 480, 14, 14) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5a_expand_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5a_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5a_expand_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block5a_expand_bn/FusedBatchNormV3:0 -> (1, 480, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5a_expand_activation/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5a_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5a_expand_activation/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block5a_expand_bn/FusedBatchNormV3:0 -> (1, 480, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5a_expand_activation/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5a_expand_activation/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5a_expand_activation/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5a_expand_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5a_expand_activation/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block5a_expand_activation/Sigmoid:0 -> (1, 480, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5a_expand_activation/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5a_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5a_expand_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5a_expand_activation/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block5a_expand_bn/FusedBatchNormV3:0 -> (1, 480, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block5a_expand_activation/Sigmoid:0 -> (1, 480, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5a_expand_activation/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5a_expand_activation/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5a_expand_activation/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5a_expand_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5a_expand_activation/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block5a_expand_activation/mul:0 -> (1, 480, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5a_dwconv/depthwise [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5a_expand_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5a_dwconv/depthwise_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5a_dwconv/depthwise_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5a_dwconv/depthwise [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block5a_expand_activation/mul:0 -> (1, 480, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block5a_dwconv/depthwise_weights_fused_bn -> (480, 1, 5, 5)], [StatefulPartitionedCall/efficientnet-b0/block5a_dwconv/depthwise_bias_fused_bn -> (480)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 480, 14, 14) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5a_dwconv/depthwise for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5a_dwconv/depthwise [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (5, 5), strides: (1, 1), prepadding: (2, 2), postpadding: (2, 2), dilations: (1, 1), numOutputs: 480 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 480, 14, 14) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5a_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5a_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5a_dwconv/depthwise [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block5a_bn/FusedBatchNormV3:0 -> (1, 480, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5a_activation/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5a_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5a_activation/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block5a_bn/FusedBatchNormV3:0 -> (1, 480, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5a_activation/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5a_activation/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5a_activation/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5a_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5a_activation/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block5a_activation/Sigmoid:0 -> (1, 480, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5a_activation/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5a_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5a_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5a_activation/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block5a_bn/FusedBatchNormV3:0 -> (1, 480, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block5a_activation/Sigmoid:0 -> (1, 480, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5a_activation/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5a_activation/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5a_activation/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5a_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5a_activation/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block5a_activation/mul:0 -> (1, 480, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5a_se_squeeze/Mean [ReduceMean] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5a_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5a_se_squeeze/Mean [ReduceMean] inputs: [StatefulPartitionedCall/efficientnet-b0/block5a_activation/mul:0 -> (1, 480, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5a_se_squeeze/Mean for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5a_se_squeeze/Mean [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5a_se_squeeze/Mean:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5a_se_squeeze/Mean:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5a_se_squeeze/Mean [ReduceMean] outputs: [StatefulPartitionedCall/efficientnet-b0/block5a_se_squeeze/Mean:0 -> (1, 480)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5a_se_reshape/Reshape [Reshape] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5a_se_squeeze/Mean:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__513 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5a_se_reshape/Reshape [Reshape] inputs: [StatefulPartitionedCall/efficientnet-b0/block5a_se_squeeze/Mean:0 -> (1, 480)], [const_fold_opt__513 -> (4)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5a_se_reshape/Reshape for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5a_se_reshape/Reshape [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5a_se_reshape/Reshape:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5a_se_reshape/Reshape:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5a_se_reshape/Reshape [Reshape] outputs: [StatefulPartitionedCall/efficientnet-b0/block5a_se_reshape/Reshape:0 -> (1, 1, 1, 480)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/BiasAdd__195 [Reshape] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5a_se_reshape/Reshape:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: new_shape__509 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/BiasAdd__195 [Reshape] inputs: [StatefulPartitionedCall/efficientnet-b0/block5a_se_reshape/Reshape:0 -> (1, 1, 1, 480)], [new_shape__509 -> (4)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/BiasAdd__195 for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/BiasAdd__195 [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/BiasAdd__195:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/BiasAdd__195:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/BiasAdd__195 [Reshape] outputs: [StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/BiasAdd__195:0 -> (1, 480, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/BiasAdd [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/BiasAdd__195:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/BiasAdd [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/BiasAdd__195:0 -> (1, 480, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/Conv2D/ReadVariableOp:0 -> (20, 480, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/BiasAdd/ReadVariableOp:0 -> (20)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 480, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/BiasAdd for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/BiasAdd [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 20 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 20, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/BiasAdd [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/BiasAdd:0 -> (1, 20, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/BiasAdd:0 -> (1, 20, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/Sigmoid:0 -> (1, 20, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/BiasAdd:0 -> (1, 20, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/Sigmoid:0 -> (1, 20, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/mul:0 -> (1, 20, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5a_se_expand/BiasAdd [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5a_se_expand/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5a_se_expand/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5a_se_expand/BiasAdd [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/mul:0 -> (1, 20, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block5a_se_expand/Conv2D/ReadVariableOp:0 -> (480, 20, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block5a_se_expand/BiasAdd/ReadVariableOp:0 -> (480)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 20, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5a_se_expand/BiasAdd for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5a_se_expand/BiasAdd [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 480 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 480, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5a_se_expand/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5a_se_expand/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5a_se_expand/BiasAdd [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block5a_se_expand/BiasAdd:0 -> (1, 480, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5a_se_expand/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5a_se_expand/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5a_se_expand/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block5a_se_expand/BiasAdd:0 -> (1, 480, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5a_se_expand/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5a_se_expand/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5a_se_expand/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5a_se_expand/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5a_se_expand/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block5a_se_expand/Sigmoid:0 -> (1, 480, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5a_se_excite/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5a_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5a_se_expand/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5a_se_excite/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block5a_activation/mul:0 -> (1, 480, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block5a_se_expand/Sigmoid:0 -> (1, 480, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5a_se_excite/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5a_se_excite/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5a_se_excite/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5a_se_excite/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5a_se_excite/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block5a_se_excite/mul:0 -> (1, 480, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5a_se_excite/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block5a_se_excite/mul:0 -> (1, 480, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D_weights_fused_bn -> (112, 480, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D_bias_fused_bn -> (112)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 480, 14, 14) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 112 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 112, 14, 14) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5a_project_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5a_project_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block5a_project_bn/FusedBatchNormV3:0 -> (1, 112, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5a_project_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block5a_project_bn/FusedBatchNormV3:0 -> (1, 112, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D/ReadVariableOp:0 -> (672, 112, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 112, 14, 14) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 672 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 672, 14, 14) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D:0 -> (1, 672, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5b_expand_bn/FusedBatchNormV3 [BatchNormalization] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5b_expand_bn/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5b_expand_bn/ReadVariableOp_1:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5b_expand_bn/FusedBatchNormV3/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5b_expand_bn/FusedBatchNormV3/ReadVariableOp_1:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5b_expand_bn/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D:0 -> (1, 672, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block5b_expand_bn/ReadVariableOp:0 -> (672)], [StatefulPartitionedCall/efficientnet-b0/block5b_expand_bn/ReadVariableOp_1:0 -> (672)], [StatefulPartitionedCall/efficientnet-b0/block5b_expand_bn/FusedBatchNormV3/ReadVariableOp:0 -> (672)], [StatefulPartitionedCall/efficientnet-b0/block5b_expand_bn/FusedBatchNormV3/ReadVariableOp_1:0 -> (672)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5b_expand_bn/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5b_expand_bn/FusedBatchNormV3 [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5b_expand_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5b_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5b_expand_bn/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/efficientnet-b0/block5b_expand_bn/FusedBatchNormV3:0 -> (1, 672, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5b_expand_activation/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5b_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5b_expand_activation/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block5b_expand_bn/FusedBatchNormV3:0 -> (1, 672, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5b_expand_activation/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5b_expand_activation/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5b_expand_activation/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5b_expand_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5b_expand_activation/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block5b_expand_activation/Sigmoid:0 -> (1, 672, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5b_expand_activation/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5b_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5b_expand_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5b_expand_activation/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block5b_expand_bn/FusedBatchNormV3:0 -> (1, 672, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block5b_expand_activation/Sigmoid:0 -> (1, 672, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5b_expand_activation/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5b_expand_activation/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5b_expand_activation/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5b_expand_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5b_expand_activation/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block5b_expand_activation/mul:0 -> (1, 672, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5b_dwconv/depthwise [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5b_expand_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5b_dwconv/depthwise_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5b_dwconv/depthwise_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5b_dwconv/depthwise [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block5b_expand_activation/mul:0 -> (1, 672, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block5b_dwconv/depthwise_weights_fused_bn -> (672, 1, 5, 5)], [StatefulPartitionedCall/efficientnet-b0/block5b_dwconv/depthwise_bias_fused_bn -> (672)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 672, 14, 14) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5b_dwconv/depthwise for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5b_dwconv/depthwise [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (5, 5), strides: (1, 1), prepadding: (2, 2), postpadding: (2, 2), dilations: (1, 1), numOutputs: 672 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 672, 14, 14) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5b_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5b_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5b_dwconv/depthwise [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block5b_bn/FusedBatchNormV3:0 -> (1, 672, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5b_activation/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5b_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5b_activation/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block5b_bn/FusedBatchNormV3:0 -> (1, 672, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5b_activation/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5b_activation/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5b_activation/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5b_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5b_activation/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block5b_activation/Sigmoid:0 -> (1, 672, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5b_activation/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5b_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5b_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5b_activation/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block5b_bn/FusedBatchNormV3:0 -> (1, 672, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block5b_activation/Sigmoid:0 -> (1, 672, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5b_activation/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5b_activation/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5b_activation/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5b_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5b_activation/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block5b_activation/mul:0 -> (1, 672, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5b_se_squeeze/Mean [ReduceMean] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5b_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5b_se_squeeze/Mean [ReduceMean] inputs: [StatefulPartitionedCall/efficientnet-b0/block5b_activation/mul:0 -> (1, 672, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5b_se_squeeze/Mean for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5b_se_squeeze/Mean [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5b_se_squeeze/Mean:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5b_se_squeeze/Mean:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5b_se_squeeze/Mean [ReduceMean] outputs: [StatefulPartitionedCall/efficientnet-b0/block5b_se_squeeze/Mean:0 -> (1, 672)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5b_se_reshape/Reshape [Reshape] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5b_se_squeeze/Mean:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__511 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5b_se_reshape/Reshape [Reshape] inputs: [StatefulPartitionedCall/efficientnet-b0/block5b_se_squeeze/Mean:0 -> (1, 672)], [const_fold_opt__511 -> (4)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5b_se_reshape/Reshape for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5b_se_reshape/Reshape [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5b_se_reshape/Reshape:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5b_se_reshape/Reshape:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5b_se_reshape/Reshape [Reshape] outputs: [StatefulPartitionedCall/efficientnet-b0/block5b_se_reshape/Reshape:0 -> (1, 1, 1, 672)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd__215 [Reshape] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5b_se_reshape/Reshape:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: new_shape__495 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd__215 [Reshape] inputs: [StatefulPartitionedCall/efficientnet-b0/block5b_se_reshape/Reshape:0 -> (1, 1, 1, 672)], [new_shape__495 -> (4)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd__215 for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd__215 [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd__215:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd__215:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd__215 [Reshape] outputs: [StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd__215:0 -> (1, 672, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd__215:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd__215:0 -> (1, 672, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/Conv2D/ReadVariableOp:0 -> (28, 672, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd/ReadVariableOp:0 -> (28)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 672, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 28 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 28, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd:0 -> (1, 28, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd:0 -> (1, 28, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/Sigmoid:0 -> (1, 28, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd:0 -> (1, 28, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/Sigmoid:0 -> (1, 28, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/mul:0 -> (1, 28, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/mul:0 -> (1, 28, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/Conv2D/ReadVariableOp:0 -> (672, 28, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd/ReadVariableOp:0 -> (672)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 28, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 672 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 672, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd:0 -> (1, 672, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd:0 -> (1, 672, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/Sigmoid:0 -> (1, 672, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5b_se_excite/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5b_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5b_se_excite/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block5b_activation/mul:0 -> (1, 672, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/Sigmoid:0 -> (1, 672, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5b_se_excite/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5b_se_excite/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5b_se_excite/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5b_se_excite/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5b_se_excite/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block5b_se_excite/mul:0 -> (1, 672, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5b_se_excite/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block5b_se_excite/mul:0 -> (1, 672, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D_weights_fused_bn -> (112, 672, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D_bias_fused_bn -> (112)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 672, 14, 14) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 112 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 112, 14, 14) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5b_project_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5b_project_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block5b_project_bn/FusedBatchNormV3:0 -> (1, 112, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5b_add/add [Add] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5b_project_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5a_project_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5b_add/add [Add] inputs: [StatefulPartitionedCall/efficientnet-b0/block5b_project_bn/FusedBatchNormV3:0 -> (1, 112, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block5a_project_bn/FusedBatchNormV3:0 -> (1, 112, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5b_add/add for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5b_add/add [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5b_add/add:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5b_add/add:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5b_add/add [Add] outputs: [StatefulPartitionedCall/efficientnet-b0/block5b_add/add:0 -> (1, 112, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5c_expand_conv/Conv2D [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5b_add/add:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5c_expand_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5c_expand_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5c_expand_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block5b_add/add:0 -> (1, 112, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block5c_expand_conv/Conv2D_weights_fused_bn -> (672, 112, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block5c_expand_conv/Conv2D_bias_fused_bn -> (672)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 112, 14, 14) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5c_expand_conv/Conv2D for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5c_expand_conv/Conv2D [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 672 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 672, 14, 14) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5c_expand_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5c_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5c_expand_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block5c_expand_bn/FusedBatchNormV3:0 -> (1, 672, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5c_expand_activation/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5c_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5c_expand_activation/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block5c_expand_bn/FusedBatchNormV3:0 -> (1, 672, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5c_expand_activation/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5c_expand_activation/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5c_expand_activation/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5c_expand_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5c_expand_activation/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block5c_expand_activation/Sigmoid:0 -> (1, 672, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5c_expand_activation/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5c_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5c_expand_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5c_expand_activation/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block5c_expand_bn/FusedBatchNormV3:0 -> (1, 672, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block5c_expand_activation/Sigmoid:0 -> (1, 672, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5c_expand_activation/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5c_expand_activation/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5c_expand_activation/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5c_expand_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5c_expand_activation/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block5c_expand_activation/mul:0 -> (1, 672, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5c_dwconv/depthwise [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5c_expand_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5c_dwconv/depthwise_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5c_dwconv/depthwise_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5c_dwconv/depthwise [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block5c_expand_activation/mul:0 -> (1, 672, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block5c_dwconv/depthwise_weights_fused_bn -> (672, 1, 5, 5)], [StatefulPartitionedCall/efficientnet-b0/block5c_dwconv/depthwise_bias_fused_bn -> (672)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 672, 14, 14) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5c_dwconv/depthwise for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5c_dwconv/depthwise [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (5, 5), strides: (1, 1), prepadding: (2, 2), postpadding: (2, 2), dilations: (1, 1), numOutputs: 672 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 672, 14, 14) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5c_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5c_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5c_dwconv/depthwise [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block5c_bn/FusedBatchNormV3:0 -> (1, 672, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5c_activation/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5c_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5c_activation/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block5c_bn/FusedBatchNormV3:0 -> (1, 672, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5c_activation/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5c_activation/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5c_activation/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5c_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5c_activation/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block5c_activation/Sigmoid:0 -> (1, 672, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5c_activation/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5c_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5c_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5c_activation/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block5c_bn/FusedBatchNormV3:0 -> (1, 672, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block5c_activation/Sigmoid:0 -> (1, 672, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5c_activation/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5c_activation/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5c_activation/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5c_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5c_activation/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block5c_activation/mul:0 -> (1, 672, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5c_se_squeeze/Mean [ReduceMean] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5c_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5c_se_squeeze/Mean [ReduceMean] inputs: [StatefulPartitionedCall/efficientnet-b0/block5c_activation/mul:0 -> (1, 672, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5c_se_squeeze/Mean for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5c_se_squeeze/Mean [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5c_se_squeeze/Mean:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5c_se_squeeze/Mean:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5c_se_squeeze/Mean [ReduceMean] outputs: [StatefulPartitionedCall/efficientnet-b0/block5c_se_squeeze/Mean:0 -> (1, 672)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5c_se_reshape/Reshape [Reshape] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5c_se_squeeze/Mean:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__511 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5c_se_reshape/Reshape [Reshape] inputs: [StatefulPartitionedCall/efficientnet-b0/block5c_se_squeeze/Mean:0 -> (1, 672)], [const_fold_opt__511 -> (4)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5c_se_reshape/Reshape for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5c_se_reshape/Reshape [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5c_se_reshape/Reshape:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5c_se_reshape/Reshape:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5c_se_reshape/Reshape [Reshape] outputs: [StatefulPartitionedCall/efficientnet-b0/block5c_se_reshape/Reshape:0 -> (1, 1, 1, 672)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/BiasAdd__235 [Reshape] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5c_se_reshape/Reshape:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: new_shape__495 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/BiasAdd__235 [Reshape] inputs: [StatefulPartitionedCall/efficientnet-b0/block5c_se_reshape/Reshape:0 -> (1, 1, 1, 672)], [new_shape__495 -> (4)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/BiasAdd__235 for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/BiasAdd__235 [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/BiasAdd__235:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/BiasAdd__235:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/BiasAdd__235 [Reshape] outputs: [StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/BiasAdd__235:0 -> (1, 672, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/BiasAdd [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/BiasAdd__235:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/BiasAdd [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/BiasAdd__235:0 -> (1, 672, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/Conv2D/ReadVariableOp:0 -> (28, 672, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/BiasAdd/ReadVariableOp:0 -> (28)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 672, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/BiasAdd for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/BiasAdd [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 28 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 28, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/BiasAdd [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/BiasAdd:0 -> (1, 28, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/BiasAdd:0 -> (1, 28, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/Sigmoid:0 -> (1, 28, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/BiasAdd:0 -> (1, 28, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/Sigmoid:0 -> (1, 28, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/mul:0 -> (1, 28, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5c_se_expand/BiasAdd [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5c_se_expand/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5c_se_expand/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5c_se_expand/BiasAdd [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/mul:0 -> (1, 28, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block5c_se_expand/Conv2D/ReadVariableOp:0 -> (672, 28, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block5c_se_expand/BiasAdd/ReadVariableOp:0 -> (672)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 28, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5c_se_expand/BiasAdd for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5c_se_expand/BiasAdd [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 672 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 672, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5c_se_expand/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5c_se_expand/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5c_se_expand/BiasAdd [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block5c_se_expand/BiasAdd:0 -> (1, 672, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5c_se_expand/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5c_se_expand/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5c_se_expand/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block5c_se_expand/BiasAdd:0 -> (1, 672, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5c_se_expand/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5c_se_expand/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5c_se_expand/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5c_se_expand/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5c_se_expand/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block5c_se_expand/Sigmoid:0 -> (1, 672, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5c_se_excite/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5c_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5c_se_expand/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5c_se_excite/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block5c_activation/mul:0 -> (1, 672, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block5c_se_expand/Sigmoid:0 -> (1, 672, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5c_se_excite/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5c_se_excite/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5c_se_excite/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5c_se_excite/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5c_se_excite/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block5c_se_excite/mul:0 -> (1, 672, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5c_project_conv/Conv2D [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5c_se_excite/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5c_project_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5c_project_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5c_project_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block5c_se_excite/mul:0 -> (1, 672, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block5c_project_conv/Conv2D_weights_fused_bn -> (112, 672, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block5c_project_conv/Conv2D_bias_fused_bn -> (112)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 672, 14, 14) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5c_project_conv/Conv2D for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5c_project_conv/Conv2D [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 112 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 112, 14, 14) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5c_project_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5c_project_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5c_project_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block5c_project_bn/FusedBatchNormV3:0 -> (1, 112, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block5c_add/add [Add] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5c_project_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5b_add/add:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block5c_add/add [Add] inputs: [StatefulPartitionedCall/efficientnet-b0/block5c_project_bn/FusedBatchNormV3:0 -> (1, 112, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block5b_add/add:0 -> (1, 112, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block5c_add/add for ONNX node: StatefulPartitionedCall/efficientnet-b0/block5c_add/add [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block5c_add/add:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block5c_add/add:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block5c_add/add [Add] outputs: [StatefulPartitionedCall/efficientnet-b0/block5c_add/add:0 -> (1, 112, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6a_expand_conv/Conv2D [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block5c_add/add:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6a_expand_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6a_expand_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6a_expand_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block5c_add/add:0 -> (1, 112, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block6a_expand_conv/Conv2D_weights_fused_bn -> (672, 112, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block6a_expand_conv/Conv2D_bias_fused_bn -> (672)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 112, 14, 14) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6a_expand_conv/Conv2D for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6a_expand_conv/Conv2D [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 672 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 672, 14, 14) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6a_expand_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6a_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6a_expand_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block6a_expand_bn/FusedBatchNormV3:0 -> (1, 672, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6a_expand_activation/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6a_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6a_expand_activation/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block6a_expand_bn/FusedBatchNormV3:0 -> (1, 672, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6a_expand_activation/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6a_expand_activation/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6a_expand_activation/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6a_expand_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6a_expand_activation/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block6a_expand_activation/Sigmoid:0 -> (1, 672, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6a_expand_activation/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6a_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6a_expand_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6a_expand_activation/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block6a_expand_bn/FusedBatchNormV3:0 -> (1, 672, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block6a_expand_activation/Sigmoid:0 -> (1, 672, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6a_expand_activation/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6a_expand_activation/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6a_expand_activation/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6a_expand_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6a_expand_activation/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block6a_expand_activation/mul:0 -> (1, 672, 14, 14)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6a_dwconv/depthwise [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6a_expand_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6a_dwconv/depthwise_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6a_dwconv/depthwise_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6a_dwconv/depthwise [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block6a_expand_activation/mul:0 -> (1, 672, 14, 14)], [StatefulPartitionedCall/efficientnet-b0/block6a_dwconv/depthwise_weights_fused_bn -> (672, 1, 5, 5)], [StatefulPartitionedCall/efficientnet-b0/block6a_dwconv/depthwise_bias_fused_bn -> (672)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 672, 14, 14) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6a_dwconv/depthwise for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6a_dwconv/depthwise [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (5, 5), strides: (2, 2), prepadding: (1, 1), postpadding: (2, 2), dilations: (1, 1), numOutputs: 672 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 672, 7, 7) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6a_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6a_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6a_dwconv/depthwise [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block6a_bn/FusedBatchNormV3:0 -> (1, 672, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6a_activation/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6a_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6a_activation/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block6a_bn/FusedBatchNormV3:0 -> (1, 672, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6a_activation/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6a_activation/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6a_activation/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6a_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6a_activation/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block6a_activation/Sigmoid:0 -> (1, 672, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6a_activation/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6a_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6a_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6a_activation/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block6a_bn/FusedBatchNormV3:0 -> (1, 672, 7, 7)], [StatefulPartitionedCall/efficientnet-b0/block6a_activation/Sigmoid:0 -> (1, 672, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6a_activation/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6a_activation/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6a_activation/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6a_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6a_activation/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block6a_activation/mul:0 -> (1, 672, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6a_se_squeeze/Mean [ReduceMean] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6a_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6a_se_squeeze/Mean [ReduceMean] inputs: [StatefulPartitionedCall/efficientnet-b0/block6a_activation/mul:0 -> (1, 672, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6a_se_squeeze/Mean for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6a_se_squeeze/Mean [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6a_se_squeeze/Mean:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6a_se_squeeze/Mean:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6a_se_squeeze/Mean [ReduceMean] outputs: [StatefulPartitionedCall/efficientnet-b0/block6a_se_squeeze/Mean:0 -> (1, 672)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6a_se_reshape/Reshape [Reshape] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6a_se_squeeze/Mean:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__511 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6a_se_reshape/Reshape [Reshape] inputs: [StatefulPartitionedCall/efficientnet-b0/block6a_se_squeeze/Mean:0 -> (1, 672)], [const_fold_opt__511 -> (4)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6a_se_reshape/Reshape for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6a_se_reshape/Reshape [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6a_se_reshape/Reshape:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6a_se_reshape/Reshape:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6a_se_reshape/Reshape [Reshape] outputs: [StatefulPartitionedCall/efficientnet-b0/block6a_se_reshape/Reshape:0 -> (1, 1, 1, 672)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/BiasAdd__255 [Reshape] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6a_se_reshape/Reshape:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: new_shape__495 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/BiasAdd__255 [Reshape] inputs: [StatefulPartitionedCall/efficientnet-b0/block6a_se_reshape/Reshape:0 -> (1, 1, 1, 672)], [new_shape__495 -> (4)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/BiasAdd__255 for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/BiasAdd__255 [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/BiasAdd__255:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/BiasAdd__255:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/BiasAdd__255 [Reshape] outputs: [StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/BiasAdd__255:0 -> (1, 672, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/BiasAdd [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/BiasAdd__255:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/BiasAdd [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/BiasAdd__255:0 -> (1, 672, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/Conv2D/ReadVariableOp:0 -> (28, 672, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/BiasAdd/ReadVariableOp:0 -> (28)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 672, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/BiasAdd for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/BiasAdd [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 28 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 28, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/BiasAdd [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/BiasAdd:0 -> (1, 28, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/BiasAdd:0 -> (1, 28, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/Sigmoid:0 -> (1, 28, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/BiasAdd:0 -> (1, 28, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/Sigmoid:0 -> (1, 28, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/mul:0 -> (1, 28, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6a_se_expand/BiasAdd [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6a_se_expand/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6a_se_expand/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6a_se_expand/BiasAdd [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/mul:0 -> (1, 28, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block6a_se_expand/Conv2D/ReadVariableOp:0 -> (672, 28, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block6a_se_expand/BiasAdd/ReadVariableOp:0 -> (672)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 28, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6a_se_expand/BiasAdd for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6a_se_expand/BiasAdd [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 672 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 672, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6a_se_expand/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6a_se_expand/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6a_se_expand/BiasAdd [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block6a_se_expand/BiasAdd:0 -> (1, 672, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6a_se_expand/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6a_se_expand/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6a_se_expand/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block6a_se_expand/BiasAdd:0 -> (1, 672, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6a_se_expand/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6a_se_expand/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6a_se_expand/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6a_se_expand/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6a_se_expand/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block6a_se_expand/Sigmoid:0 -> (1, 672, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6a_se_excite/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6a_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6a_se_expand/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6a_se_excite/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block6a_activation/mul:0 -> (1, 672, 7, 7)], [StatefulPartitionedCall/efficientnet-b0/block6a_se_expand/Sigmoid:0 -> (1, 672, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6a_se_excite/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6a_se_excite/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6a_se_excite/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6a_se_excite/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6a_se_excite/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block6a_se_excite/mul:0 -> (1, 672, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6a_project_conv/Conv2D [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6a_se_excite/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6a_project_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6a_project_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6a_project_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block6a_se_excite/mul:0 -> (1, 672, 7, 7)], [StatefulPartitionedCall/efficientnet-b0/block6a_project_conv/Conv2D_weights_fused_bn -> (192, 672, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block6a_project_conv/Conv2D_bias_fused_bn -> (192)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 672, 7, 7) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6a_project_conv/Conv2D for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6a_project_conv/Conv2D [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 192 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 192, 7, 7) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6a_project_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6a_project_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6a_project_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block6a_project_bn/FusedBatchNormV3:0 -> (1, 192, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6a_project_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block6a_project_bn/FusedBatchNormV3:0 -> (1, 192, 7, 7)], [StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D/ReadVariableOp:0 -> (1152, 192, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 192, 7, 7) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1152 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 1152, 7, 7) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6b_expand_bn/FusedBatchNormV3 [BatchNormalization] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6b_expand_bn/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6b_expand_bn/ReadVariableOp_1:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6b_expand_bn/FusedBatchNormV3/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6b_expand_bn/FusedBatchNormV3/ReadVariableOp_1:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6b_expand_bn/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D:0 -> (1, 1152, 7, 7)], [StatefulPartitionedCall/efficientnet-b0/block6b_expand_bn/ReadVariableOp:0 -> (1152)], [StatefulPartitionedCall/efficientnet-b0/block6b_expand_bn/ReadVariableOp_1:0 -> (1152)], [StatefulPartitionedCall/efficientnet-b0/block6b_expand_bn/FusedBatchNormV3/ReadVariableOp:0 -> (1152)], [StatefulPartitionedCall/efficientnet-b0/block6b_expand_bn/FusedBatchNormV3/ReadVariableOp_1:0 -> (1152)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6b_expand_bn/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6b_expand_bn/FusedBatchNormV3 [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6b_expand_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6b_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6b_expand_bn/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/efficientnet-b0/block6b_expand_bn/FusedBatchNormV3:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6b_expand_activation/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6b_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6b_expand_activation/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block6b_expand_bn/FusedBatchNormV3:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6b_expand_activation/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6b_expand_activation/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6b_expand_activation/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6b_expand_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6b_expand_activation/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block6b_expand_activation/Sigmoid:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6b_expand_activation/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6b_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6b_expand_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6b_expand_activation/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block6b_expand_bn/FusedBatchNormV3:0 -> (1, 1152, 7, 7)], [StatefulPartitionedCall/efficientnet-b0/block6b_expand_activation/Sigmoid:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6b_expand_activation/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6b_expand_activation/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6b_expand_activation/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6b_expand_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6b_expand_activation/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block6b_expand_activation/mul:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6b_dwconv/depthwise [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6b_expand_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6b_dwconv/depthwise_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6b_dwconv/depthwise_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6b_dwconv/depthwise [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block6b_expand_activation/mul:0 -> (1, 1152, 7, 7)], [StatefulPartitionedCall/efficientnet-b0/block6b_dwconv/depthwise_weights_fused_bn -> (1152, 1, 5, 5)], [StatefulPartitionedCall/efficientnet-b0/block6b_dwconv/depthwise_bias_fused_bn -> (1152)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 1152, 7, 7) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6b_dwconv/depthwise for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6b_dwconv/depthwise [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (5, 5), strides: (1, 1), prepadding: (2, 2), postpadding: (2, 2), dilations: (1, 1), numOutputs: 1152 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 1152, 7, 7) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6b_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6b_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6b_dwconv/depthwise [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block6b_bn/FusedBatchNormV3:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6b_activation/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6b_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6b_activation/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block6b_bn/FusedBatchNormV3:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6b_activation/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6b_activation/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6b_activation/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6b_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6b_activation/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block6b_activation/Sigmoid:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6b_activation/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6b_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6b_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6b_activation/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block6b_bn/FusedBatchNormV3:0 -> (1, 1152, 7, 7)], [StatefulPartitionedCall/efficientnet-b0/block6b_activation/Sigmoid:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6b_activation/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6b_activation/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6b_activation/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6b_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6b_activation/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block6b_activation/mul:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6b_se_squeeze/Mean [ReduceMean] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6b_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6b_se_squeeze/Mean [ReduceMean] inputs: [StatefulPartitionedCall/efficientnet-b0/block6b_activation/mul:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6b_se_squeeze/Mean for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6b_se_squeeze/Mean [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6b_se_squeeze/Mean:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6b_se_squeeze/Mean:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6b_se_squeeze/Mean [ReduceMean] outputs: [StatefulPartitionedCall/efficientnet-b0/block6b_se_squeeze/Mean:0 -> (1, 1152)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6b_se_reshape/Reshape [Reshape] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6b_se_squeeze/Mean:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__525 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6b_se_reshape/Reshape [Reshape] inputs: [StatefulPartitionedCall/efficientnet-b0/block6b_se_squeeze/Mean:0 -> (1, 1152)], [const_fold_opt__525 -> (4)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6b_se_reshape/Reshape for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6b_se_reshape/Reshape [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6b_se_reshape/Reshape:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6b_se_reshape/Reshape:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6b_se_reshape/Reshape [Reshape] outputs: [StatefulPartitionedCall/efficientnet-b0/block6b_se_reshape/Reshape:0 -> (1, 1, 1, 1152)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd__275 [Reshape] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6b_se_reshape/Reshape:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: new_shape__499 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd__275 [Reshape] inputs: [StatefulPartitionedCall/efficientnet-b0/block6b_se_reshape/Reshape:0 -> (1, 1, 1, 1152)], [new_shape__499 -> (4)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd__275 for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd__275 [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd__275:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd__275:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd__275 [Reshape] outputs: [StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd__275:0 -> (1, 1152, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd__275:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd__275:0 -> (1, 1152, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/Conv2D/ReadVariableOp:0 -> (48, 1152, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd/ReadVariableOp:0 -> (48)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 1152, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 48 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 48, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd:0 -> (1, 48, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd:0 -> (1, 48, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/Sigmoid:0 -> (1, 48, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd:0 -> (1, 48, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/Sigmoid:0 -> (1, 48, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/mul:0 -> (1, 48, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/mul:0 -> (1, 48, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/Conv2D/ReadVariableOp:0 -> (1152, 48, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd/ReadVariableOp:0 -> (1152)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 48, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1152 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 1152, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd:0 -> (1, 1152, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd:0 -> (1, 1152, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/Sigmoid:0 -> (1, 1152, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6b_se_excite/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6b_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6b_se_excite/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block6b_activation/mul:0 -> (1, 1152, 7, 7)], [StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/Sigmoid:0 -> (1, 1152, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6b_se_excite/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6b_se_excite/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6b_se_excite/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6b_se_excite/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6b_se_excite/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block6b_se_excite/mul:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6b_se_excite/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block6b_se_excite/mul:0 -> (1, 1152, 7, 7)], [StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D_weights_fused_bn -> (192, 1152, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D_bias_fused_bn -> (192)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 1152, 7, 7) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 192 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 192, 7, 7) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6b_project_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6b_project_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block6b_project_bn/FusedBatchNormV3:0 -> (1, 192, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6b_add/add [Add] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6b_project_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6a_project_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6b_add/add [Add] inputs: [StatefulPartitionedCall/efficientnet-b0/block6b_project_bn/FusedBatchNormV3:0 -> (1, 192, 7, 7)], [StatefulPartitionedCall/efficientnet-b0/block6a_project_bn/FusedBatchNormV3:0 -> (1, 192, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6b_add/add for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6b_add/add [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6b_add/add:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6b_add/add:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6b_add/add [Add] outputs: [StatefulPartitionedCall/efficientnet-b0/block6b_add/add:0 -> (1, 192, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6c_expand_conv/Conv2D [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6b_add/add:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6c_expand_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6c_expand_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6c_expand_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block6b_add/add:0 -> (1, 192, 7, 7)], [StatefulPartitionedCall/efficientnet-b0/block6c_expand_conv/Conv2D_weights_fused_bn -> (1152, 192, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block6c_expand_conv/Conv2D_bias_fused_bn -> (1152)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 192, 7, 7) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6c_expand_conv/Conv2D for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6c_expand_conv/Conv2D [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1152 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 1152, 7, 7) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6c_expand_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6c_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6c_expand_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block6c_expand_bn/FusedBatchNormV3:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6c_expand_activation/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6c_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6c_expand_activation/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block6c_expand_bn/FusedBatchNormV3:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6c_expand_activation/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6c_expand_activation/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6c_expand_activation/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6c_expand_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6c_expand_activation/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block6c_expand_activation/Sigmoid:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6c_expand_activation/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6c_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6c_expand_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6c_expand_activation/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block6c_expand_bn/FusedBatchNormV3:0 -> (1, 1152, 7, 7)], [StatefulPartitionedCall/efficientnet-b0/block6c_expand_activation/Sigmoid:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6c_expand_activation/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6c_expand_activation/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6c_expand_activation/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6c_expand_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6c_expand_activation/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block6c_expand_activation/mul:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6c_dwconv/depthwise [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6c_expand_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6c_dwconv/depthwise_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6c_dwconv/depthwise_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6c_dwconv/depthwise [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block6c_expand_activation/mul:0 -> (1, 1152, 7, 7)], [StatefulPartitionedCall/efficientnet-b0/block6c_dwconv/depthwise_weights_fused_bn -> (1152, 1, 5, 5)], [StatefulPartitionedCall/efficientnet-b0/block6c_dwconv/depthwise_bias_fused_bn -> (1152)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 1152, 7, 7) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6c_dwconv/depthwise for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6c_dwconv/depthwise [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (5, 5), strides: (1, 1), prepadding: (2, 2), postpadding: (2, 2), dilations: (1, 1), numOutputs: 1152 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 1152, 7, 7) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6c_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6c_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6c_dwconv/depthwise [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block6c_bn/FusedBatchNormV3:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6c_activation/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6c_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6c_activation/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block6c_bn/FusedBatchNormV3:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6c_activation/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6c_activation/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6c_activation/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6c_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6c_activation/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block6c_activation/Sigmoid:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6c_activation/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6c_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6c_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6c_activation/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block6c_bn/FusedBatchNormV3:0 -> (1, 1152, 7, 7)], [StatefulPartitionedCall/efficientnet-b0/block6c_activation/Sigmoid:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6c_activation/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6c_activation/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6c_activation/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6c_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6c_activation/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block6c_activation/mul:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6c_se_squeeze/Mean [ReduceMean] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6c_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6c_se_squeeze/Mean [ReduceMean] inputs: [StatefulPartitionedCall/efficientnet-b0/block6c_activation/mul:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6c_se_squeeze/Mean for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6c_se_squeeze/Mean [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6c_se_squeeze/Mean:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6c_se_squeeze/Mean:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6c_se_squeeze/Mean [ReduceMean] outputs: [StatefulPartitionedCall/efficientnet-b0/block6c_se_squeeze/Mean:0 -> (1, 1152)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6c_se_reshape/Reshape [Reshape] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6c_se_squeeze/Mean:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__525 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6c_se_reshape/Reshape [Reshape] inputs: [StatefulPartitionedCall/efficientnet-b0/block6c_se_squeeze/Mean:0 -> (1, 1152)], [const_fold_opt__525 -> (4)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6c_se_reshape/Reshape for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6c_se_reshape/Reshape [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6c_se_reshape/Reshape:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6c_se_reshape/Reshape:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6c_se_reshape/Reshape [Reshape] outputs: [StatefulPartitionedCall/efficientnet-b0/block6c_se_reshape/Reshape:0 -> (1, 1, 1, 1152)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/BiasAdd__295 [Reshape] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6c_se_reshape/Reshape:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: new_shape__499 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/BiasAdd__295 [Reshape] inputs: [StatefulPartitionedCall/efficientnet-b0/block6c_se_reshape/Reshape:0 -> (1, 1, 1, 1152)], [new_shape__499 -> (4)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/BiasAdd__295 for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/BiasAdd__295 [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/BiasAdd__295:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/BiasAdd__295:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/BiasAdd__295 [Reshape] outputs: [StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/BiasAdd__295:0 -> (1, 1152, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/BiasAdd [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/BiasAdd__295:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/BiasAdd [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/BiasAdd__295:0 -> (1, 1152, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/Conv2D/ReadVariableOp:0 -> (48, 1152, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/BiasAdd/ReadVariableOp:0 -> (48)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 1152, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/BiasAdd for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/BiasAdd [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 48 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 48, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/BiasAdd [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/BiasAdd:0 -> (1, 48, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/BiasAdd:0 -> (1, 48, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/Sigmoid:0 -> (1, 48, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/BiasAdd:0 -> (1, 48, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/Sigmoid:0 -> (1, 48, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/mul:0 -> (1, 48, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6c_se_expand/BiasAdd [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6c_se_expand/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6c_se_expand/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6c_se_expand/BiasAdd [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/mul:0 -> (1, 48, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block6c_se_expand/Conv2D/ReadVariableOp:0 -> (1152, 48, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block6c_se_expand/BiasAdd/ReadVariableOp:0 -> (1152)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 48, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6c_se_expand/BiasAdd for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6c_se_expand/BiasAdd [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1152 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 1152, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6c_se_expand/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6c_se_expand/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6c_se_expand/BiasAdd [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block6c_se_expand/BiasAdd:0 -> (1, 1152, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6c_se_expand/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6c_se_expand/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6c_se_expand/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block6c_se_expand/BiasAdd:0 -> (1, 1152, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6c_se_expand/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6c_se_expand/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6c_se_expand/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6c_se_expand/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6c_se_expand/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block6c_se_expand/Sigmoid:0 -> (1, 1152, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6c_se_excite/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6c_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6c_se_expand/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6c_se_excite/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block6c_activation/mul:0 -> (1, 1152, 7, 7)], [StatefulPartitionedCall/efficientnet-b0/block6c_se_expand/Sigmoid:0 -> (1, 1152, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6c_se_excite/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6c_se_excite/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6c_se_excite/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6c_se_excite/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6c_se_excite/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block6c_se_excite/mul:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6c_project_conv/Conv2D [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6c_se_excite/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6c_project_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6c_project_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6c_project_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block6c_se_excite/mul:0 -> (1, 1152, 7, 7)], [StatefulPartitionedCall/efficientnet-b0/block6c_project_conv/Conv2D_weights_fused_bn -> (192, 1152, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block6c_project_conv/Conv2D_bias_fused_bn -> (192)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 1152, 7, 7) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6c_project_conv/Conv2D for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6c_project_conv/Conv2D [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 192 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 192, 7, 7) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6c_project_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6c_project_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6c_project_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block6c_project_bn/FusedBatchNormV3:0 -> (1, 192, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6c_add/add [Add] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6c_project_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6b_add/add:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6c_add/add [Add] inputs: [StatefulPartitionedCall/efficientnet-b0/block6c_project_bn/FusedBatchNormV3:0 -> (1, 192, 7, 7)], [StatefulPartitionedCall/efficientnet-b0/block6b_add/add:0 -> (1, 192, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6c_add/add for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6c_add/add [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6c_add/add:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6c_add/add:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6c_add/add [Add] outputs: [StatefulPartitionedCall/efficientnet-b0/block6c_add/add:0 -> (1, 192, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6d_expand_conv/Conv2D [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6c_add/add:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6d_expand_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6d_expand_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6d_expand_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block6c_add/add:0 -> (1, 192, 7, 7)], [StatefulPartitionedCall/efficientnet-b0/block6d_expand_conv/Conv2D_weights_fused_bn -> (1152, 192, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block6d_expand_conv/Conv2D_bias_fused_bn -> (1152)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 192, 7, 7) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6d_expand_conv/Conv2D for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6d_expand_conv/Conv2D [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1152 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 1152, 7, 7) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6d_expand_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6d_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6d_expand_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block6d_expand_bn/FusedBatchNormV3:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6d_expand_activation/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6d_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6d_expand_activation/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block6d_expand_bn/FusedBatchNormV3:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6d_expand_activation/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6d_expand_activation/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6d_expand_activation/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6d_expand_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6d_expand_activation/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block6d_expand_activation/Sigmoid:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6d_expand_activation/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6d_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6d_expand_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6d_expand_activation/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block6d_expand_bn/FusedBatchNormV3:0 -> (1, 1152, 7, 7)], [StatefulPartitionedCall/efficientnet-b0/block6d_expand_activation/Sigmoid:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6d_expand_activation/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6d_expand_activation/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6d_expand_activation/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6d_expand_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6d_expand_activation/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block6d_expand_activation/mul:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6d_dwconv/depthwise [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6d_expand_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6d_dwconv/depthwise_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6d_dwconv/depthwise_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6d_dwconv/depthwise [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block6d_expand_activation/mul:0 -> (1, 1152, 7, 7)], [StatefulPartitionedCall/efficientnet-b0/block6d_dwconv/depthwise_weights_fused_bn -> (1152, 1, 5, 5)], [StatefulPartitionedCall/efficientnet-b0/block6d_dwconv/depthwise_bias_fused_bn -> (1152)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 1152, 7, 7) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6d_dwconv/depthwise for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6d_dwconv/depthwise [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (5, 5), strides: (1, 1), prepadding: (2, 2), postpadding: (2, 2), dilations: (1, 1), numOutputs: 1152 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 1152, 7, 7) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6d_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6d_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6d_dwconv/depthwise [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block6d_bn/FusedBatchNormV3:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6d_activation/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6d_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6d_activation/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block6d_bn/FusedBatchNormV3:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6d_activation/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6d_activation/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6d_activation/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6d_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6d_activation/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block6d_activation/Sigmoid:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6d_activation/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6d_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6d_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6d_activation/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block6d_bn/FusedBatchNormV3:0 -> (1, 1152, 7, 7)], [StatefulPartitionedCall/efficientnet-b0/block6d_activation/Sigmoid:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6d_activation/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6d_activation/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6d_activation/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6d_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6d_activation/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block6d_activation/mul:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6d_se_squeeze/Mean [ReduceMean] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6d_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6d_se_squeeze/Mean [ReduceMean] inputs: [StatefulPartitionedCall/efficientnet-b0/block6d_activation/mul:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6d_se_squeeze/Mean for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6d_se_squeeze/Mean [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6d_se_squeeze/Mean:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6d_se_squeeze/Mean:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6d_se_squeeze/Mean [ReduceMean] outputs: [StatefulPartitionedCall/efficientnet-b0/block6d_se_squeeze/Mean:0 -> (1, 1152)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6d_se_reshape/Reshape [Reshape] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6d_se_squeeze/Mean:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__525 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6d_se_reshape/Reshape [Reshape] inputs: [StatefulPartitionedCall/efficientnet-b0/block6d_se_squeeze/Mean:0 -> (1, 1152)], [const_fold_opt__525 -> (4)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6d_se_reshape/Reshape for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6d_se_reshape/Reshape [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6d_se_reshape/Reshape:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6d_se_reshape/Reshape:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6d_se_reshape/Reshape [Reshape] outputs: [StatefulPartitionedCall/efficientnet-b0/block6d_se_reshape/Reshape:0 -> (1, 1, 1, 1152)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/BiasAdd__315 [Reshape] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6d_se_reshape/Reshape:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: new_shape__499 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/BiasAdd__315 [Reshape] inputs: [StatefulPartitionedCall/efficientnet-b0/block6d_se_reshape/Reshape:0 -> (1, 1, 1, 1152)], [new_shape__499 -> (4)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/BiasAdd__315 for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/BiasAdd__315 [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/BiasAdd__315:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/BiasAdd__315:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/BiasAdd__315 [Reshape] outputs: [StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/BiasAdd__315:0 -> (1, 1152, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/BiasAdd [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/BiasAdd__315:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/BiasAdd [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/BiasAdd__315:0 -> (1, 1152, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/Conv2D/ReadVariableOp:0 -> (48, 1152, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/BiasAdd/ReadVariableOp:0 -> (48)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 1152, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/BiasAdd for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/BiasAdd [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 48 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 48, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/BiasAdd [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/BiasAdd:0 -> (1, 48, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/BiasAdd:0 -> (1, 48, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/Sigmoid:0 -> (1, 48, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/BiasAdd:0 -> (1, 48, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/Sigmoid:0 -> (1, 48, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/mul:0 -> (1, 48, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6d_se_expand/BiasAdd [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6d_se_expand/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6d_se_expand/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6d_se_expand/BiasAdd [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/mul:0 -> (1, 48, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block6d_se_expand/Conv2D/ReadVariableOp:0 -> (1152, 48, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block6d_se_expand/BiasAdd/ReadVariableOp:0 -> (1152)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 48, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6d_se_expand/BiasAdd for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6d_se_expand/BiasAdd [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1152 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 1152, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6d_se_expand/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6d_se_expand/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6d_se_expand/BiasAdd [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block6d_se_expand/BiasAdd:0 -> (1, 1152, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6d_se_expand/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6d_se_expand/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6d_se_expand/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block6d_se_expand/BiasAdd:0 -> (1, 1152, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6d_se_expand/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6d_se_expand/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6d_se_expand/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6d_se_expand/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6d_se_expand/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block6d_se_expand/Sigmoid:0 -> (1, 1152, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6d_se_excite/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6d_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6d_se_expand/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6d_se_excite/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block6d_activation/mul:0 -> (1, 1152, 7, 7)], [StatefulPartitionedCall/efficientnet-b0/block6d_se_expand/Sigmoid:0 -> (1, 1152, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6d_se_excite/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6d_se_excite/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6d_se_excite/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6d_se_excite/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6d_se_excite/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block6d_se_excite/mul:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6d_project_conv/Conv2D [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6d_se_excite/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6d_project_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6d_project_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6d_project_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block6d_se_excite/mul:0 -> (1, 1152, 7, 7)], [StatefulPartitionedCall/efficientnet-b0/block6d_project_conv/Conv2D_weights_fused_bn -> (192, 1152, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block6d_project_conv/Conv2D_bias_fused_bn -> (192)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 1152, 7, 7) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6d_project_conv/Conv2D for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6d_project_conv/Conv2D [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 192 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 192, 7, 7) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6d_project_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6d_project_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6d_project_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block6d_project_bn/FusedBatchNormV3:0 -> (1, 192, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block6d_add/add [Add] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6d_project_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6c_add/add:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block6d_add/add [Add] inputs: [StatefulPartitionedCall/efficientnet-b0/block6d_project_bn/FusedBatchNormV3:0 -> (1, 192, 7, 7)], [StatefulPartitionedCall/efficientnet-b0/block6c_add/add:0 -> (1, 192, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block6d_add/add for ONNX node: StatefulPartitionedCall/efficientnet-b0/block6d_add/add [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block6d_add/add:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block6d_add/add:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block6d_add/add [Add] outputs: [StatefulPartitionedCall/efficientnet-b0/block6d_add/add:0 -> (1, 192, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block7a_expand_conv/Conv2D [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block6d_add/add:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block7a_expand_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block7a_expand_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block7a_expand_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block6d_add/add:0 -> (1, 192, 7, 7)], [StatefulPartitionedCall/efficientnet-b0/block7a_expand_conv/Conv2D_weights_fused_bn -> (1152, 192, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block7a_expand_conv/Conv2D_bias_fused_bn -> (1152)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 192, 7, 7) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block7a_expand_conv/Conv2D for ONNX node: StatefulPartitionedCall/efficientnet-b0/block7a_expand_conv/Conv2D [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1152 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 1152, 7, 7) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block7a_expand_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block7a_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block7a_expand_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block7a_expand_bn/FusedBatchNormV3:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block7a_expand_activation/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block7a_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block7a_expand_activation/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block7a_expand_bn/FusedBatchNormV3:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block7a_expand_activation/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block7a_expand_activation/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block7a_expand_activation/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block7a_expand_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block7a_expand_activation/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block7a_expand_activation/Sigmoid:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block7a_expand_activation/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block7a_expand_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block7a_expand_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block7a_expand_activation/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block7a_expand_bn/FusedBatchNormV3:0 -> (1, 1152, 7, 7)], [StatefulPartitionedCall/efficientnet-b0/block7a_expand_activation/Sigmoid:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block7a_expand_activation/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block7a_expand_activation/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block7a_expand_activation/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block7a_expand_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block7a_expand_activation/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block7a_expand_activation/mul:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block7a_expand_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block7a_expand_activation/mul:0 -> (1, 1152, 7, 7)], [StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise_weights_fused_bn -> (1152, 1, 3, 3)], [StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise_bias_fused_bn -> (1152)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 1152, 7, 7) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise for ONNX node: StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 1152 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 1152, 7, 7) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block7a_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block7a_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block7a_bn/FusedBatchNormV3:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block7a_activation/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block7a_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block7a_activation/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block7a_bn/FusedBatchNormV3:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block7a_activation/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block7a_activation/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block7a_activation/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block7a_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block7a_activation/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block7a_activation/Sigmoid:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block7a_activation/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block7a_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block7a_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block7a_activation/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block7a_bn/FusedBatchNormV3:0 -> (1, 1152, 7, 7)], [StatefulPartitionedCall/efficientnet-b0/block7a_activation/Sigmoid:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block7a_activation/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block7a_activation/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block7a_activation/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block7a_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block7a_activation/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block7a_activation/mul:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block7a_se_squeeze/Mean [ReduceMean] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block7a_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block7a_se_squeeze/Mean [ReduceMean] inputs: [StatefulPartitionedCall/efficientnet-b0/block7a_activation/mul:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block7a_se_squeeze/Mean for ONNX node: StatefulPartitionedCall/efficientnet-b0/block7a_se_squeeze/Mean [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block7a_se_squeeze/Mean:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block7a_se_squeeze/Mean:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block7a_se_squeeze/Mean [ReduceMean] outputs: [StatefulPartitionedCall/efficientnet-b0/block7a_se_squeeze/Mean:0 -> (1, 1152)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block7a_se_reshape/Reshape [Reshape] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block7a_se_squeeze/Mean:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__525 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block7a_se_reshape/Reshape [Reshape] inputs: [StatefulPartitionedCall/efficientnet-b0/block7a_se_squeeze/Mean:0 -> (1, 1152)], [const_fold_opt__525 -> (4)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block7a_se_reshape/Reshape for ONNX node: StatefulPartitionedCall/efficientnet-b0/block7a_se_reshape/Reshape [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block7a_se_reshape/Reshape:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block7a_se_reshape/Reshape:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block7a_se_reshape/Reshape [Reshape] outputs: [StatefulPartitionedCall/efficientnet-b0/block7a_se_reshape/Reshape:0 -> (1, 1, 1, 1152)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/BiasAdd__335 [Reshape] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block7a_se_reshape/Reshape:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: new_shape__499 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/BiasAdd__335 [Reshape] inputs: [StatefulPartitionedCall/efficientnet-b0/block7a_se_reshape/Reshape:0 -> (1, 1, 1, 1152)], [new_shape__499 -> (4)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/BiasAdd__335 for ONNX node: StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/BiasAdd__335 [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/BiasAdd__335:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/BiasAdd__335:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/BiasAdd__335 [Reshape] outputs: [StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/BiasAdd__335:0 -> (1, 1152, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/BiasAdd [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/BiasAdd__335:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/BiasAdd [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/BiasAdd__335:0 -> (1, 1152, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/Conv2D/ReadVariableOp:0 -> (48, 1152, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/BiasAdd/ReadVariableOp:0 -> (48)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 1152, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/BiasAdd for ONNX node: StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/BiasAdd [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 48 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 48, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/BiasAdd [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/BiasAdd:0 -> (1, 48, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/BiasAdd:0 -> (1, 48, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/Sigmoid:0 -> (1, 48, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/BiasAdd:0 -> (1, 48, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/Sigmoid:0 -> (1, 48, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/mul:0 -> (1, 48, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block7a_se_expand/BiasAdd [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block7a_se_expand/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block7a_se_expand/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block7a_se_expand/BiasAdd [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/mul:0 -> (1, 48, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block7a_se_expand/Conv2D/ReadVariableOp:0 -> (1152, 48, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block7a_se_expand/BiasAdd/ReadVariableOp:0 -> (1152)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 48, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block7a_se_expand/BiasAdd for ONNX node: StatefulPartitionedCall/efficientnet-b0/block7a_se_expand/BiasAdd [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1152 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 1152, 1, 1) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block7a_se_expand/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block7a_se_expand/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block7a_se_expand/BiasAdd [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block7a_se_expand/BiasAdd:0 -> (1, 1152, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block7a_se_expand/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block7a_se_expand/BiasAdd:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block7a_se_expand/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/block7a_se_expand/BiasAdd:0 -> (1, 1152, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block7a_se_expand/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/block7a_se_expand/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block7a_se_expand/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block7a_se_expand/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block7a_se_expand/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/block7a_se_expand/Sigmoid:0 -> (1, 1152, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block7a_se_excite/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block7a_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block7a_se_expand/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block7a_se_excite/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/block7a_activation/mul:0 -> (1, 1152, 7, 7)], [StatefulPartitionedCall/efficientnet-b0/block7a_se_expand/Sigmoid:0 -> (1, 1152, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block7a_se_excite/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/block7a_se_excite/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block7a_se_excite/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block7a_se_excite/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block7a_se_excite/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/block7a_se_excite/mul:0 -> (1, 1152, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/block7a_project_conv/Conv2D [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block7a_se_excite/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block7a_project_conv/Conv2D_weights_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block7a_project_conv/Conv2D_bias_fused_bn [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/block7a_project_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block7a_se_excite/mul:0 -> (1, 1152, 7, 7)], [StatefulPartitionedCall/efficientnet-b0/block7a_project_conv/Conv2D_weights_fused_bn -> (320, 1152, 1, 1)], [StatefulPartitionedCall/efficientnet-b0/block7a_project_conv/Conv2D_bias_fused_bn -> (320)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 1152, 7, 7) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/block7a_project_conv/Conv2D for ONNX node: StatefulPartitionedCall/efficientnet-b0/block7a_project_conv/Conv2D [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 320 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 320, 7, 7) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/block7a_project_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/block7a_project_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/block7a_project_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/block7a_project_bn/FusedBatchNormV3:0 -> (1, 320, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D [Conv] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/block7a_project_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D [Conv] inputs: [StatefulPartitionedCall/efficientnet-b0/block7a_project_bn/FusedBatchNormV3:0 -> (1, 320, 7, 7)], [StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D/ReadVariableOp:0 -> (1280, 320, 1, 1)], [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:450: Convolution input dimensions: (1, 320, 7, 7) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D for ONNX node: StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:533: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1280 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:534: Convolution output dimensions: (1, 1280, 7, 7) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D [Conv] outputs: [StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D:0 -> (1, 1280, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/top_bn/FusedBatchNormV3 [BatchNormalization] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/top_bn/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/top_bn/ReadVariableOp_1:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/top_bn/FusedBatchNormV3/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/top_bn/FusedBatchNormV3/ReadVariableOp_1:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/top_bn/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D:0 -> (1, 1280, 7, 7)], [StatefulPartitionedCall/efficientnet-b0/top_bn/ReadVariableOp:0 -> (1280)], [StatefulPartitionedCall/efficientnet-b0/top_bn/ReadVariableOp_1:0 -> (1280)], [StatefulPartitionedCall/efficientnet-b0/top_bn/FusedBatchNormV3/ReadVariableOp:0 -> (1280)], [StatefulPartitionedCall/efficientnet-b0/top_bn/FusedBatchNormV3/ReadVariableOp_1:0 -> (1280)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/top_bn/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/efficientnet-b0/top_bn/FusedBatchNormV3 [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/top_bn/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/top_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/top_bn/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/efficientnet-b0/top_bn/FusedBatchNormV3:0 -> (1, 1280, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/top_activation/Sigmoid [Sigmoid] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/top_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/top_activation/Sigmoid [Sigmoid] inputs: [StatefulPartitionedCall/efficientnet-b0/top_bn/FusedBatchNormV3:0 -> (1, 1280, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/top_activation/Sigmoid for ONNX node: StatefulPartitionedCall/efficientnet-b0/top_activation/Sigmoid [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/top_activation/Sigmoid:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/top_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/top_activation/Sigmoid [Sigmoid] outputs: [StatefulPartitionedCall/efficientnet-b0/top_activation/Sigmoid:0 -> (1, 1280, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/top_activation/mul [Mul] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/top_bn/FusedBatchNormV3:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/top_activation/Sigmoid:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/top_activation/mul [Mul] inputs: [StatefulPartitionedCall/efficientnet-b0/top_bn/FusedBatchNormV3:0 -> (1, 1280, 7, 7)], [StatefulPartitionedCall/efficientnet-b0/top_activation/Sigmoid:0 -> (1, 1280, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/top_activation/mul for ONNX node: StatefulPartitionedCall/efficientnet-b0/top_activation/mul [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/top_activation/mul:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/top_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/top_activation/mul [Mul] outputs: [StatefulPartitionedCall/efficientnet-b0/top_activation/mul:0 -> (1, 1280, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/avg_pool/Mean [ReduceMean] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/top_activation/mul:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/avg_pool/Mean [ReduceMean] inputs: [StatefulPartitionedCall/efficientnet-b0/top_activation/mul:0 -> (1, 1280, 7, 7)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/avg_pool/Mean for ONNX node: StatefulPartitionedCall/efficientnet-b0/avg_pool/Mean [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/avg_pool/Mean:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/avg_pool/Mean:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/avg_pool/Mean [ReduceMean] outputs: [StatefulPartitionedCall/efficientnet-b0/avg_pool/Mean:0 -> (1, 1280)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/probs/MatMul_Gemm__22 [Gemm] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/avg_pool/Mean:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/probs/MatMul/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/probs/BiasAdd/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/probs/MatMul_Gemm__22 [Gemm] inputs: [StatefulPartitionedCall/efficientnet-b0/avg_pool/Mean:0 -> (1, 1280)], [StatefulPartitionedCall/efficientnet-b0/probs/MatMul/ReadVariableOp:0 -> (1280, 1000)], [StatefulPartitionedCall/efficientnet-b0/probs/BiasAdd/ReadVariableOp:0 -> (1000)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/probs/MatMul/ReadVariableOp:0 for ONNX node: StatefulPartitionedCall/efficientnet-b0/probs/MatMul/ReadVariableOp:0 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:1083: Using opA: 0 opB: 0 [04/19/2021-12:44:19] [V] [TRT] builtin_op_importers.cpp:1084: GEMM: A, after squeezing: (1, 1280) [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/probs/MatMul_Gemm__22 for ONNX node: StatefulPartitionedCall/efficientnet-b0/probs/MatMul_Gemm__22 [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: StatefulPartitionedCall/efficientnet-b0/probs/MatMul_Gemm__22:0 for ONNX tensor: StatefulPartitionedCall/efficientnet-b0/probs/MatMul_Gemm__22:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/probs/MatMul_Gemm__22 [Gemm] outputs: [StatefulPartitionedCall/efficientnet-b0/probs/MatMul_Gemm__22:0 -> (1, 1000)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:103: Parsing node: StatefulPartitionedCall/efficientnet-b0/probs/Softmax [Softmax] [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:119: Searching for input: StatefulPartitionedCall/efficientnet-b0/probs/MatMul_Gemm__22:0 [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:125: StatefulPartitionedCall/efficientnet-b0/probs/Softmax [Softmax] inputs: [StatefulPartitionedCall/efficientnet-b0/probs/MatMul_Gemm__22:0 -> (1, 1000)], [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:141: Registering layer: StatefulPartitionedCall/efficientnet-b0/probs/Softmax for ONNX node: StatefulPartitionedCall/efficientnet-b0/probs/Softmax [04/19/2021-12:44:19] [V] [TRT] ImporterContext.hpp:116: Registering tensor: probs_1 for ONNX tensor: probs [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:179: StatefulPartitionedCall/efficientnet-b0/probs/Softmax [Softmax] outputs: [probs -> (1, 1000)], [04/19/2021-12:44:19] [V] [TRT] ModelImporter.cpp:507: Marking probs_1 as output: probs ----- Parsing of ONNX model /home/sesa/model.onnx is Done ---- [04/19/2021-12:44:19] [V] [TRT] Applying generic optimizations to the graph for inference. [04/19/2021-12:44:19] [V] [TRT] Original: 285 layers [04/19/2021-12:44:19] [V] [TRT] After dead-layer removal: 285 layers [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block1a_se_reshape/Reshape with StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd__35 [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block2a_se_reshape/Reshape with StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd__55 [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block2b_se_reshape/Reshape with StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd__75 [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block3a_se_reshape/Reshape with StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/BiasAdd__95 [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block3b_se_reshape/Reshape with StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd__115 [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block4a_se_reshape/Reshape with StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/BiasAdd__135 [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block4b_se_reshape/Reshape with StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd__155 [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block4c_se_reshape/Reshape with StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/BiasAdd__175 [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block5a_se_reshape/Reshape with StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/BiasAdd__195 [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block5b_se_reshape/Reshape with StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd__215 [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block5c_se_reshape/Reshape with StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/BiasAdd__235 [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block6a_se_reshape/Reshape with StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/BiasAdd__255 [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block6b_se_reshape/Reshape with StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd__275 [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block6c_se_reshape/Reshape with StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/BiasAdd__295 [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block6d_se_reshape/Reshape with StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/BiasAdd__315 [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block7a_se_reshape/Reshape with StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/BiasAdd__335 [04/19/2021-12:44:19] [V] [TRT] Fusing (Unnamed Layer* 279) [Constant] with (Unnamed Layer* 280) [Shuffle] [04/19/2021-12:44:19] [V] [TRT] Removing (Unnamed Layer* 282) [Shuffle] [04/19/2021-12:44:19] [V] [TRT] Removing (Unnamed Layer* 284) [Shuffle] [04/19/2021-12:44:19] [V] [TRT] After Myelin optimization: 266 layers [04/19/2021-12:44:19] [V] [TRT] Fusing convolution weights from StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D with scale StatefulPartitionedCall/efficientnet-b0/block2a_expand_bn/FusedBatchNormV3 [04/19/2021-12:44:19] [V] [TRT] Fusing convolution weights from StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D with scale StatefulPartitionedCall/efficientnet-b0/block2b_expand_bn/FusedBatchNormV3 [04/19/2021-12:44:19] [V] [TRT] Fusing convolution weights from StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D with scale StatefulPartitionedCall/efficientnet-b0/block3b_expand_bn/FusedBatchNormV3 [04/19/2021-12:44:19] [V] [TRT] Fusing convolution weights from StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D with scale StatefulPartitionedCall/efficientnet-b0/block4b_expand_bn/FusedBatchNormV3 [04/19/2021-12:44:19] [V] [TRT] Fusing convolution weights from StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D with scale StatefulPartitionedCall/efficientnet-b0/block5b_expand_bn/FusedBatchNormV3 [04/19/2021-12:44:19] [V] [TRT] Fusing convolution weights from StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D with scale StatefulPartitionedCall/efficientnet-b0/block6b_expand_bn/FusedBatchNormV3 [04/19/2021-12:44:19] [V] [TRT] Fusing convolution weights from StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D with scale StatefulPartitionedCall/efficientnet-b0/top_bn/FusedBatchNormV3 [04/19/2021-12:44:19] [V] [TRT] After scale fusion: 259 layers [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D with StatefulPartitionedCall/efficientnet-b0/block2b_add/add [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D with StatefulPartitionedCall/efficientnet-b0/block3b_add/add [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D with StatefulPartitionedCall/efficientnet-b0/block4b_add/add [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block4c_project_conv/Conv2D with StatefulPartitionedCall/efficientnet-b0/block4c_add/add [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D with StatefulPartitionedCall/efficientnet-b0/block5b_add/add [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block5c_project_conv/Conv2D with StatefulPartitionedCall/efficientnet-b0/block5c_add/add [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D with StatefulPartitionedCall/efficientnet-b0/block6b_add/add [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block6c_project_conv/Conv2D with StatefulPartitionedCall/efficientnet-b0/block6c_add/add [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block6d_project_conv/Conv2D with StatefulPartitionedCall/efficientnet-b0/block6d_add/add [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/stem_activation/Sigmoid with StatefulPartitionedCall/efficientnet-b0/stem_activation/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block1a_activation/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block1a_activation/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block1a_se_excite/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block2a_expand_activation/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block2a_expand_activation/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block2a_activation/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block2a_activation/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block2a_se_excite/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block2b_expand_activation/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block2b_expand_activation/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block2b_activation/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block2b_activation/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block2b_se_excite/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block3a_expand_activation/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block3a_expand_activation/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block3a_activation/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block3a_activation/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block3a_se_expand/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block3a_se_excite/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block3b_expand_activation/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block3b_expand_activation/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block3b_activation/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block3b_activation/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block3b_se_excite/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block4a_expand_activation/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block4a_expand_activation/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block4a_activation/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block4a_activation/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block4a_se_expand/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block4a_se_excite/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block4b_expand_activation/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block4b_expand_activation/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block4b_activation/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block4b_activation/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block4b_se_excite/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block4c_expand_activation/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block4c_expand_activation/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block4c_activation/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block4c_activation/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block4c_se_expand/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block4c_se_excite/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block5a_expand_activation/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block5a_expand_activation/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block5a_activation/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block5a_activation/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block5a_se_expand/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block5a_se_excite/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block5b_expand_activation/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block5b_expand_activation/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block5b_activation/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block5b_activation/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block5b_se_excite/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block5c_expand_activation/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block5c_expand_activation/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block5c_activation/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block5c_activation/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block5c_se_expand/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block5c_se_excite/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block6a_expand_activation/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block6a_expand_activation/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block6a_activation/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block6a_activation/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block6a_se_expand/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block6a_se_excite/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block6b_expand_activation/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block6b_expand_activation/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block6b_activation/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block6b_activation/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block6b_se_excite/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block6c_expand_activation/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block6c_expand_activation/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block6c_activation/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block6c_activation/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block6c_se_expand/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block6c_se_excite/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block6d_expand_activation/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block6d_expand_activation/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block6d_activation/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block6d_activation/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block6d_se_expand/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block6d_se_excite/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block7a_expand_activation/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block7a_expand_activation/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block7a_activation/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block7a_activation/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/block7a_se_expand/Sigmoid with StatefulPartitionedCall/efficientnet-b0/block7a_se_excite/mul [04/19/2021-12:44:19] [V] [TRT] Fusing StatefulPartitionedCall/efficientnet-b0/top_activation/Sigmoid with StatefulPartitionedCall/efficientnet-b0/top_activation/mul [04/19/2021-12:44:19] [V] [TRT] After vertical fusions: 185 layers [04/19/2021-12:44:19] [V] [TRT] After final dead-layer removal: 185 layers [04/19/2021-12:44:19] [V] [TRT] After tensor merging: 185 layers [04/19/2021-12:44:19] [V] [TRT] After concat removal: 185 layers [04/19/2021-12:44:19] [V] [TRT] Graph construction and optimization completed in 0.151487 seconds. [04/19/2021-12:44:51] [V] [TRT] Constructing optimization profile number 0 [1/1]. [04/19/2021-12:44:53] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:44:53] [V] [TRT] Tactic: 1002 time 0.420755 [04/19/2021-12:44:53] [V] [TRT] Tactic: 0 time 0.681615 [04/19/2021-12:44:53] [V] [TRT] Fastest Tactic: 1002 Time: 0.420755 [04/19/2021-12:44:53] [V] [TRT] *************** Autotuning format combination: Float(1,3,672,150528) -> Float(1,224,50176,150528) *************** [04/19/2021-12:44:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D__23 (Shuffle) [04/19/2021-12:44:53] [V] [TRT] Tactic: 0 time 0.433502 [04/19/2021-12:44:53] [V] [TRT] Tactic: 1 time 2.92041 [04/19/2021-12:44:53] [V] [TRT] Fastest Tactic: 0 Time: 0.433502 [04/19/2021-12:44:53] [V] [TRT] *************** Autotuning format combination: Float(1,3,672:32,4704) -> Float(1,224,50176:32,50176) *************** [04/19/2021-12:44:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D__23 (Shuffle) [04/19/2021-12:44:53] [V] [TRT] Tactic: 0 time 0.628809 [04/19/2021-12:44:54] [V] [TRT] Tactic: 1 time 3.67862 [04/19/2021-12:44:54] [V] [TRT] Fastest Tactic: 0 Time: 0.628809 [04/19/2021-12:44:54] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:44:54] [V] [TRT] Tactic: 1002 time 0.569108 [04/19/2021-12:44:54] [V] [TRT] Tactic: 0 time 0.514186 [04/19/2021-12:44:54] [V] [TRT] Fastest Tactic: 0 Time: 0.514186 [04/19/2021-12:44:54] [V] [TRT] *************** Autotuning format combination: Float(1,224,50176,150528) -> Float(1,112,12544,401408) *************** [04/19/2021-12:44:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:44:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [04/19/2021-12:44:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:44:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:44:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:44:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [04/19/2021-12:44:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [04/19/2021-12:44:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:44:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:45:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D (FusedConvActConvolution) [04/19/2021-12:45:11] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/19/2021-12:45:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D (CaskConvolution) [04/19/2021-12:45:11] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:45:11] [V] [TRT] Tactic: 1062367460111450758 time 0.804648 [04/19/2021-12:45:11] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [04/19/2021-12:45:11] [V] [TRT] Tactic: 4337000649858996379 time 1.26451 [04/19/2021-12:45:11] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:45:11] [V] [TRT] Tactic: 4501471010995462441 time 2.38629 [04/19/2021-12:45:11] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:45:11] [V] [TRT] Tactic: 5137655947464784826 time 1.23605 [04/19/2021-12:45:11] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:45:11] [V] [TRT] Tactic: 6645123197870846056 time 1.51162 [04/19/2021-12:45:11] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [04/19/2021-12:45:11] [V] [TRT] Tactic: -9137461792520977713 time 2.98888 [04/19/2021-12:45:11] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [04/19/2021-12:45:11] [V] [TRT] Tactic: -6092040395344634144 time 1.0272 [04/19/2021-12:45:11] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:45:11] [V] [TRT] Tactic: -3456450830548107839 time 0.94571 [04/19/2021-12:45:11] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:45:12] [V] [TRT] Tactic: -410470605513481746 time 3.00936 [04/19/2021-12:45:12] [V] [TRT] Fastest Tactic: 1062367460111450758 Time: 0.804648 [04/19/2021-12:45:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D (CudaConvolution) [04/19/2021-12:45:34] [V] [TRT] Tactic: 0 time 1.69362 [04/19/2021-12:45:34] [V] [TRT] Tactic: 2 time 2.07516 [04/19/2021-12:45:35] [V] [TRT] Tactic: 5 time 41.4973 [04/19/2021-12:45:35] [V] [TRT] Tactic: 57 time 0.715196 [04/19/2021-12:45:35] [V] [TRT] Fastest Tactic: 57 Time: 0.715196 [04/19/2021-12:45:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D (CudaDepthwiseConvolution) [04/19/2021-12:45:35] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/19/2021-12:45:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 57 [04/19/2021-12:45:35] [V] [TRT] [04/19/2021-12:45:36] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:45:36] [V] [TRT] Tactic: 1002 time 1.09225 [04/19/2021-12:45:36] [V] [TRT] Tactic: 0 time 1.41225 [04/19/2021-12:45:36] [V] [TRT] Fastest Tactic: 1002 Time: 1.09225 [04/19/2021-12:45:36] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:45:36] [V] [TRT] Tactic: 1002 time 0.972252 [04/19/2021-12:45:36] [V] [TRT] Tactic: 0 time 1.3373 [04/19/2021-12:45:36] [V] [TRT] Fastest Tactic: 1002 Time: 0.972252 [04/19/2021-12:45:36] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:45:36] [V] [TRT] Tactic: 1002 time 1.4346 [04/19/2021-12:45:36] [V] [TRT] Tactic: 0 time 1.35923 [04/19/2021-12:45:36] [V] [TRT] Fastest Tactic: 0 Time: 1.35923 [04/19/2021-12:45:36] [V] [TRT] *************** Autotuning format combination: Float(1,112,12544,401408) -> Float(1,112,12544,401408) *************** [04/19/2021-12:45:56] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/stem_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/stem_activation/mul) (PointWise) [04/19/2021-12:45:56] [V] [TRT] Tactic: 128 time 2.07374 [04/19/2021-12:45:56] [V] [TRT] Tactic: 256 time 2.07911 [04/19/2021-12:45:56] [V] [TRT] Tactic: 512 time 2.10307 [04/19/2021-12:45:56] [V] [TRT] Tactic: -32 time 2.10665 [04/19/2021-12:45:56] [V] [TRT] Tactic: -64 time 2.10315 [04/19/2021-12:45:56] [V] [TRT] Tactic: -128 time 2.12154 [04/19/2021-12:45:56] [V] [TRT] Fastest Tactic: 128 Time: 2.07374 [04/19/2021-12:45:56] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/stem_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/stem_activation/mul) (PointWiseV2) [04/19/2021-12:45:56] [V] [TRT] Tactic: 0 time 0.801511 [04/19/2021-12:45:56] [V] [TRT] Tactic: 1 time 0.574818 [04/19/2021-12:45:56] [V] [TRT] Tactic: 2 time 0.513262 [04/19/2021-12:45:56] [V] [TRT] Tactic: 3 time 0.436862 [04/19/2021-12:45:56] [V] [TRT] Tactic: 4 time 0.370404 [04/19/2021-12:45:56] [V] [TRT] Tactic: 5 time 0.392122 [04/19/2021-12:45:56] [V] [TRT] Tactic: 6 time 0.37416 [04/19/2021-12:45:56] [V] [TRT] Tactic: 7 time 0.299329 [04/19/2021-12:45:56] [V] [TRT] Tactic: 8 time 0.294063 [04/19/2021-12:45:56] [V] [TRT] Tactic: 9 time 0.3261 [04/19/2021-12:45:57] [V] [TRT] Tactic: 28 time 0.775729 [04/19/2021-12:45:57] [V] [TRT] Fastest Tactic: 8 Time: 0.294063 [04/19/2021-12:45:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [04/19/2021-12:45:57] [V] [TRT] [04/19/2021-12:45:57] [V] [TRT] *************** Autotuning format combination: Float(1,112,12544:32,12544) -> Float(1,112,12544:32,12544) *************** [04/19/2021-12:46:02] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/stem_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/stem_activation/mul) (PointWise) [04/19/2021-12:46:03] [V] [TRT] Tactic: 128 time 2.0737 [04/19/2021-12:46:03] [V] [TRT] Tactic: 256 time 2.08092 [04/19/2021-12:46:03] [V] [TRT] Tactic: 512 time 2.62218 [04/19/2021-12:46:03] [V] [TRT] Tactic: -32 time 2.62889 [04/19/2021-12:46:03] [V] [TRT] Tactic: -64 time 2.10249 [04/19/2021-12:46:03] [V] [TRT] Tactic: -128 time 2.12209 [04/19/2021-12:46:03] [V] [TRT] Fastest Tactic: 128 Time: 2.0737 [04/19/2021-12:46:03] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/stem_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/stem_activation/mul) (PointWiseV2) [04/19/2021-12:46:03] [V] [TRT] Tactic: 24 time 0.534824 [04/19/2021-12:46:03] [V] [TRT] Tactic: 25 time 0.46748 [04/19/2021-12:46:03] [V] [TRT] Tactic: 26 time 0.434108 [04/19/2021-12:46:03] [V] [TRT] Tactic: 27 time 0.425586 [04/19/2021-12:46:03] [V] [TRT] Tactic: 31 time 0.531413 [04/19/2021-12:46:03] [V] [TRT] Fastest Tactic: 27 Time: 0.425586 [04/19/2021-12:46:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [04/19/2021-12:46:03] [V] [TRT] [04/19/2021-12:46:03] [V] [TRT] *************** Autotuning format combination: Float(1,112,12544,401408) -> Float(1,112,12544,401408) *************** [04/19/2021-12:46:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:46:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [04/19/2021-12:46:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [04/19/2021-12:46:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:46:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:46:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [04/19/2021-12:46:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:46:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [04/19/2021-12:46:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [04/19/2021-12:46:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [04/19/2021-12:46:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [04/19/2021-12:46:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:46:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 [04/19/2021-12:46:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [04/19/2021-12:46:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:46:03] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise (FusedConvActConvolution) [04/19/2021-12:46:03] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/19/2021-12:46:03] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise (CaskConvolution) [04/19/2021-12:46:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:46:03] [V] [TRT] Tactic: 1062367460111450758 time 8.13304 [04/19/2021-12:46:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [04/19/2021-12:46:04] [V] [TRT] Tactic: 3827454225649558724 time 23.5518 [04/19/2021-12:46:04] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [04/19/2021-12:46:04] [V] [TRT] Tactic: 4337000649858996379 time 12.3961 [04/19/2021-12:46:04] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:46:04] [V] [TRT] Tactic: 4501471010995462441 time 24.1466 [04/19/2021-12:46:04] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:46:04] [V] [TRT] Tactic: 5137655947464784826 time 12.254 [04/19/2021-12:46:04] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [04/19/2021-12:46:05] [V] [TRT] Tactic: 5921334924264294896 time 15.6672 [04/19/2021-12:46:05] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:46:05] [V] [TRT] Tactic: 6645123197870846056 time 12.1819 [04/19/2021-12:46:05] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [04/19/2021-12:46:05] [V] [TRT] Tactic: 7852627285308570038 time 24.9025 [04/19/2021-12:46:05] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [04/19/2021-12:46:06] [V] [TRT] Tactic: -9137461792520977713 time 25.0666 [04/19/2021-12:46:06] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [04/19/2021-12:46:06] [V] [TRT] Tactic: -8776506421218919509 time 22.5722 [04/19/2021-12:46:06] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [04/19/2021-12:46:06] [V] [TRT] Tactic: -6092040395344634144 time 8.2906 [04/19/2021-12:46:06] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:46:06] [V] [TRT] Tactic: -3456450830548107839 time 7.73016 [04/19/2021-12:46:06] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 [04/19/2021-12:46:07] [V] [TRT] Tactic: -2318106587342035239 time 24.151 [04/19/2021-12:46:07] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [04/19/2021-12:46:07] [V] [TRT] Tactic: -1343271414618805657 time 15.3837 [04/19/2021-12:46:07] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:46:08] [V] [TRT] Tactic: -410470605513481746 time 24.5642 [04/19/2021-12:46:08] [V] [TRT] Fastest Tactic: -3456450830548107839 Time: 7.73016 [04/19/2021-12:46:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise (CudaConvolution) [04/19/2021-12:46:08] [V] [TRT] Tactic: 0 time 1.17034 [04/19/2021-12:46:08] [V] [TRT] Tactic: 2 time 1.1707 [04/19/2021-12:46:10] [V] [TRT] Tactic: 5 time 149.06 [04/19/2021-12:46:10] [V] [TRT] Tactic: 6 time 15.8804 [04/19/2021-12:46:10] [V] [TRT] Tactic: 57 time 1.17592 [04/19/2021-12:46:10] [V] [TRT] Fastest Tactic: 0 Time: 1.17034 [04/19/2021-12:46:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise (CudaDepthwiseConvolution) [04/19/2021-12:46:10] [V] [TRT] Tactic: -1 time 0.563177 [04/19/2021-12:46:10] [V] [TRT] Fastest Tactic: -1 Time: 0.563177 [04/19/2021-12:46:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [04/19/2021-12:46:10] [V] [TRT] [04/19/2021-12:46:11] [V] [TRT] *************** Autotuning format combination: Float(1,112,12544,401408) -> Float(1,112,12544,401408) *************** [04/19/2021-12:46:11] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block1a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block1a_activation/mul) (PointWise) [04/19/2021-12:46:11] [V] [TRT] Tactic: 128 time 0.864297 [04/19/2021-12:46:11] [V] [TRT] Tactic: 256 time 0.866816 [04/19/2021-12:46:11] [V] [TRT] Tactic: 512 time 0.875534 [04/19/2021-12:46:11] [V] [TRT] Tactic: -32 time 0.89681 [04/19/2021-12:46:11] [V] [TRT] Tactic: -64 time 0.877311 [04/19/2021-12:46:11] [V] [TRT] Tactic: -128 time 0.884134 [04/19/2021-12:46:11] [V] [TRT] Fastest Tactic: 128 Time: 0.864297 [04/19/2021-12:46:11] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block1a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block1a_activation/mul) (PointWiseV2) [04/19/2021-12:46:11] [V] [TRT] Tactic: 0 time 0.404707 [04/19/2021-12:46:11] [V] [TRT] Tactic: 1 time 0.297324 [04/19/2021-12:46:11] [V] [TRT] Tactic: 2 time 0.272233 [04/19/2021-12:46:11] [V] [TRT] Tactic: 3 time 0.248496 [04/19/2021-12:46:11] [V] [TRT] Tactic: 4 time 0.196003 [04/19/2021-12:46:11] [V] [TRT] Tactic: 5 time 0.205417 [04/19/2021-12:46:11] [V] [TRT] Tactic: 6 time 0.235697 [04/19/2021-12:46:11] [V] [TRT] Tactic: 7 time 0.182565 [04/19/2021-12:46:11] [V] [TRT] Tactic: 8 time 0.169284 [04/19/2021-12:46:11] [V] [TRT] Tactic: 9 time 0.169518 [04/19/2021-12:46:11] [V] [TRT] Tactic: 28 time 0.392305 [04/19/2021-12:46:11] [V] [TRT] Fastest Tactic: 8 Time: 0.169284 [04/19/2021-12:46:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [04/19/2021-12:46:11] [V] [TRT] [04/19/2021-12:46:11] [V] [TRT] *************** Autotuning format combination: Float(1,112,12544:32,12544) -> Float(1,112,12544:32,12544) *************** [04/19/2021-12:46:11] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block1a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block1a_activation/mul) (PointWise) [04/19/2021-12:46:11] [V] [TRT] Tactic: 128 time 0.864271 [04/19/2021-12:46:11] [V] [TRT] Tactic: 256 time 0.866973 [04/19/2021-12:46:11] [V] [TRT] Tactic: 512 time 0.874857 [04/19/2021-12:46:11] [V] [TRT] Tactic: -32 time 0.896387 [04/19/2021-12:46:11] [V] [TRT] Tactic: -64 time 0.877233 [04/19/2021-12:46:11] [V] [TRT] Tactic: -128 time 0.884049 [04/19/2021-12:46:11] [V] [TRT] Fastest Tactic: 128 Time: 0.864271 [04/19/2021-12:46:11] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block1a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block1a_activation/mul) (PointWiseV2) [04/19/2021-12:46:11] [V] [TRT] Tactic: 24 time 0.288503 [04/19/2021-12:46:11] [V] [TRT] Tactic: 25 time 0.260143 [04/19/2021-12:46:11] [V] [TRT] Tactic: 26 time 0.258561 [04/19/2021-12:46:11] [V] [TRT] Tactic: 27 time 0.256081 [04/19/2021-12:46:11] [V] [TRT] Tactic: 31 time 0.290202 [04/19/2021-12:46:11] [V] [TRT] Fastest Tactic: 27 Time: 0.256081 [04/19/2021-12:46:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [04/19/2021-12:46:11] [V] [TRT] [04/19/2021-12:46:11] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:46:11] [V] [TRT] Tactic: 1002 time 1.3667 [04/19/2021-12:46:11] [V] [TRT] Tactic: 0 time 1.34708 [04/19/2021-12:46:11] [V] [TRT] Fastest Tactic: 0 Time: 1.34708 [04/19/2021-12:46:11] [V] [TRT] *************** Autotuning format combination: Float(1,112,12544,401408) -> Float(1,32) *************** [04/19/2021-12:46:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block1a_se_squeeze/Mean (Reduce) [04/19/2021-12:46:12] [V] [TRT] Tactic: 1 time 0.132539 [04/19/2021-12:46:12] [V] [TRT] Tactic: 3 time 1.18447 [04/19/2021-12:46:12] [V] [TRT] Tactic: 6 time 26.1058 [04/19/2021-12:46:12] [V] [TRT] Fastest Tactic: 1 Time: 0.132539 [04/19/2021-12:46:12] [V] [TRT] *************** Autotuning format combination: Float(1,32) -> Float(1,1,1,32) *************** [04/19/2021-12:46:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block1a_se_reshape/Reshape + StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd__35 (Shuffle) [04/19/2021-12:46:12] [V] [TRT] Tactic: 0 time 0.003457 [04/19/2021-12:46:12] [V] [TRT] Tactic: 1 time 0.00916025 [04/19/2021-12:46:12] [V] [TRT] Fastest Tactic: 0 Time: 0.003457 [04/19/2021-12:46:12] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,32) -> Float(1,1,1,8) *************** [04/19/2021-12:46:12] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:46:12] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:46:12] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:46:12] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:46:12] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:46:12] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:46:12] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:46:12] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:46:12] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:46:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd (FusedConvActConvolution) [04/19/2021-12:46:12] [V] [TRT] Tactic: 589823 time 0.0172851 [04/19/2021-12:46:12] [V] [TRT] Tactic: 655359 time 0.0167125 [04/19/2021-12:46:12] [V] [TRT] Tactic: 786431 time 0.0126756 [04/19/2021-12:46:12] [V] [TRT] Tactic: 851967 time 0.00793638 [04/19/2021-12:46:12] [V] [TRT] Tactic: 1179647 time 0.00571612 [04/19/2021-12:46:12] [V] [TRT] Tactic: 1310719 time 0.0243489 [04/19/2021-12:46:12] [V] [TRT] Tactic: 1376255 time 0.014987 [04/19/2021-12:46:12] [V] [TRT] Tactic: 1441791 time 0.00804013 [04/19/2021-12:46:12] [V] [TRT] Tactic: 1507327 time 0.0126694 [04/19/2021-12:46:12] [V] [TRT] Tactic: 1638399 time 0.0080795 [04/19/2021-12:46:12] [V] [TRT] Tactic: 1835007 time 0.0102475 [04/19/2021-12:46:12] [V] [TRT] Tactic: 1900543 time 0.0195573 [04/19/2021-12:46:12] [V] [TRT] Tactic: 2097151 time 0.00797538 [04/19/2021-12:46:12] [V] [TRT] Tactic: 2162687 time 0.0170574 [04/19/2021-12:46:12] [V] [TRT] Tactic: 2293759 time 0.0149284 [04/19/2021-12:46:12] [V] [TRT] Tactic: 2359295 time 0.0150325 [04/19/2021-12:46:12] [V] [TRT] Tactic: 2686975 time 0.0149544 [04/19/2021-12:46:12] [V] [TRT] Tactic: 3080191 time 0.0103775 [04/19/2021-12:46:12] [V] [TRT] Tactic: 3342335 time 0.0126368 [04/19/2021-12:46:12] [V] [TRT] Tactic: 3407871 time 0.0125976 [04/19/2021-12:46:12] [V] [TRT] Tactic: 3538943 time 0.00801425 [04/19/2021-12:46:12] [V] [TRT] Tactic: 3670015 time 0.0226171 [04/19/2021-12:46:12] [V] [TRT] Tactic: 3932159 time 0.0109505 [04/19/2021-12:46:12] [V] [TRT] Tactic: 3997695 time 0.00798187 [04/19/2021-12:46:12] [V] [TRT] Tactic: 4063231 time 0.00802087 [04/19/2021-12:46:12] [V] [TRT] Tactic: 4194303 time 0.0126563 [04/19/2021-12:46:12] [V] [TRT] Tactic: 4259839 time 0.00796863 [04/19/2021-12:46:12] [V] [TRT] Tactic: 4325375 time 0.0103582 [04/19/2021-12:46:12] [V] [TRT] Tactic: 4521983 time 0.0173046 [04/19/2021-12:46:12] [V] [TRT] Tactic: 4587519 time 0.00801412 [04/19/2021-12:46:12] [V] [TRT] Tactic: 4653055 time 0.00800125 [04/19/2021-12:46:12] [V] [TRT] Tactic: 4915199 time 0.00798163 [04/19/2021-12:46:12] [V] [TRT] Tactic: 4980735 time 0.0150199 [04/19/2021-12:46:12] [V] [TRT] Tactic: 5177343 time 0.0056965 [04/19/2021-12:46:12] [V] [TRT] Tactic: 5242879 time 0.0102345 [04/19/2021-12:46:12] [V] [TRT] Tactic: 5373951 time 0.00576175 [04/19/2021-12:46:13] [V] [TRT] Tactic: 5439487 time 0.0103579 [04/19/2021-12:46:13] [V] [TRT] Tactic: 5570559 time 0.0126498 [04/19/2021-12:46:13] [V] [TRT] Tactic: 5636095 time 0.0080665 [04/19/2021-12:46:13] [V] [TRT] Tactic: 5701631 time 0.0126496 [04/19/2021-12:46:13] [V] [TRT] Tactic: 5767167 time 0.00802088 [04/19/2021-12:46:13] [V] [TRT] Tactic: 5832703 time 0.0102931 [04/19/2021-12:46:13] [V] [TRT] Tactic: 5898239 time 0.00798838 [04/19/2021-12:46:13] [V] [TRT] Tactic: 6029311 time 0.0126498 [04/19/2021-12:46:13] [V] [TRT] Tactic: 6225919 time 0.00803362 [04/19/2021-12:46:13] [V] [TRT] Tactic: 6291455 time 0.00570312 [04/19/2021-12:46:13] [V] [TRT] Tactic: 6422527 time 0.00809225 [04/19/2021-12:46:13] [V] [TRT] Tactic: 6750207 time 0.00799475 [04/19/2021-12:46:13] [V] [TRT] Tactic: 6815743 time 0.0103454 [04/19/2021-12:46:13] [V] [TRT] Tactic: 6946815 time 0.0103386 [04/19/2021-12:46:13] [V] [TRT] Tactic: 7012351 time 0.00806637 [04/19/2021-12:46:13] [V] [TRT] Tactic: 7077887 time 0.00806 [04/19/2021-12:46:13] [V] [TRT] Tactic: 7143423 time 0.00800775 [04/19/2021-12:46:13] [V] [TRT] Tactic: 7208959 time 0.0103256 [04/19/2021-12:46:13] [V] [TRT] Tactic: 7340031 time 0.00798162 [04/19/2021-12:46:13] [V] [TRT] Tactic: 7405567 time 0.00797525 [04/19/2021-12:46:13] [V] [TRT] Tactic: 7536639 time 0.0103321 [04/19/2021-12:46:13] [V] [TRT] Tactic: 7602175 time 0.0103384 [04/19/2021-12:46:13] [V] [TRT] Tactic: 7733247 time 0.00872425 [04/19/2021-12:46:13] [V] [TRT] Tactic: 7798783 time 0.0126305 [04/19/2021-12:46:13] [V] [TRT] Tactic: 8191999 time 0.00803387 [04/19/2021-12:46:13] [V] [TRT] Tactic: 8257535 time 0.00794238 [04/19/2021-12:46:13] [V] [TRT] Tactic: 8323071 time 0.0103709 [04/19/2021-12:46:13] [V] [TRT] Tactic: 8650751 time 0.010319 [04/19/2021-12:46:13] [V] [TRT] Tactic: 8716287 time 0.008021 [04/19/2021-12:46:13] [V] [TRT] Tactic: 9109503 time 0.00789038 [04/19/2021-12:46:13] [V] [TRT] Tactic: 9568255 time 0.00807288 [04/19/2021-12:46:13] [V] [TRT] Tactic: 9895935 time 0.0126432 [04/19/2021-12:46:13] [V] [TRT] Tactic: 10223615 time 0.0149219 [04/19/2021-12:46:13] [V] [TRT] Tactic: 10354687 time 0.00800775 [04/19/2021-12:46:13] [V] [TRT] Tactic: 10551295 time 0.0102864 [04/19/2021-12:46:13] [V] [TRT] Tactic: 10747903 time 0.0103454 [04/19/2021-12:46:13] [V] [TRT] Tactic: 10944511 time 0.0150065 [04/19/2021-12:46:13] [V] [TRT] Fastest Tactic: 5177343 Time: 0.0056965 [04/19/2021-12:46:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd (CaskConvolution) [04/19/2021-12:46:13] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:46:13] [V] [TRT] Tactic: 1062367460111450758 time 0.0177669 [04/19/2021-12:46:13] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:46:13] [V] [TRT] Tactic: 4501471010995462441 time 0.0193749 [04/19/2021-12:46:13] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:46:13] [V] [TRT] Tactic: 5137655947464784826 time 0.0170898 [04/19/2021-12:46:13] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:46:13] [V] [TRT] Tactic: 5326823351883942011 time 0.0176106 [04/19/2021-12:46:13] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:46:13] [V] [TRT] Tactic: 6645123197870846056 time 0.0173306 [04/19/2021-12:46:13] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:46:13] [V] [TRT] Tactic: -6576203419454146580 time 0.0175782 [04/19/2021-12:46:13] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:46:13] [V] [TRT] Tactic: -3456450830548107839 time 0.0173371 [04/19/2021-12:46:13] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:46:13] [V] [TRT] Tactic: -410470605513481746 time 0.0194075 [04/19/2021-12:46:13] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:46:13] [V] [TRT] Tactic: -37215280111360163 time 0.015293 [04/19/2021-12:46:13] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.015293 [04/19/2021-12:46:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd (CudaConvolution) [04/19/2021-12:46:13] [V] [TRT] Tactic: 0 time 0.016224 [04/19/2021-12:46:13] [V] [TRT] Tactic: 2 time 0.03375 [04/19/2021-12:46:13] [V] [TRT] Tactic: 5 time 0.108692 [04/19/2021-12:46:13] [V] [TRT] Tactic: 57 time 0.018177 [04/19/2021-12:46:13] [V] [TRT] Fastest Tactic: 0 Time: 0.016224 [04/19/2021-12:46:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd (CudaDepthwiseConvolution) [04/19/2021-12:46:13] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/19/2021-12:46:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 5177343 [04/19/2021-12:46:13] [V] [TRT] [04/19/2021-12:46:13] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:46:13] [V] [TRT] Tactic: 1002 time 0.00796888 [04/19/2021-12:46:13] [V] [TRT] Tactic: 0 time 0.00548175 [04/19/2021-12:46:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00548175 [04/19/2021-12:46:13] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:46:13] [V] [TRT] Tactic: 1002 time 0.00798825 [04/19/2021-12:46:13] [V] [TRT] Tactic: 0 time 0.00549487 [04/19/2021-12:46:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00549487 [04/19/2021-12:46:13] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:46:13] [V] [TRT] Tactic: 1002 time 0.00803375 [04/19/2021-12:46:13] [V] [TRT] Tactic: 0 time 0.00552725 [04/19/2021-12:46:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00552725 [04/19/2021-12:46:13] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,8) -> Float(1,1,1,8) *************** [04/19/2021-12:46:13] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/mul) (PointWise) [04/19/2021-12:46:13] [V] [TRT] Tactic: 128 time 0.0056705 [04/19/2021-12:46:13] [V] [TRT] Tactic: 256 time 0.00576175 [04/19/2021-12:46:13] [V] [TRT] Tactic: 512 time 0.00574862 [04/19/2021-12:46:13] [V] [TRT] Fastest Tactic: 128 Time: 0.0056705 [04/19/2021-12:46:13] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/mul) (PointWiseV2) [04/19/2021-12:46:13] [V] [TRT] Tactic: 0 time 0.00369138 [04/19/2021-12:46:13] [V] [TRT] Tactic: 1 time 0.004512 [04/19/2021-12:46:13] [V] [TRT] Tactic: 2 time 0.0042905 [04/19/2021-12:46:13] [V] [TRT] Tactic: 3 time 0.0053385 [04/19/2021-12:46:13] [V] [TRT] Tactic: 4 time 0.00502625 [04/19/2021-12:46:13] [V] [TRT] Tactic: 5 time 0.00430975 [04/19/2021-12:46:13] [V] [TRT] Tactic: 6 time 0.00563788 [04/19/2021-12:46:13] [V] [TRT] Tactic: 7 time 0.00559913 [04/19/2021-12:46:13] [V] [TRT] Tactic: 8 time 0.00512375 [04/19/2021-12:46:13] [V] [TRT] Tactic: 9 time 0.00451175 [04/19/2021-12:46:13] [V] [TRT] Tactic: 28 time 0.00369825 [04/19/2021-12:46:13] [V] [TRT] Fastest Tactic: 0 Time: 0.00369138 [04/19/2021-12:46:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [04/19/2021-12:46:13] [V] [TRT] [04/19/2021-12:46:14] [V] [TRT] *************** Autotuning format combination: Float(1,1,1:32,1) -> Float(1,1,1:32,1) *************** [04/19/2021-12:46:19] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/mul) (PointWise) [04/19/2021-12:46:19] [V] [TRT] Tactic: 128 time 0.0469533 [04/19/2021-12:46:19] [V] [TRT] Tactic: 256 time 0.0469726 [04/19/2021-12:46:19] [V] [TRT] Tactic: 512 time 0.0469597 [04/19/2021-12:46:19] [V] [TRT] Tactic: -32 time 0.0599415 [04/19/2021-12:46:19] [V] [TRT] Tactic: -64 time 0.0598178 [04/19/2021-12:46:19] [V] [TRT] Tactic: -128 time 0.0597397 [04/19/2021-12:46:19] [V] [TRT] Fastest Tactic: 128 Time: 0.0469533 [04/19/2021-12:46:19] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/mul) (PointWiseV2) [04/19/2021-12:46:19] [V] [TRT] Tactic: 24 time 0.0588409 [04/19/2021-12:46:19] [V] [TRT] Tactic: 25 time 0.0588215 [04/19/2021-12:46:19] [V] [TRT] Tactic: 26 time 0.0716538 [04/19/2021-12:46:19] [V] [TRT] Tactic: 27 time 0.0716926 [04/19/2021-12:46:19] [V] [TRT] Tactic: 31 time 0.0588413 [04/19/2021-12:46:19] [V] [TRT] Fastest Tactic: 25 Time: 0.0588215 [04/19/2021-12:46:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [04/19/2021-12:46:19] [V] [TRT] [04/19/2021-12:46:19] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,8) -> Float(1,1,1,32) *************** [04/19/2021-12:46:19] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:46:19] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:46:19] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:46:19] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:46:19] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:46:19] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:46:19] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:46:19] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:46:19] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:46:19] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd (FusedConvActConvolution) [04/19/2021-12:46:19] [V] [TRT] Tactic: 589823 time 0.010332 [04/19/2021-12:46:19] [V] [TRT] Tactic: 655359 time 0.0126171 [04/19/2021-12:46:19] [V] [TRT] Tactic: 786431 time 0.0103582 [04/19/2021-12:46:19] [V] [TRT] Tactic: 851967 time 0.00732388 [04/19/2021-12:46:19] [V] [TRT] Tactic: 1310719 time 0.0151368 [04/19/2021-12:46:20] [V] [TRT] Tactic: 1376255 time 0.0138021 [04/19/2021-12:46:20] [V] [TRT] Tactic: 1507327 time 0.0113671 [04/19/2021-12:46:20] [V] [TRT] Tactic: 1638399 time 0.00865887 [04/19/2021-12:46:20] [V] [TRT] Tactic: 1835007 time 0.0114061 [04/19/2021-12:46:20] [V] [TRT] Tactic: 1900543 time 0.0165232 [04/19/2021-12:46:20] [V] [TRT] Tactic: 2162687 time 0.0139129 [04/19/2021-12:46:20] [V] [TRT] Tactic: 2293759 time 0.0113609 [04/19/2021-12:46:20] [V] [TRT] Tactic: 2359295 time 0.0148113 [04/19/2021-12:46:20] [V] [TRT] Tactic: 2686975 time 0.0118554 [04/19/2021-12:46:20] [V] [TRT] Tactic: 3080191 time 0.0102409 [04/19/2021-12:46:20] [V] [TRT] Tactic: 3342335 time 0.0113674 [04/19/2021-12:46:20] [V] [TRT] Tactic: 3407871 time 0.0113799 [04/19/2021-12:46:20] [V] [TRT] Tactic: 3538943 time 0.00882812 [04/19/2021-12:46:20] [V] [TRT] Tactic: 3670015 time 0.0165105 [04/19/2021-12:46:20] [V] [TRT] Tactic: 3932159 time 0.00884125 [04/19/2021-12:46:20] [V] [TRT] Tactic: 4063231 time 0.00883475 [04/19/2021-12:46:20] [V] [TRT] Tactic: 4194303 time 0.0131966 [04/19/2021-12:46:20] [V] [TRT] Tactic: 4325375 time 0.00834625 [04/19/2021-12:46:20] [V] [TRT] Tactic: 4521983 time 0.0134179 [04/19/2021-12:46:20] [V] [TRT] Tactic: 4980735 time 0.0132421 [04/19/2021-12:46:20] [V] [TRT] Tactic: 5242879 time 0.00846338 [04/19/2021-12:46:20] [V] [TRT] Tactic: 5439487 time 0.00843087 [04/19/2021-12:46:20] [V] [TRT] Tactic: 5570559 time 0.0109571 [04/19/2021-12:46:20] [V] [TRT] Tactic: 5636095 time 0.00825537 [04/19/2021-12:46:20] [V] [TRT] Tactic: 5701631 time 0.00852875 [04/19/2021-12:46:20] [V] [TRT] Tactic: 5767167 time 0.00601587 [04/19/2021-12:46:20] [V] [TRT] Tactic: 5832703 time 0.008444 [04/19/2021-12:46:20] [V] [TRT] Tactic: 6029311 time 0.0099675 [04/19/2021-12:46:20] [V] [TRT] Tactic: 6225919 time 0.00606775 [04/19/2021-12:46:20] [V] [TRT] Tactic: 6422527 time 0.008203 [04/19/2021-12:46:20] [V] [TRT] Tactic: 6815743 time 0.00845725 [04/19/2021-12:46:20] [V] [TRT] Tactic: 6946815 time 0.00845062 [04/19/2021-12:46:20] [V] [TRT] Tactic: 7077887 time 0.00599625 [04/19/2021-12:46:20] [V] [TRT] Tactic: 7143423 time 0.006035 [04/19/2021-12:46:20] [V] [TRT] Tactic: 7208959 time 0.008353 [04/19/2021-12:46:20] [V] [TRT] Tactic: 7405567 time 0.00645187 [04/19/2021-12:46:20] [V] [TRT] Tactic: 7536639 time 0.00603525 [04/19/2021-12:46:20] [V] [TRT] Tactic: 7602175 time 0.0084115 [04/19/2021-12:46:20] [V] [TRT] Tactic: 7733247 time 0.0083925 [04/19/2021-12:46:20] [V] [TRT] Tactic: 7798783 time 0.0107294 [04/19/2021-12:46:20] [V] [TRT] Tactic: 8191999 time 0.00601563 [04/19/2021-12:46:20] [V] [TRT] Tactic: 8323071 time 0.00837262 [04/19/2021-12:46:20] [V] [TRT] Tactic: 8650751 time 0.0085025 [04/19/2021-12:46:20] [V] [TRT] Tactic: 8716287 time 0.00570975 [04/19/2021-12:46:20] [V] [TRT] Tactic: 9895935 time 0.0105272 [04/19/2021-12:46:20] [V] [TRT] Tactic: 10223615 time 0.0103779 [04/19/2021-12:46:20] [V] [TRT] Tactic: 10551295 time 0.00804687 [04/19/2021-12:46:20] [V] [TRT] Tactic: 10747903 time 0.0081055 [04/19/2021-12:46:20] [V] [TRT] Tactic: 10944511 time 0.0122524 [04/19/2021-12:46:20] [V] [TRT] Fastest Tactic: 8716287 Time: 0.00570975 [04/19/2021-12:46:20] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd (CaskConvolution) [04/19/2021-12:46:20] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:46:20] [V] [TRT] Tactic: 1062367460111450758 time 0.0150716 [04/19/2021-12:46:20] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:46:20] [V] [TRT] Tactic: 4501471010995462441 time 0.0148437 [04/19/2021-12:46:20] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:46:20] [V] [TRT] Tactic: 5137655947464784826 time 0.0126693 [04/19/2021-12:46:20] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:46:20] [V] [TRT] Tactic: 5326823351883942011 time 0.0148047 [04/19/2021-12:46:20] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:46:20] [V] [TRT] Tactic: 6645123197870846056 time 0.0137241 [04/19/2021-12:46:20] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:46:20] [V] [TRT] Tactic: -6576203419454146580 time 0.0153385 [04/19/2021-12:46:20] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:46:20] [V] [TRT] Tactic: -3456450830548107839 time 0.0149934 [04/19/2021-12:46:20] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:46:20] [V] [TRT] Tactic: -410470605513481746 time 0.0149479 [04/19/2021-12:46:20] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:46:20] [V] [TRT] Tactic: -37215280111360163 time 0.0129688 [04/19/2021-12:46:20] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.0126693 [04/19/2021-12:46:20] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd (CudaConvolution) [04/19/2021-12:46:20] [V] [TRT] Tactic: 0 time 0.0123633 [04/19/2021-12:46:20] [V] [TRT] Tactic: 2 time 0.0192775 [04/19/2021-12:46:20] [V] [TRT] Tactic: 5 time 0.11349 [04/19/2021-12:46:20] [V] [TRT] Tactic: 57 time 0.0142513 [04/19/2021-12:46:20] [V] [TRT] Fastest Tactic: 0 Time: 0.0123633 [04/19/2021-12:46:20] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd (CudaDepthwiseConvolution) [04/19/2021-12:46:20] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/19/2021-12:46:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 8716287 [04/19/2021-12:46:20] [V] [TRT] [04/19/2021-12:46:20] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:46:20] [V] [TRT] Tactic: 1002 time 0.008392 [04/19/2021-12:46:20] [V] [TRT] Tactic: 0 time 0.00548825 [04/19/2021-12:46:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00548825 [04/19/2021-12:46:20] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:46:20] [V] [TRT] Tactic: 1002 time 0.008366 [04/19/2021-12:46:20] [V] [TRT] Tactic: 0 time 0.00562487 [04/19/2021-12:46:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00562487 [04/19/2021-12:46:20] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:46:20] [V] [TRT] Tactic: 1002 time 0.00852875 [04/19/2021-12:46:20] [V] [TRT] Tactic: 0 time 0.00542975 [04/19/2021-12:46:20] [V] [TRT] Fastest Tactic: 0 Time: 0.00542975 [04/19/2021-12:46:20] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,32), Float(1,112,12544,401408) -> Float(1,112,12544,401408) *************** [04/19/2021-12:46:47] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block1a_se_excite/mul) (PointWise) [04/19/2021-12:46:48] [V] [TRT] Tactic: 128 time 12.7745 [04/19/2021-12:46:48] [V] [TRT] Tactic: 256 time 12.8351 [04/19/2021-12:46:48] [V] [TRT] Tactic: 512 time 12.9388 [04/19/2021-12:46:48] [V] [TRT] Tactic: -32 time 9.40051 [04/19/2021-12:46:49] [V] [TRT] Tactic: -64 time 5.42845 [04/19/2021-12:46:49] [V] [TRT] Tactic: -128 time 5.57204 [04/19/2021-12:46:49] [V] [TRT] Fastest Tactic: -64 Time: 5.42845 [04/19/2021-12:46:49] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block1a_se_excite/mul) (PointWiseV2) [04/19/2021-12:46:49] [V] [TRT] Tactic: 0 time 4.71762 [04/19/2021-12:46:49] [V] [TRT] Tactic: 1 time 2.32171 [04/19/2021-12:46:49] [V] [TRT] Tactic: 2 time 1.90872 [04/19/2021-12:46:49] [V] [TRT] Tactic: 3 time 1.31421 [04/19/2021-12:46:49] [V] [TRT] Tactic: 4 time 1.38052 [04/19/2021-12:46:49] [V] [TRT] Tactic: 5 time 1.2773 [04/19/2021-12:46:49] [V] [TRT] Tactic: 6 time 1.6841 [04/19/2021-12:46:49] [V] [TRT] Tactic: 7 time 1.64567 [04/19/2021-12:46:49] [V] [TRT] Tactic: 8 time 1.65474 [04/19/2021-12:46:49] [V] [TRT] Tactic: 9 time 1.55065 [04/19/2021-12:46:49] [V] [TRT] Tactic: 28 time 2.70627 [04/19/2021-12:46:49] [V] [TRT] Fastest Tactic: 5 Time: 1.2773 [04/19/2021-12:46:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [04/19/2021-12:46:49] [V] [TRT] [04/19/2021-12:46:49] [V] [TRT] *************** Autotuning format combination: Float(1,1,1:32,1), Float(1,112,12544:32,12544) -> Float(1,112,12544:32,12544) *************** [04/19/2021-12:46:56] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block1a_se_excite/mul) (PointWise) [04/19/2021-12:46:56] [V] [TRT] Tactic: 128 time 2.96013 [04/19/2021-12:46:56] [V] [TRT] Tactic: 256 time 3.49851 [04/19/2021-12:46:56] [V] [TRT] Tactic: 512 time 2.99273 [04/19/2021-12:46:56] [V] [TRT] Tactic: -32 time 3.43208 [04/19/2021-12:46:56] [V] [TRT] Tactic: -64 time 3.44898 [04/19/2021-12:46:56] [V] [TRT] Tactic: -128 time 3.44943 [04/19/2021-12:46:56] [V] [TRT] Fastest Tactic: 128 Time: 2.96013 [04/19/2021-12:46:56] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block1a_se_excite/mul) (PointWiseV2) [04/19/2021-12:46:56] [V] [TRT] Tactic: 24 time 0.696732 [04/19/2021-12:46:56] [V] [TRT] Tactic: 25 time 0.614212 [04/19/2021-12:46:56] [V] [TRT] Tactic: 26 time 0.5886 [04/19/2021-12:46:57] [V] [TRT] Tactic: 27 time 0.582865 [04/19/2021-12:46:57] [V] [TRT] Tactic: 31 time 0.698711 [04/19/2021-12:46:57] [V] [TRT] Fastest Tactic: 27 Time: 0.582865 [04/19/2021-12:46:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [04/19/2021-12:46:57] [V] [TRT] [04/19/2021-12:46:57] [V] [TRT] *************** Autotuning format combination: Float(1,112,12544,401408) -> Float(1,112,12544,200704) *************** [04/19/2021-12:46:57] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:46:57] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:46:57] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:46:57] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:46:57] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:46:57] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:46:57] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:46:57] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:46:57] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:46:57] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D (FusedConvActConvolution) [04/19/2021-12:46:57] [V] [TRT] Tactic: 589823 time 0.848294 [04/19/2021-12:46:57] [V] [TRT] Tactic: 655359 time 1.9471 [04/19/2021-12:46:57] [V] [TRT] Tactic: 786431 time 1.31491 [04/19/2021-12:46:57] [V] [TRT] Tactic: 851967 time 3.45606 [04/19/2021-12:46:57] [V] [TRT] Tactic: 1179647 time 1.76116 [04/19/2021-12:46:57] [V] [TRT] Tactic: 1310719 time 1.58775 [04/19/2021-12:46:58] [V] [TRT] Tactic: 1376255 time 0.843424 [04/19/2021-12:46:58] [V] [TRT] Tactic: 1441791 time 2.11364 [04/19/2021-12:46:58] [V] [TRT] Tactic: 1507327 time 2.59587 [04/19/2021-12:46:58] [V] [TRT] Tactic: 1638399 time 1.26887 [04/19/2021-12:46:58] [V] [TRT] Tactic: 1835007 time 1.22637 [04/19/2021-12:46:58] [V] [TRT] Tactic: 1900543 time 2.1143 [04/19/2021-12:46:58] [V] [TRT] Tactic: 2097151 time 1.36812 [04/19/2021-12:46:58] [V] [TRT] Tactic: 2162687 time 0.822786 [04/19/2021-12:46:58] [V] [TRT] Tactic: 2293759 time 0.769857 [04/19/2021-12:46:58] [V] [TRT] Tactic: 2359295 time 1.26706 [04/19/2021-12:46:58] [V] [TRT] Tactic: 2686975 time 0.804701 [04/19/2021-12:46:59] [V] [TRT] Tactic: 3080191 time 2.08872 [04/19/2021-12:46:59] [V] [TRT] Tactic: 3342335 time 2.33399 [04/19/2021-12:46:59] [V] [TRT] Tactic: 3407871 time 1.07896 [04/19/2021-12:46:59] [V] [TRT] Tactic: 3538943 time 1.08564 [04/19/2021-12:46:59] [V] [TRT] Tactic: 3670015 time 1.26228 [04/19/2021-12:46:59] [V] [TRT] Tactic: 3932159 time 1.38542 [04/19/2021-12:46:59] [V] [TRT] Tactic: 3997695 time 0.959941 [04/19/2021-12:46:59] [V] [TRT] Tactic: 4063231 time 2.37852 [04/19/2021-12:46:59] [V] [TRT] Tactic: 4194303 time 0.869642 [04/19/2021-12:46:59] [V] [TRT] Tactic: 4259839 time 1.13702 [04/19/2021-12:46:59] [V] [TRT] Tactic: 4325375 time 0.818965 [04/19/2021-12:46:59] [V] [TRT] Tactic: 4521983 time 0.603646 [04/19/2021-12:46:59] [V] [TRT] Tactic: 4587519 time 0.931179 [04/19/2021-12:47:00] [V] [TRT] Tactic: 4653055 time 1.63231 [04/19/2021-12:47:00] [V] [TRT] Tactic: 4915199 time 0.894141 [04/19/2021-12:47:00] [V] [TRT] Tactic: 4980735 time 0.803437 [04/19/2021-12:47:00] [V] [TRT] Tactic: 5177343 time 1.24859 [04/19/2021-12:47:00] [V] [TRT] Tactic: 5242879 time 0.99972 [04/19/2021-12:47:00] [V] [TRT] Tactic: 5373951 time 1.34384 [04/19/2021-12:47:00] [V] [TRT] Tactic: 5439487 time 1.34904 [04/19/2021-12:47:00] [V] [TRT] Tactic: 5570559 time 1.95409 [04/19/2021-12:47:00] [V] [TRT] Tactic: 5636095 time 2.36076 [04/19/2021-12:47:00] [V] [TRT] Tactic: 5701631 time 0.731686 [04/19/2021-12:47:00] [V] [TRT] Tactic: 5767167 time 2.21564 [04/19/2021-12:47:00] [V] [TRT] Tactic: 5832703 time 0.872891 [04/19/2021-12:47:01] [V] [TRT] Tactic: 5898239 time 1.16774 [04/19/2021-12:47:01] [V] [TRT] Tactic: 6029311 time 0.711881 [04/19/2021-12:47:01] [V] [TRT] Tactic: 6225919 time 0.933678 [04/19/2021-12:47:01] [V] [TRT] Tactic: 6291455 time 1.26204 [04/19/2021-12:47:01] [V] [TRT] Tactic: 6422527 time 1.52688 [04/19/2021-12:47:01] [V] [TRT] Tactic: 6750207 time 0.89722 [04/19/2021-12:47:01] [V] [TRT] Tactic: 6815743 time 1.25717 [04/19/2021-12:47:01] [V] [TRT] Tactic: 6946815 time 1.29784 [04/19/2021-12:47:01] [V] [TRT] Tactic: 7012351 time 1.16659 [04/19/2021-12:47:01] [V] [TRT] Tactic: 7077887 time 0.892507 [04/19/2021-12:47:01] [V] [TRT] Tactic: 7143423 time 0.950925 [04/19/2021-12:47:01] [V] [TRT] Tactic: 7208959 time 0.996973 [04/19/2021-12:47:01] [V] [TRT] Tactic: 7340031 time 1.1174 [04/19/2021-12:47:01] [V] [TRT] Tactic: 7405567 time 1.21443 [04/19/2021-12:47:02] [V] [TRT] Tactic: 7536639 time 0.935599 [04/19/2021-12:47:02] [V] [TRT] Tactic: 7602175 time 0.87265 [04/19/2021-12:47:02] [V] [TRT] Tactic: 7733247 time 1.10081 [04/19/2021-12:47:02] [V] [TRT] Tactic: 7798783 time 0.897643 [04/19/2021-12:47:02] [V] [TRT] Tactic: 8191999 time 1.02363 [04/19/2021-12:47:02] [V] [TRT] Tactic: 8257535 time 0.905299 [04/19/2021-12:47:02] [V] [TRT] Tactic: 8323071 time 0.948418 [04/19/2021-12:47:02] [V] [TRT] Tactic: 8650751 time 0.965749 [04/19/2021-12:47:02] [V] [TRT] Tactic: 8716287 time 1.21876 [04/19/2021-12:47:02] [V] [TRT] Tactic: 9109503 time 1.14378 [04/19/2021-12:47:02] [V] [TRT] Tactic: 9568255 time 0.897337 [04/19/2021-12:47:02] [V] [TRT] Tactic: 9895935 time 0.864942 [04/19/2021-12:47:02] [V] [TRT] Tactic: 10223615 time 0.683405 [04/19/2021-12:47:02] [V] [TRT] Tactic: 10354687 time 0.917604 [04/19/2021-12:47:02] [V] [TRT] Tactic: 10551295 time 0.671608 [04/19/2021-12:47:02] [V] [TRT] Tactic: 10747903 time 1.04841 [04/19/2021-12:47:02] [V] [TRT] Tactic: 10944511 time 0.801497 [04/19/2021-12:47:02] [V] [TRT] Fastest Tactic: 4521983 Time: 0.603646 [04/19/2021-12:47:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D (CaskConvolution) [04/19/2021-12:47:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:47:02] [V] [TRT] Tactic: 1062367460111450758 time 0.359232 [04/19/2021-12:47:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:47:03] [V] [TRT] Tactic: 4501471010995462441 time 1.01366 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:47:03] [V] [TRT] Tactic: 5137655947464784826 time 0.50472 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:47:03] [V] [TRT] Tactic: 5326823351883942011 time 0.978119 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:47:03] [V] [TRT] Tactic: 6645123197870846056 time 0.513346 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:47:03] [V] [TRT] Tactic: -6576203419454146580 time 0.332402 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:47:03] [V] [TRT] Tactic: -3456450830548107839 time 0.343763 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:47:03] [V] [TRT] Tactic: -410470605513481746 time 0.995228 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:47:03] [V] [TRT] Tactic: -37215280111360163 time 0.507389 [04/19/2021-12:47:03] [V] [TRT] Fastest Tactic: -6576203419454146580 Time: 0.332402 [04/19/2021-12:47:03] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D (CudaConvolution) [04/19/2021-12:47:03] [V] [TRT] Tactic: 0 time 0.539616 [04/19/2021-12:47:03] [V] [TRT] Tactic: 2 time 0.774896 [04/19/2021-12:47:03] [V] [TRT] Tactic: 5 time 1.59982 [04/19/2021-12:47:03] [V] [TRT] Tactic: 57 time 0.449577 [04/19/2021-12:47:03] [V] [TRT] Fastest Tactic: 57 Time: 0.449577 [04/19/2021-12:47:03] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D (CudaDepthwiseConvolution) [04/19/2021-12:47:03] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/19/2021-12:47:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6576203419454146580 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:47:03] [V] [TRT] [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:47:03] [V] [TRT] *************** Autotuning format combination: Float(1,112,12544,200704) -> Float(1,112,12544,1204224) *************** [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:47:03] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D (FusedConvActConvolution) [04/19/2021-12:47:03] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/19/2021-12:47:03] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D (CaskConvolution) [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:47:03] [V] [TRT] Tactic: 1062367460111450758 time 0.801354 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:47:03] [V] [TRT] Tactic: 4501471010995462441 time 0.824492 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:47:03] [V] [TRT] Tactic: 5137655947464784826 time 0.794212 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:47:03] [V] [TRT] Tactic: 5326823351883942011 time 0.784584 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:47:03] [V] [TRT] Tactic: 6645123197870846056 time 0.804902 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:47:03] [V] [TRT] Tactic: -6576203419454146580 time 0.765638 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:47:03] [V] [TRT] Tactic: -3456450830548107839 time 0.777878 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:47:03] [V] [TRT] Tactic: -410470605513481746 time 0.799017 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:47:03] [V] [TRT] Tactic: -37215280111360163 time 0.788398 [04/19/2021-12:47:03] [V] [TRT] Fastest Tactic: -6576203419454146580 Time: 0.765638 [04/19/2021-12:47:03] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D (CudaConvolution) [04/19/2021-12:47:03] [V] [TRT] Tactic: 0 time 1.74902 [04/19/2021-12:47:03] [V] [TRT] Tactic: 2 time 2.02281 [04/19/2021-12:47:03] [V] [TRT] Tactic: 5 time 3.03902 [04/19/2021-12:47:03] [V] [TRT] Tactic: 57 time 1.76702 [04/19/2021-12:47:03] [V] [TRT] Fastest Tactic: 0 Time: 1.74902 [04/19/2021-12:47:03] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D (CudaDepthwiseConvolution) [04/19/2021-12:47:03] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/19/2021-12:47:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6576203419454146580 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:47:03] [V] [TRT] [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:47:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:47:03] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:47:03] [V] [TRT] Tactic: 1002 time 2.40344 [04/19/2021-12:47:03] [V] [TRT] Tactic: 0 time 3.75299 [04/19/2021-12:47:03] [V] [TRT] Fastest Tactic: 1002 Time: 2.40344 [04/19/2021-12:47:03] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:47:04] [V] [TRT] Tactic: 1002 time 2.40003 [04/19/2021-12:47:04] [V] [TRT] Tactic: 0 time 3.76011 [04/19/2021-12:47:04] [V] [TRT] Fastest Tactic: 1002 Time: 2.40003 [04/19/2021-12:47:04] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:47:04] [V] [TRT] Tactic: 1002 time 3.98405 [04/19/2021-12:47:04] [V] [TRT] Tactic: 0 time 4.01034 [04/19/2021-12:47:04] [V] [TRT] Fastest Tactic: 1002 Time: 3.98405 [04/19/2021-12:47:04] [V] [TRT] *************** Autotuning format combination: Float(1,112,12544,1204224) -> Float(1,112,12544,1204224) *************** [04/19/2021-12:47:04] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block2a_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2a_expand_activation/mul) (PointWise) [04/19/2021-12:47:04] [V] [TRT] Tactic: 128 time 2.57378 [04/19/2021-12:47:04] [V] [TRT] Tactic: 256 time 2.5832 [04/19/2021-12:47:04] [V] [TRT] Tactic: 512 time 2.6076 [04/19/2021-12:47:04] [V] [TRT] Tactic: -32 time 2.62381 [04/19/2021-12:47:04] [V] [TRT] Tactic: -64 time 2.59568 [04/19/2021-12:47:04] [V] [TRT] Tactic: -128 time 2.62548 [04/19/2021-12:47:04] [V] [TRT] Fastest Tactic: 128 Time: 2.57378 [04/19/2021-12:47:04] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block2a_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2a_expand_activation/mul) (PointWiseV2) [04/19/2021-12:47:04] [V] [TRT] Tactic: 0 time 1.19572 [04/19/2021-12:47:04] [V] [TRT] Tactic: 1 time 0.869746 [04/19/2021-12:47:04] [V] [TRT] Tactic: 2 time 0.794434 [04/19/2021-12:47:04] [V] [TRT] Tactic: 3 time 0.725124 [04/19/2021-12:47:04] [V] [TRT] Tactic: 4 time 0.56931 [04/19/2021-12:47:04] [V] [TRT] Tactic: 5 time 0.597708 [04/19/2021-12:47:04] [V] [TRT] Tactic: 6 time 0.682317 [04/19/2021-12:47:05] [V] [TRT] Tactic: 7 time 0.526465 [04/19/2021-12:47:05] [V] [TRT] Tactic: 8 time 0.479675 [04/19/2021-12:47:05] [V] [TRT] Tactic: 9 time 0.487748 [04/19/2021-12:47:05] [V] [TRT] Tactic: 28 time 1.15925 [04/19/2021-12:47:05] [V] [TRT] Fastest Tactic: 8 Time: 0.479675 [04/19/2021-12:47:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [04/19/2021-12:47:05] [V] [TRT] [04/19/2021-12:47:05] [V] [TRT] *************** Autotuning format combination: Float(1,112,12544:32,37632) -> Float(1,112,12544:32,37632) *************** [04/19/2021-12:47:05] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block2a_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2a_expand_activation/mul) (PointWise) [04/19/2021-12:47:05] [V] [TRT] Tactic: 128 time 2.5738 [04/19/2021-12:47:05] [V] [TRT] Tactic: 256 time 2.58301 [04/19/2021-12:47:05] [V] [TRT] Tactic: 512 time 2.60883 [04/19/2021-12:47:05] [V] [TRT] Tactic: -32 time 2.62396 [04/19/2021-12:47:05] [V] [TRT] Tactic: -64 time 2.59643 [04/19/2021-12:47:05] [V] [TRT] Tactic: -128 time 2.62536 [04/19/2021-12:47:05] [V] [TRT] Fastest Tactic: 128 Time: 2.5738 [04/19/2021-12:47:05] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block2a_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2a_expand_activation/mul) (PointWiseV2) [04/19/2021-12:47:05] [V] [TRT] Tactic: 24 time 0.845403 [04/19/2021-12:47:05] [V] [TRT] Tactic: 25 time 0.761133 [04/19/2021-12:47:05] [V] [TRT] Tactic: 26 time 0.753704 [04/19/2021-12:47:05] [V] [TRT] Tactic: 27 time 0.73552 [04/19/2021-12:47:05] [V] [TRT] Tactic: 31 time 0.845801 [04/19/2021-12:47:05] [V] [TRT] Fastest Tactic: 27 Time: 0.73552 [04/19/2021-12:47:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [04/19/2021-12:47:05] [V] [TRT] [04/19/2021-12:47:05] [V] [TRT] *************** Autotuning format combination: Float(1,112,12544,1204224) -> Float(1,56,3136,301056) *************** [04/19/2021-12:47:05] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:47:05] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [04/19/2021-12:47:05] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:47:05] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:47:05] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:47:05] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [04/19/2021-12:47:05] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [04/19/2021-12:47:05] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:47:05] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:47:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2a_dwconv/depthwise (FusedConvActConvolution) [04/19/2021-12:47:05] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/19/2021-12:47:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2a_dwconv/depthwise (CaskConvolution) [04/19/2021-12:47:05] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:47:06] [V] [TRT] Tactic: 1062367460111450758 time 7.07283 [04/19/2021-12:47:06] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [04/19/2021-12:47:06] [V] [TRT] Tactic: 4337000649858996379 time 10.018 [04/19/2021-12:47:06] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:47:06] [V] [TRT] Tactic: 4501471010995462441 time 18.9367 [04/19/2021-12:47:06] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:47:06] [V] [TRT] Tactic: 5137655947464784826 time 9.88374 [04/19/2021-12:47:06] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:47:07] [V] [TRT] Tactic: 6645123197870846056 time 9.87134 [04/19/2021-12:47:07] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [04/19/2021-12:47:07] [V] [TRT] Tactic: -9137461792520977713 time 19.6503 [04/19/2021-12:47:07] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [04/19/2021-12:47:07] [V] [TRT] Tactic: -6092040395344634144 time 7.18053 [04/19/2021-12:47:07] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:47:07] [V] [TRT] Tactic: -3456450830548107839 time 6.78266 [04/19/2021-12:47:07] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:47:08] [V] [TRT] Tactic: -410470605513481746 time 19.2951 [04/19/2021-12:47:08] [V] [TRT] Fastest Tactic: -3456450830548107839 Time: 6.78266 [04/19/2021-12:47:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2a_dwconv/depthwise (CudaConvolution) [04/19/2021-12:47:08] [V] [TRT] Tactic: 0 time 6.66074 [04/19/2021-12:47:08] [V] [TRT] Tactic: 2 time 1.94027 [04/19/2021-12:47:15] [V] [TRT] Tactic: 5 time 447.242 [04/19/2021-12:47:15] [V] [TRT] Tactic: 57 time 6.65939 [04/19/2021-12:47:15] [V] [TRT] Fastest Tactic: 2 Time: 1.94027 [04/19/2021-12:47:15] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2a_dwconv/depthwise (CudaDepthwiseConvolution) [04/19/2021-12:47:15] [V] [TRT] Tactic: -1 time 0.843828 [04/19/2021-12:47:15] [V] [TRT] Fastest Tactic: -1 Time: 0.843828 [04/19/2021-12:47:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [04/19/2021-12:47:15] [V] [TRT] [04/19/2021-12:47:15] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:47:15] [V] [TRT] Tactic: 1002 time 0.614954 [04/19/2021-12:47:15] [V] [TRT] Tactic: 0 time 0.947917 [04/19/2021-12:47:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.614954 [04/19/2021-12:47:15] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:47:15] [V] [TRT] Tactic: 1002 time 0.613633 [04/19/2021-12:47:15] [V] [TRT] Tactic: 0 time 0.950404 [04/19/2021-12:47:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.613633 [04/19/2021-12:47:15] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:47:15] [V] [TRT] Tactic: 1002 time 0.854102 [04/19/2021-12:47:15] [V] [TRT] Tactic: 0 time 1.01251 [04/19/2021-12:47:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.854102 [04/19/2021-12:47:15] [V] [TRT] *************** Autotuning format combination: Float(1,56,3136,301056) -> Float(1,56,3136,301056) *************** [04/19/2021-12:47:15] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block2a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2a_activation/mul) (PointWise) [04/19/2021-12:47:16] [V] [TRT] Tactic: 128 time 0.650684 [04/19/2021-12:47:16] [V] [TRT] Tactic: 256 time 0.652298 [04/19/2021-12:47:16] [V] [TRT] Tactic: 512 time 0.658913 [04/19/2021-12:47:16] [V] [TRT] Tactic: -32 time 0.683685 [04/19/2021-12:47:16] [V] [TRT] Tactic: -64 time 0.662565 [04/19/2021-12:47:16] [V] [TRT] Tactic: -128 time 0.665938 [04/19/2021-12:47:16] [V] [TRT] Fastest Tactic: 128 Time: 0.650684 [04/19/2021-12:47:16] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block2a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2a_activation/mul) (PointWiseV2) [04/19/2021-12:47:16] [V] [TRT] Tactic: 0 time 0.305755 [04/19/2021-12:47:16] [V] [TRT] Tactic: 1 time 0.224173 [04/19/2021-12:47:16] [V] [TRT] Tactic: 2 time 0.204265 [04/19/2021-12:47:16] [V] [TRT] Tactic: 3 time 0.188281 [04/19/2021-12:47:16] [V] [TRT] Tactic: 4 time 0.148314 [04/19/2021-12:47:16] [V] [TRT] Tactic: 5 time 0.155508 [04/19/2021-12:47:16] [V] [TRT] Tactic: 6 time 0.177428 [04/19/2021-12:47:16] [V] [TRT] Tactic: 7 time 0.13724 [04/19/2021-12:47:16] [V] [TRT] Tactic: 8 time 0.125573 [04/19/2021-12:47:16] [V] [TRT] Tactic: 9 time 0.129394 [04/19/2021-12:47:16] [V] [TRT] Tactic: 28 time 0.29612 [04/19/2021-12:47:16] [V] [TRT] Fastest Tactic: 8 Time: 0.125573 [04/19/2021-12:47:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [04/19/2021-12:47:16] [V] [TRT] [04/19/2021-12:47:16] [V] [TRT] *************** Autotuning format combination: Float(1,56,3136:32,9408) -> Float(1,56,3136:32,9408) *************** [04/19/2021-12:47:16] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block2a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2a_activation/mul) (PointWise) [04/19/2021-12:47:16] [V] [TRT] Tactic: 128 time 0.650683 [04/19/2021-12:47:16] [V] [TRT] Tactic: 256 time 0.652474 [04/19/2021-12:47:16] [V] [TRT] Tactic: 512 time 0.658919 [04/19/2021-12:47:16] [V] [TRT] Tactic: -32 time 0.684147 [04/19/2021-12:47:16] [V] [TRT] Tactic: -64 time 0.663099 [04/19/2021-12:47:16] [V] [TRT] Tactic: -128 time 0.666556 [04/19/2021-12:47:16] [V] [TRT] Fastest Tactic: 128 Time: 0.650683 [04/19/2021-12:47:16] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block2a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2a_activation/mul) (PointWiseV2) [04/19/2021-12:47:16] [V] [TRT] Tactic: 24 time 0.217949 [04/19/2021-12:47:16] [V] [TRT] Tactic: 25 time 0.198705 [04/19/2021-12:47:16] [V] [TRT] Tactic: 26 time 0.196679 [04/19/2021-12:47:16] [V] [TRT] Tactic: 27 time 0.192988 [04/19/2021-12:47:16] [V] [TRT] Tactic: 31 time 0.217018 [04/19/2021-12:47:16] [V] [TRT] Fastest Tactic: 27 Time: 0.192988 [04/19/2021-12:47:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [04/19/2021-12:47:16] [V] [TRT] [04/19/2021-12:47:16] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:47:16] [V] [TRT] Tactic: 1002 time 0.853626 [04/19/2021-12:47:16] [V] [TRT] Tactic: 0 time 1.01098 [04/19/2021-12:47:16] [V] [TRT] Fastest Tactic: 1002 Time: 0.853626 [04/19/2021-12:47:16] [V] [TRT] *************** Autotuning format combination: Float(1,56,3136,301056) -> Float(1,96) *************** [04/19/2021-12:47:16] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2a_se_squeeze/Mean (Reduce) [04/19/2021-12:47:16] [V] [TRT] Tactic: 1 time 0.165026 [04/19/2021-12:47:16] [V] [TRT] Tactic: 3 time 0.519603 [04/19/2021-12:47:16] [V] [TRT] Tactic: 6 time 7.24311 [04/19/2021-12:47:16] [V] [TRT] Fastest Tactic: 1 Time: 0.165026 [04/19/2021-12:47:16] [V] [TRT] *************** Autotuning format combination: Float(1,96) -> Float(1,1,1,96) *************** [04/19/2021-12:47:16] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2a_se_reshape/Reshape + StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd__55 (Shuffle) [04/19/2021-12:47:17] [V] [TRT] Tactic: 0 time 0.00329438 [04/19/2021-12:47:17] [V] [TRT] Tactic: 1 time 0.00973288 [04/19/2021-12:47:17] [V] [TRT] Fastest Tactic: 0 Time: 0.00329438 [04/19/2021-12:47:17] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,96) -> Float(1,1,1,4) *************** [04/19/2021-12:47:17] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:47:17] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:47:17] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:47:17] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:47:17] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:47:17] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:47:17] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:47:17] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:47:17] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:47:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd (FusedConvActConvolution) [04/19/2021-12:47:17] [V] [TRT] Tactic: 589823 time 0.0334834 [04/19/2021-12:47:17] [V] [TRT] Tactic: 655359 time 0.0286069 [04/19/2021-12:47:17] [V] [TRT] Tactic: 786431 time 0.0172656 [04/19/2021-12:47:17] [V] [TRT] Tactic: 851967 time 0.0126366 [04/19/2021-12:47:17] [V] [TRT] Tactic: 1179647 time 0.00801438 [04/19/2021-12:47:17] [V] [TRT] Tactic: 1310719 time 0.047474 [04/19/2021-12:47:17] [V] [TRT] Tactic: 1376255 time 0.0288609 [04/19/2021-12:47:17] [V] [TRT] Tactic: 1441791 time 0.010358 [04/19/2021-12:47:17] [V] [TRT] Tactic: 1507327 time 0.0196027 [04/19/2021-12:47:17] [V] [TRT] Tactic: 1638399 time 0.0103516 [04/19/2021-12:47:17] [V] [TRT] Tactic: 1835007 time 0.014948 [04/19/2021-12:47:17] [V] [TRT] Tactic: 1900543 time 0.0311914 [04/19/2021-12:47:17] [V] [TRT] Tactic: 2097151 time 0.00826837 [04/19/2021-12:47:17] [V] [TRT] Tactic: 2162687 time 0.0288477 [04/19/2021-12:47:17] [V] [TRT] Tactic: 2293759 time 0.0265561 [04/19/2021-12:47:17] [V] [TRT] Tactic: 2359295 time 0.0242383 [04/19/2021-12:47:17] [V] [TRT] Tactic: 2686975 time 0.0265236 [04/19/2021-12:47:17] [V] [TRT] Tactic: 3080191 time 0.0171484 [04/19/2021-12:47:17] [V] [TRT] Tactic: 3342335 time 0.0195247 [04/19/2021-12:47:17] [V] [TRT] Tactic: 3407871 time 0.0176236 [04/19/2021-12:47:17] [V] [TRT] Tactic: 3538943 time 0.0113345 [04/19/2021-12:47:17] [V] [TRT] Tactic: 3670015 time 0.0474284 [04/19/2021-12:47:17] [V] [TRT] Tactic: 3932159 time 0.0218883 [04/19/2021-12:47:17] [V] [TRT] Tactic: 3997695 time 0.0103515 [04/19/2021-12:47:17] [V] [TRT] Tactic: 4063231 time 0.0125847 [04/19/2021-12:47:17] [V] [TRT] Tactic: 4194303 time 0.0172981 [04/19/2021-12:47:17] [V] [TRT] Tactic: 4259839 time 0.008099 [04/19/2021-12:47:17] [V] [TRT] Tactic: 4325375 time 0.0126693 [04/19/2021-12:47:17] [V] [TRT] Tactic: 4521983 time 0.0277476 [04/19/2021-12:47:17] [V] [TRT] Tactic: 4587519 time 0.0102931 [04/19/2021-12:47:17] [V] [TRT] Tactic: 4653055 time 0.0103256 [04/19/2021-12:47:17] [V] [TRT] Tactic: 4915199 time 0.0103648 [04/19/2021-12:47:17] [V] [TRT] Tactic: 4980735 time 0.0218683 [04/19/2021-12:47:17] [V] [TRT] Tactic: 5177343 time 0.00801412 [04/19/2021-12:47:17] [V] [TRT] Tactic: 5242879 time 0.0172525 [04/19/2021-12:47:17] [V] [TRT] Tactic: 5373951 time 0.00799487 [04/19/2021-12:47:17] [V] [TRT] Tactic: 5439487 time 0.0149479 [04/19/2021-12:47:17] [V] [TRT] Tactic: 5570559 time 0.0172654 [04/19/2021-12:47:17] [V] [TRT] Tactic: 5636095 time 0.0126563 [04/19/2021-12:47:17] [V] [TRT] Tactic: 5701631 time 0.0242709 [04/19/2021-12:47:17] [V] [TRT] Tactic: 5767167 time 0.0126173 [04/19/2021-12:47:17] [V] [TRT] Tactic: 5832703 time 0.0172265 [04/19/2021-12:47:17] [V] [TRT] Tactic: 5898239 time 0.0103517 [04/19/2021-12:47:17] [V] [TRT] Tactic: 6029311 time 0.0241929 [04/19/2021-12:47:17] [V] [TRT] Tactic: 6225919 time 0.0103256 [04/19/2021-12:47:17] [V] [TRT] Tactic: 6291455 time 0.00801425 [04/19/2021-12:47:17] [V] [TRT] Tactic: 6422527 time 0.0149479 [04/19/2021-12:47:17] [V] [TRT] Tactic: 6750207 time 0.0103581 [04/19/2021-12:47:17] [V] [TRT] Tactic: 6815743 time 0.0169854 [04/19/2021-12:47:17] [V] [TRT] Tactic: 6946815 time 0.0172787 [04/19/2021-12:47:17] [V] [TRT] Tactic: 7012351 time 0.00866525 [04/19/2021-12:47:17] [V] [TRT] Tactic: 7077887 time 0.0103061 [04/19/2021-12:47:17] [V] [TRT] Tactic: 7143423 time 0.012682 [04/19/2021-12:47:17] [V] [TRT] Tactic: 7208959 time 0.0172983 [04/19/2021-12:47:17] [V] [TRT] Tactic: 7340031 time 0.0103645 [04/19/2021-12:47:17] [V] [TRT] Tactic: 7405567 time 0.0103582 [04/19/2021-12:47:17] [V] [TRT] Tactic: 7536639 time 0.0196289 [04/19/2021-12:47:17] [V] [TRT] Tactic: 7602175 time 0.0172463 [04/19/2021-12:47:17] [V] [TRT] Tactic: 7733247 time 0.0126434 [04/19/2021-12:47:17] [V] [TRT] Tactic: 7798783 time 0.017246 [04/19/2021-12:47:17] [V] [TRT] Tactic: 8191999 time 0.0126431 [04/19/2021-12:47:17] [V] [TRT] Tactic: 8257535 time 0.0103385 [04/19/2021-12:47:17] [V] [TRT] Tactic: 8323071 time 0.0150198 [04/19/2021-12:47:17] [V] [TRT] Tactic: 8650751 time 0.017246 [04/19/2021-12:47:17] [V] [TRT] Tactic: 8716287 time 0.0103389 [04/19/2021-12:47:17] [V] [TRT] Tactic: 9109503 time 0.00798837 [04/19/2021-12:47:17] [V] [TRT] Tactic: 9568255 time 0.0103255 [04/19/2021-12:47:17] [V] [TRT] Tactic: 9895935 time 0.0172853 [04/19/2021-12:47:17] [V] [TRT] Tactic: 10223615 time 0.0265104 [04/19/2021-12:47:17] [V] [TRT] Tactic: 10354687 time 0.0103709 [04/19/2021-12:47:17] [V] [TRT] Tactic: 10551295 time 0.0172332 [04/19/2021-12:47:17] [V] [TRT] Tactic: 10747903 time 0.0126695 [04/19/2021-12:47:17] [V] [TRT] Tactic: 10944511 time 0.0219074 [04/19/2021-12:47:17] [V] [TRT] Fastest Tactic: 9109503 Time: 0.00798837 [04/19/2021-12:47:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd (CaskConvolution) [04/19/2021-12:47:17] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:47:17] [V] [TRT] Tactic: 1062367460111450758 time 0.0281575 [04/19/2021-12:47:17] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:47:17] [V] [TRT] Tactic: 4501471010995462441 time 0.0308722 [04/19/2021-12:47:17] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:47:17] [V] [TRT] Tactic: 5137655947464784826 time 0.0240299 [04/19/2021-12:47:17] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:47:17] [V] [TRT] Tactic: 5326823351883942011 time 0.0291799 [04/19/2021-12:47:17] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:47:17] [V] [TRT] Tactic: 6645123197870846056 time 0.0242774 [04/19/2021-12:47:17] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:47:17] [V] [TRT] Tactic: -6576203419454146580 time 0.0245445 [04/19/2021-12:47:17] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:47:17] [V] [TRT] Tactic: -3456450830548107839 time 0.0242904 [04/19/2021-12:47:17] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:47:17] [V] [TRT] Tactic: -410470605513481746 time 0.029375 [04/19/2021-12:47:17] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:47:17] [V] [TRT] Tactic: -37215280111360163 time 0.0222135 [04/19/2021-12:47:17] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.0222135 [04/19/2021-12:47:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd (CudaConvolution) [04/19/2021-12:47:17] [V] [TRT] Tactic: 0 time 0.023268 [04/19/2021-12:47:17] [V] [TRT] Tactic: 2 time 0.067526 [04/19/2021-12:47:17] [V] [TRT] Tactic: 5 time 0.179017 [04/19/2021-12:47:18] [V] [TRT] Tactic: 57 time 0.0245118 [04/19/2021-12:47:18] [V] [TRT] Fastest Tactic: 0 Time: 0.023268 [04/19/2021-12:47:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd (CudaDepthwiseConvolution) [04/19/2021-12:47:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/19/2021-12:47:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 9109503 [04/19/2021-12:47:18] [V] [TRT] [04/19/2021-12:47:18] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:47:18] [V] [TRT] Tactic: 1002 time 0.007949 [04/19/2021-12:47:18] [V] [TRT] Tactic: 0 time 0.00544925 [04/19/2021-12:47:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00544925 [04/19/2021-12:47:18] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:47:18] [V] [TRT] Tactic: 1002 time 0.00749362 [04/19/2021-12:47:18] [V] [TRT] Tactic: 0 time 0.005625 [04/19/2021-12:47:18] [V] [TRT] Fastest Tactic: 0 Time: 0.005625 [04/19/2021-12:47:18] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:47:18] [V] [TRT] Tactic: 1002 time 0.00791662 [04/19/2021-12:47:18] [V] [TRT] Tactic: 0 time 0.00539062 [04/19/2021-12:47:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00539062 [04/19/2021-12:47:18] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,4) -> Float(1,1,1,4) *************** [04/19/2021-12:47:18] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/mul) (PointWise) [04/19/2021-12:47:18] [V] [TRT] Tactic: 128 time 0.00569662 [04/19/2021-12:47:18] [V] [TRT] Tactic: 256 time 0.00572238 [04/19/2021-12:47:18] [V] [TRT] Tactic: 512 time 0.00569662 [04/19/2021-12:47:18] [V] [TRT] Fastest Tactic: 128 Time: 0.00569662 [04/19/2021-12:47:18] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/mul) (PointWiseV2) [04/19/2021-12:47:18] [V] [TRT] Tactic: 0 time 0.00419287 [04/19/2021-12:47:18] [V] [TRT] Tactic: 1 time 0.00455737 [04/19/2021-12:47:18] [V] [TRT] Tactic: 2 time 0.00475263 [04/19/2021-12:47:18] [V] [TRT] Tactic: 3 time 0.00565113 [04/19/2021-12:47:18] [V] [TRT] Tactic: 4 time 0.00483725 [04/19/2021-12:47:18] [V] [TRT] Tactic: 5 time 0.0045575 [04/19/2021-12:47:18] [V] [TRT] Tactic: 6 time 0.00557925 [04/19/2021-12:47:18] [V] [TRT] Tactic: 7 time 0.00557963 [04/19/2021-12:47:18] [V] [TRT] Tactic: 8 time 0.00508475 [04/19/2021-12:47:18] [V] [TRT] Tactic: 9 time 0.00476563 [04/19/2021-12:47:18] [V] [TRT] Tactic: 28 time 0.004238 [04/19/2021-12:47:18] [V] [TRT] Fastest Tactic: 0 Time: 0.00419287 [04/19/2021-12:47:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [04/19/2021-12:47:18] [V] [TRT] [04/19/2021-12:47:18] [V] [TRT] *************** Autotuning format combination: Float(1,1,1:32,1) -> Float(1,1,1:32,1) *************** [04/19/2021-12:47:18] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/mul) (PointWise) [04/19/2021-12:47:18] [V] [TRT] Tactic: 128 time 0.00573563 [04/19/2021-12:47:18] [V] [TRT] Tactic: 256 time 0.0057225 [04/19/2021-12:47:18] [V] [TRT] Tactic: 512 time 0.00569625 [04/19/2021-12:47:18] [V] [TRT] Tactic: -32 time 0.005716 [04/19/2021-12:47:18] [V] [TRT] Tactic: -64 time 0.0057095 [04/19/2021-12:47:18] [V] [TRT] Tactic: -128 time 0.00568363 [04/19/2021-12:47:18] [V] [TRT] Fastest Tactic: -128 Time: 0.00568363 [04/19/2021-12:47:18] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/mul) (PointWiseV2) [04/19/2021-12:47:18] [V] [TRT] Tactic: 24 time 0.00557275 [04/19/2021-12:47:18] [V] [TRT] Tactic: 25 time 0.00555988 [04/19/2021-12:47:18] [V] [TRT] Tactic: 26 time 0.00561863 [04/19/2021-12:47:18] [V] [TRT] Tactic: 27 time 0.007897 [04/19/2021-12:47:18] [V] [TRT] Tactic: 31 time 0.00556 [04/19/2021-12:47:18] [V] [TRT] Fastest Tactic: 25 Time: 0.00555988 [04/19/2021-12:47:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [04/19/2021-12:47:18] [V] [TRT] [04/19/2021-12:47:18] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,4) -> Float(1,1,1,96) *************** [04/19/2021-12:47:18] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:47:18] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:47:18] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:47:18] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:47:18] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:47:18] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:47:18] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:47:18] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:47:18] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:47:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd (FusedConvActConvolution) [04/19/2021-12:47:18] [V] [TRT] Tactic: 589823 time 0.0103186 [04/19/2021-12:47:18] [V] [TRT] Tactic: 655359 time 0.0103449 [04/19/2021-12:47:18] [V] [TRT] Tactic: 1310719 time 0.014974 [04/19/2021-12:47:18] [V] [TRT] Tactic: 1376255 time 0.0101694 [04/19/2021-12:47:18] [V] [TRT] Tactic: 1507327 time 0.0103385 [04/19/2021-12:47:18] [V] [TRT] Tactic: 1900543 time 0.0126367 [04/19/2021-12:47:18] [V] [TRT] Tactic: 2162687 time 0.0103579 [04/19/2021-12:47:18] [V] [TRT] Tactic: 2293759 time 0.00859362 [04/19/2021-12:47:18] [V] [TRT] Tactic: 2359295 time 0.0126821 [04/19/2021-12:47:18] [V] [TRT] Tactic: 2686975 time 0.01028 [04/19/2021-12:47:18] [V] [TRT] Tactic: 3080191 time 0.0079755 [04/19/2021-12:47:18] [V] [TRT] Tactic: 3342335 time 0.0102474 [04/19/2021-12:47:18] [V] [TRT] Tactic: 3407871 time 0.008138 [04/19/2021-12:47:19] [V] [TRT] Tactic: 3670015 time 0.012604 [04/19/2021-12:47:19] [V] [TRT] Tactic: 3932159 time 0.00803375 [04/19/2021-12:47:19] [V] [TRT] Tactic: 4521983 time 0.0103189 [04/19/2021-12:47:19] [V] [TRT] Tactic: 4980735 time 0.0103972 [04/19/2021-12:47:19] [V] [TRT] Tactic: 5242879 time 0.00796863 [04/19/2021-12:47:19] [V] [TRT] Tactic: 5570559 time 0.00891938 [04/19/2021-12:47:19] [V] [TRT] Tactic: 5701631 time 0.007988 [04/19/2021-12:47:19] [V] [TRT] Tactic: 5767167 time 0.00570313 [04/19/2021-12:47:19] [V] [TRT] Tactic: 5832703 time 0.00798825 [04/19/2021-12:47:19] [V] [TRT] Tactic: 6029311 time 0.00798187 [04/19/2021-12:47:19] [V] [TRT] Tactic: 6422527 time 0.00578113 [04/19/2021-12:47:19] [V] [TRT] Tactic: 6815743 time 0.00796888 [04/19/2021-12:47:19] [V] [TRT] Tactic: 7143423 time 0.00568362 [04/19/2021-12:47:19] [V] [TRT] Tactic: 7208959 time 0.00794913 [04/19/2021-12:47:19] [V] [TRT] Tactic: 7536639 time 0.00568375 [04/19/2021-12:47:19] [V] [TRT] Tactic: 10223615 time 0.0100716 [04/19/2021-12:47:19] [V] [TRT] Tactic: 10551295 time 0.00802737 [04/19/2021-12:47:19] [V] [TRT] Tactic: 10944511 time 0.0103906 [04/19/2021-12:47:19] [V] [TRT] Fastest Tactic: 7143423 Time: 0.00568362 [04/19/2021-12:47:19] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd (CaskConvolution) [04/19/2021-12:47:19] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:47:19] [V] [TRT] Tactic: 1062367460111450758 time 0.015039 [04/19/2021-12:47:19] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:47:19] [V] [TRT] Tactic: 4501471010995462441 time 0.0150259 [04/19/2021-12:47:19] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:47:19] [V] [TRT] Tactic: 5137655947464784826 time 0.0149741 [04/19/2021-12:47:19] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:47:19] [V] [TRT] Tactic: 5326823351883942011 time 0.015306 [04/19/2021-12:47:19] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:47:19] [V] [TRT] Tactic: 6645123197870846056 time 0.0150521 [04/19/2021-12:47:19] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:47:19] [V] [TRT] Tactic: -6576203419454146580 time 0.0153061 [04/19/2021-12:47:19] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:47:19] [V] [TRT] Tactic: -3456450830548107839 time 0.0149932 [04/19/2021-12:47:19] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:47:19] [V] [TRT] Tactic: -410470605513481746 time 0.0150064 [04/19/2021-12:47:19] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:47:19] [V] [TRT] Tactic: -37215280111360163 time 0.0136916 [04/19/2021-12:47:19] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.0136916 [04/19/2021-12:47:19] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd (CudaConvolution) [04/19/2021-12:47:19] [V] [TRT] Tactic: 0 time 0.0113739 [04/19/2021-12:47:19] [V] [TRT] Tactic: 2 time 0.0195574 [04/19/2021-12:47:19] [V] [TRT] Tactic: 5 time 0.0908005 [04/19/2021-12:47:19] [V] [TRT] Tactic: 57 time 0.0214455 [04/19/2021-12:47:19] [V] [TRT] Fastest Tactic: 0 Time: 0.0113739 [04/19/2021-12:47:19] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd (CudaDepthwiseConvolution) [04/19/2021-12:47:19] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/19/2021-12:47:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 7143423 [04/19/2021-12:47:19] [V] [TRT] [04/19/2021-12:47:19] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:47:19] [V] [TRT] Tactic: 1002 time 0.00904937 [04/19/2021-12:47:19] [V] [TRT] Tactic: 0 time 0.00564463 [04/19/2021-12:47:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00564463 [04/19/2021-12:47:19] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:47:19] [V] [TRT] Tactic: 1002 time 0.00916663 [04/19/2021-12:47:19] [V] [TRT] Tactic: 0 time 0.00534512 [04/19/2021-12:47:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00534512 [04/19/2021-12:47:19] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:47:19] [V] [TRT] Tactic: 1002 time 0.00945325 [04/19/2021-12:47:19] [V] [TRT] Tactic: 0 time 0.00563813 [04/19/2021-12:47:19] [V] [TRT] Fastest Tactic: 0 Time: 0.00563813 [04/19/2021-12:47:19] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,96), Float(1,56,3136,301056) -> Float(1,56,3136,301056) *************** [04/19/2021-12:47:19] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2a_se_excite/mul) (PointWise) [04/19/2021-12:47:19] [V] [TRT] Tactic: 128 time 0.811602 [04/19/2021-12:47:19] [V] [TRT] Tactic: 256 time 0.812741 [04/19/2021-12:47:19] [V] [TRT] Tactic: 512 time 0.816621 [04/19/2021-12:47:19] [V] [TRT] Tactic: -32 time 0.712715 [04/19/2021-12:47:19] [V] [TRT] Tactic: -64 time 0.72552 [04/19/2021-12:47:19] [V] [TRT] Tactic: -128 time 0.724785 [04/19/2021-12:47:19] [V] [TRT] Fastest Tactic: -32 Time: 0.712715 [04/19/2021-12:47:19] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2a_se_excite/mul) (PointWiseV2) [04/19/2021-12:47:19] [V] [TRT] Tactic: 0 time 0.595762 [04/19/2021-12:47:19] [V] [TRT] Tactic: 1 time 0.386465 [04/19/2021-12:47:19] [V] [TRT] Tactic: 2 time 0.363197 [04/19/2021-12:47:19] [V] [TRT] Tactic: 3 time 0.448652 [04/19/2021-12:47:19] [V] [TRT] Tactic: 4 time 0.462734 [04/19/2021-12:47:19] [V] [TRT] Tactic: 5 time 0.408594 [04/19/2021-12:47:19] [V] [TRT] Tactic: 6 time 0.598678 [04/19/2021-12:47:20] [V] [TRT] Tactic: 7 time 0.562708 [04/19/2021-12:47:20] [V] [TRT] Tactic: 8 time 0.572012 [04/19/2021-12:47:20] [V] [TRT] Tactic: 9 time 0.510553 [04/19/2021-12:47:20] [V] [TRT] Tactic: 28 time 0.511679 [04/19/2021-12:47:20] [V] [TRT] Fastest Tactic: 2 Time: 0.363197 [04/19/2021-12:47:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [04/19/2021-12:47:20] [V] [TRT] [04/19/2021-12:47:20] [V] [TRT] *************** Autotuning format combination: Float(1,1,1:32,3), Float(1,56,3136:32,9408) -> Float(1,56,3136:32,9408) *************** [04/19/2021-12:47:20] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2a_se_excite/mul) (PointWise) [04/19/2021-12:47:20] [V] [TRT] Tactic: 128 time 0.926335 [04/19/2021-12:47:21] [V] [TRT] Tactic: 256 time 11.0262 [04/19/2021-12:47:21] [V] [TRT] Tactic: 512 time 11.1101 [04/19/2021-12:47:22] [V] [TRT] Tactic: -32 time 7.19187 [04/19/2021-12:47:22] [V] [TRT] Tactic: -64 time 6.42 [04/19/2021-12:47:22] [V] [TRT] Tactic: -128 time 6.42137 [04/19/2021-12:47:22] [V] [TRT] Fastest Tactic: 128 Time: 0.926335 [04/19/2021-12:47:22] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2a_se_excite/mul) (PointWiseV2) [04/19/2021-12:47:22] [V] [TRT] Tactic: 24 time 1.28719 [04/19/2021-12:47:22] [V] [TRT] Tactic: 25 time 1.13918 [04/19/2021-12:47:22] [V] [TRT] Tactic: 26 time 1.1086 [04/19/2021-12:47:22] [V] [TRT] Tactic: 27 time 1.12275 [04/19/2021-12:47:22] [V] [TRT] Tactic: 31 time 1.29276 [04/19/2021-12:47:22] [V] [TRT] Fastest Tactic: 26 Time: 1.1086 [04/19/2021-12:47:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [04/19/2021-12:47:22] [V] [TRT] [04/19/2021-12:47:22] [V] [TRT] *************** Autotuning format combination: Float(1,56,3136,301056) -> Float(1,56,3136,75264) *************** [04/19/2021-12:47:22] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:47:22] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:47:22] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:47:22] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:47:22] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:47:22] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:47:22] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:47:22] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:47:22] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:47:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D (FusedConvActConvolution) [04/19/2021-12:47:23] [V] [TRT] Tactic: 589823 time 0.758802 [04/19/2021-12:47:23] [V] [TRT] Tactic: 655359 time 1.66641 [04/19/2021-12:47:23] [V] [TRT] Tactic: 786431 time 1.32871 [04/19/2021-12:47:23] [V] [TRT] Tactic: 851967 time 2.99441 [04/19/2021-12:47:23] [V] [TRT] Tactic: 1179647 time 1.59402 [04/19/2021-12:47:23] [V] [TRT] Tactic: 1310719 time 1.61703 [04/19/2021-12:47:23] [V] [TRT] Tactic: 1376255 time 0.878997 [04/19/2021-12:47:24] [V] [TRT] Tactic: 1441791 time 1.53606 [04/19/2021-12:47:24] [V] [TRT] Tactic: 1507327 time 2.15779 [04/19/2021-12:47:24] [V] [TRT] Tactic: 1638399 time 1.04068 [04/19/2021-12:47:24] [V] [TRT] Tactic: 1835007 time 1.01912 [04/19/2021-12:47:24] [V] [TRT] Tactic: 1900543 time 2.0096 [04/19/2021-12:47:24] [V] [TRT] Tactic: 2097151 time 1.08055 [04/19/2021-12:47:24] [V] [TRT] Tactic: 2162687 time 0.984538 [04/19/2021-12:47:24] [V] [TRT] Tactic: 2293759 time 0.924512 [04/19/2021-12:47:24] [V] [TRT] Tactic: 2359295 time 1.12854 [04/19/2021-12:47:24] [V] [TRT] Tactic: 2686975 time 0.908216 [04/19/2021-12:47:24] [V] [TRT] Tactic: 3080191 time 1.62283 [04/19/2021-12:47:25] [V] [TRT] Tactic: 3342335 time 1.88569 [04/19/2021-12:47:25] [V] [TRT] Tactic: 3407871 time 0.881439 [04/19/2021-12:47:25] [V] [TRT] Tactic: 3538943 time 0.902943 [04/19/2021-12:47:25] [V] [TRT] Tactic: 3670015 time 1.3956 [04/19/2021-12:47:25] [V] [TRT] Tactic: 3932159 time 1.49952 [04/19/2021-12:47:25] [V] [TRT] Tactic: 3997695 time 0.879232 [04/19/2021-12:47:25] [V] [TRT] Tactic: 4063231 time 1.93661 [04/19/2021-12:47:25] [V] [TRT] Tactic: 4194303 time 0.774238 [04/19/2021-12:47:25] [V] [TRT] Tactic: 4259839 time 0.892695 [04/19/2021-12:47:25] [V] [TRT] Tactic: 4325375 time 0.768743 [04/19/2021-12:47:25] [V] [TRT] Tactic: 4521983 time 0.751321 [04/19/2021-12:47:25] [V] [TRT] Tactic: 4587519 time 0.875417 [04/19/2021-12:47:25] [V] [TRT] Tactic: 4653055 time 1.35865 [04/19/2021-12:47:26] [V] [TRT] Tactic: 4915199 time 0.768965 [04/19/2021-12:47:26] [V] [TRT] Tactic: 4980735 time 0.809857 [04/19/2021-12:47:26] [V] [TRT] Tactic: 5177343 time 1.08329 [04/19/2021-12:47:26] [V] [TRT] Tactic: 5242879 time 0.926061 [04/19/2021-12:47:26] [V] [TRT] Tactic: 5373951 time 1.11413 [04/19/2021-12:47:26] [V] [TRT] Tactic: 5439487 time 1.07617 [04/19/2021-12:47:26] [V] [TRT] Tactic: 5570559 time 1.47105 [04/19/2021-12:47:26] [V] [TRT] Tactic: 5636095 time 1.69102 [04/19/2021-12:47:26] [V] [TRT] Tactic: 5701631 time 0.729681 [04/19/2021-12:47:26] [V] [TRT] Tactic: 5767167 time 2.01009 [04/19/2021-12:47:26] [V] [TRT] Tactic: 5832703 time 0.633197 [04/19/2021-12:47:26] [V] [TRT] Tactic: 5898239 time 0.729779 [04/19/2021-12:47:26] [V] [TRT] Tactic: 6029311 time 0.61444 [04/19/2021-12:47:26] [V] [TRT] Tactic: 6225919 time 0.680449 [04/19/2021-12:47:26] [V] [TRT] Tactic: 6291455 time 0.820313 [04/19/2021-12:47:27] [V] [TRT] Tactic: 6422527 time 1.14218 [04/19/2021-12:47:27] [V] [TRT] Tactic: 6750207 time 0.634134 [04/19/2021-12:47:27] [V] [TRT] Tactic: 6815743 time 0.984173 [04/19/2021-12:47:27] [V] [TRT] Tactic: 6946815 time 0.912526 [04/19/2021-12:47:27] [V] [TRT] Tactic: 7012351 time 0.686816 [04/19/2021-12:47:27] [V] [TRT] Tactic: 7077887 time 0.645033 [04/19/2021-12:47:27] [V] [TRT] Tactic: 7143423 time 0.848516 [04/19/2021-12:47:27] [V] [TRT] Tactic: 7208959 time 0.700006 [04/19/2021-12:47:27] [V] [TRT] Tactic: 7340031 time 0.713587 [04/19/2021-12:47:27] [V] [TRT] Tactic: 7405567 time 0.826165 [04/19/2021-12:47:27] [V] [TRT] Tactic: 7536639 time 0.886992 [04/19/2021-12:47:27] [V] [TRT] Tactic: 7602175 time 0.658242 [04/19/2021-12:47:27] [V] [TRT] Tactic: 7733247 time 0.700859 [04/19/2021-12:47:27] [V] [TRT] Tactic: 7798783 time 0.66931 [04/19/2021-12:47:27] [V] [TRT] Tactic: 8191999 time 0.805007 [04/19/2021-12:47:27] [V] [TRT] Tactic: 8257535 time 0.597604 [04/19/2021-12:47:27] [V] [TRT] Tactic: 8323071 time 0.648262 [04/19/2021-12:47:27] [V] [TRT] Tactic: 8650751 time 0.712442 [04/19/2021-12:47:27] [V] [TRT] Tactic: 8716287 time 0.936803 [04/19/2021-12:47:27] [V] [TRT] Tactic: 9109503 time 0.726471 [04/19/2021-12:47:28] [V] [TRT] Tactic: 9568255 time 0.593444 [04/19/2021-12:47:28] [V] [TRT] Tactic: 9895935 time 0.588021 [04/19/2021-12:47:28] [V] [TRT] Tactic: 10223615 time 0.591439 [04/19/2021-12:47:28] [V] [TRT] Tactic: 10354687 time 0.63541 [04/19/2021-12:47:28] [V] [TRT] Tactic: 10551295 time 0.542357 [04/19/2021-12:47:28] [V] [TRT] Tactic: 10747903 time 0.697767 [04/19/2021-12:47:28] [V] [TRT] Tactic: 10944511 time 0.617044 [04/19/2021-12:47:28] [V] [TRT] Fastest Tactic: 10551295 Time: 0.542357 [04/19/2021-12:47:28] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D (CaskConvolution) [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:47:28] [V] [TRT] Tactic: 1062367460111450758 time 0.27679 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:47:28] [V] [TRT] Tactic: 4501471010995462441 time 0.775645 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:47:28] [V] [TRT] Tactic: 5137655947464784826 time 0.393145 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:47:28] [V] [TRT] Tactic: 5326823351883942011 time 0.739427 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:47:28] [V] [TRT] Tactic: 6645123197870846056 time 0.403385 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:47:28] [V] [TRT] Tactic: -6576203419454146580 time 0.248841 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:47:28] [V] [TRT] Tactic: -3456450830548107839 time 0.260657 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:47:28] [V] [TRT] Tactic: -410470605513481746 time 0.759551 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:47:28] [V] [TRT] Tactic: -37215280111360163 time 0.392064 [04/19/2021-12:47:28] [V] [TRT] Fastest Tactic: -6576203419454146580 Time: 0.248841 [04/19/2021-12:47:28] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D (CudaConvolution) [04/19/2021-12:47:28] [V] [TRT] Tactic: 0 time 0.426471 [04/19/2021-12:47:28] [V] [TRT] Tactic: 2 time 0.736732 [04/19/2021-12:47:28] [V] [TRT] Tactic: 5 time 1.28309 [04/19/2021-12:47:28] [V] [TRT] Tactic: 57 time 0.347969 [04/19/2021-12:47:28] [V] [TRT] Fastest Tactic: 57 Time: 0.347969 [04/19/2021-12:47:28] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D (CudaDepthwiseConvolution) [04/19/2021-12:47:28] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/19/2021-12:47:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6576203419454146580 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:47:28] [V] [TRT] [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:47:28] [V] [TRT] *************** Autotuning format combination: Float(1,56,3136,75264) -> Float(1,56,3136,451584) *************** [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:47:28] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D (FusedConvActConvolution) [04/19/2021-12:47:28] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/19/2021-12:47:28] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D (CaskConvolution) [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:47:28] [V] [TRT] Tactic: 1062367460111450758 time 0.513444 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:47:28] [V] [TRT] Tactic: 4501471010995462441 time 0.629173 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:47:28] [V] [TRT] Tactic: 5137655947464784826 time 0.467142 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:47:28] [V] [TRT] Tactic: 5326823351883942011 time 0.592337 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:47:28] [V] [TRT] Tactic: 6645123197870846056 time 0.472858 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:47:28] [V] [TRT] Tactic: -6576203419454146580 time 0.472611 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:47:28] [V] [TRT] Tactic: -3456450830548107839 time 0.451895 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:47:28] [V] [TRT] Tactic: -410470605513481746 time 0.55181 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:47:28] [V] [TRT] Tactic: -37215280111360163 time 0.419772 [04/19/2021-12:47:28] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.419772 [04/19/2021-12:47:28] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D (CudaConvolution) [04/19/2021-12:47:28] [V] [TRT] Tactic: 0 time 0.837988 [04/19/2021-12:47:28] [V] [TRT] Tactic: 2 time 1.10942 [04/19/2021-12:47:28] [V] [TRT] Tactic: 5 time 1.46796 [04/19/2021-12:47:28] [V] [TRT] Tactic: 57 time 0.732793 [04/19/2021-12:47:28] [V] [TRT] Fastest Tactic: 57 Time: 0.732793 [04/19/2021-12:47:28] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D (CudaDepthwiseConvolution) [04/19/2021-12:47:28] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/19/2021-12:47:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:47:28] [V] [TRT] [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:47:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:47:28] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:47:28] [V] [TRT] Tactic: 1002 time 0.98235 [04/19/2021-12:47:28] [V] [TRT] Tactic: 0 time 1.42137 [04/19/2021-12:47:28] [V] [TRT] Fastest Tactic: 1002 Time: 0.98235 [04/19/2021-12:47:28] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:47:29] [V] [TRT] Tactic: 1002 time 0.984525 [04/19/2021-12:47:29] [V] [TRT] Tactic: 0 time 1.41683 [04/19/2021-12:47:29] [V] [TRT] Fastest Tactic: 1002 Time: 0.984525 [04/19/2021-12:47:29] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:47:29] [V] [TRT] Tactic: 1002 time 1.23059 [04/19/2021-12:47:29] [V] [TRT] Tactic: 0 time 1.51376 [04/19/2021-12:47:29] [V] [TRT] Fastest Tactic: 1002 Time: 1.23059 [04/19/2021-12:47:29] [V] [TRT] *************** Autotuning format combination: Float(1,56,3136,451584) -> Float(1,56,3136,451584) *************** [04/19/2021-12:47:29] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block2b_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2b_expand_activation/mul) (PointWise) [04/19/2021-12:47:29] [V] [TRT] Tactic: 128 time 0.971556 [04/19/2021-12:47:29] [V] [TRT] Tactic: 256 time 0.974759 [04/19/2021-12:47:29] [V] [TRT] Tactic: 512 time 0.98498 [04/19/2021-12:47:29] [V] [TRT] Tactic: -32 time 1.00811 [04/19/2021-12:47:29] [V] [TRT] Tactic: -64 time 0.987721 [04/19/2021-12:47:29] [V] [TRT] Tactic: -128 time 0.993854 [04/19/2021-12:47:29] [V] [TRT] Fastest Tactic: 128 Time: 0.971556 [04/19/2021-12:47:29] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block2b_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2b_expand_activation/mul) (PointWiseV2) [04/19/2021-12:47:29] [V] [TRT] Tactic: 0 time 0.454512 [04/19/2021-12:47:29] [V] [TRT] Tactic: 1 time 0.333158 [04/19/2021-12:47:29] [V] [TRT] Tactic: 2 time 0.303248 [04/19/2021-12:47:29] [V] [TRT] Tactic: 3 time 0.277552 [04/19/2021-12:47:29] [V] [TRT] Tactic: 4 time 0.219746 [04/19/2021-12:47:29] [V] [TRT] Tactic: 5 time 0.229558 [04/19/2021-12:47:29] [V] [TRT] Tactic: 6 time 0.267174 [04/19/2021-12:47:29] [V] [TRT] Tactic: 7 time 0.203242 [04/19/2021-12:47:29] [V] [TRT] Tactic: 8 time 0.184121 [04/19/2021-12:47:29] [V] [TRT] Tactic: 9 time 0.190058 [04/19/2021-12:47:29] [V] [TRT] Tactic: 28 time 0.440274 [04/19/2021-12:47:29] [V] [TRT] Fastest Tactic: 8 Time: 0.184121 [04/19/2021-12:47:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [04/19/2021-12:47:29] [V] [TRT] [04/19/2021-12:47:29] [V] [TRT] *************** Autotuning format combination: Float(1,56,3136:32,15680) -> Float(1,56,3136:32,15680) *************** [04/19/2021-12:47:29] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block2b_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2b_expand_activation/mul) (PointWise) [04/19/2021-12:47:29] [V] [TRT] Tactic: 128 time 1.51766 [04/19/2021-12:47:29] [V] [TRT] Tactic: 256 time 1.52116 [04/19/2021-12:47:29] [V] [TRT] Tactic: 512 time 1.52997 [04/19/2021-12:47:29] [V] [TRT] Tactic: -32 time 1.1273 [04/19/2021-12:47:29] [V] [TRT] Tactic: -64 time 1.11916 [04/19/2021-12:47:29] [V] [TRT] Tactic: -128 time 1.15562 [04/19/2021-12:47:29] [V] [TRT] Fastest Tactic: -64 Time: 1.11916 [04/19/2021-12:47:29] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block2b_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2b_expand_activation/mul) (PointWiseV2) [04/19/2021-12:47:29] [V] [TRT] Tactic: 24 time 0.377598 [04/19/2021-12:47:29] [V] [TRT] Tactic: 25 time 0.322286 [04/19/2021-12:47:29] [V] [TRT] Tactic: 26 time 0.32168 [04/19/2021-12:47:29] [V] [TRT] Tactic: 27 time 0.321347 [04/19/2021-12:47:29] [V] [TRT] Tactic: 31 time 0.378542 [04/19/2021-12:47:29] [V] [TRT] Fastest Tactic: 27 Time: 0.321347 [04/19/2021-12:47:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [04/19/2021-12:47:29] [V] [TRT] [04/19/2021-12:47:30] [V] [TRT] *************** Autotuning format combination: Float(1,56,3136,451584) -> Float(1,56,3136,451584) *************** [04/19/2021-12:47:30] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:47:30] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [04/19/2021-12:47:30] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [04/19/2021-12:47:30] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:47:30] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:47:30] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [04/19/2021-12:47:30] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:47:30] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [04/19/2021-12:47:30] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [04/19/2021-12:47:30] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [04/19/2021-12:47:30] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [04/19/2021-12:47:30] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:47:30] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 [04/19/2021-12:47:30] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [04/19/2021-12:47:30] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:47:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise (FusedConvActConvolution) [04/19/2021-12:47:30] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/19/2021-12:47:30] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise (CaskConvolution) [04/19/2021-12:47:30] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:47:30] [V] [TRT] Tactic: 1062367460111450758 time 10.6514 [04/19/2021-12:47:30] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [04/19/2021-12:47:31] [V] [TRT] Tactic: 3827454225649558724 time 30.3812 [04/19/2021-12:47:31] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [04/19/2021-12:47:31] [V] [TRT] Tactic: 4337000649858996379 time 15.1515 [04/19/2021-12:47:31] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:47:31] [V] [TRT] Tactic: 4501471010995462441 time 29.4103 [04/19/2021-12:47:31] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:47:32] [V] [TRT] Tactic: 5137655947464784826 time 14.4838 [04/19/2021-12:47:32] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [04/19/2021-12:47:32] [V] [TRT] Tactic: 5921334924264294896 time 20.7172 [04/19/2021-12:47:32] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:47:32] [V] [TRT] Tactic: 6645123197870846056 time 14.8713 [04/19/2021-12:47:32] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [04/19/2021-12:47:33] [V] [TRT] Tactic: 7852627285308570038 time 32.3369 [04/19/2021-12:47:33] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [04/19/2021-12:47:34] [V] [TRT] Tactic: -9137461792520977713 time 29.5767 [04/19/2021-12:47:34] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [04/19/2021-12:47:34] [V] [TRT] Tactic: -8776506421218919509 time 29.3098 [04/19/2021-12:47:34] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [04/19/2021-12:47:34] [V] [TRT] Tactic: -6092040395344634144 time 10.8572 [04/19/2021-12:47:34] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:47:34] [V] [TRT] Tactic: -3456450830548107839 time 10.114 [04/19/2021-12:47:34] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 [04/19/2021-12:47:35] [V] [TRT] Tactic: -2318106587342035239 time 31.1339 [04/19/2021-12:47:35] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [04/19/2021-12:47:35] [V] [TRT] Tactic: -1343271414618805657 time 20.3137 [04/19/2021-12:47:35] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:47:36] [V] [TRT] Tactic: -410470605513481746 time 28.936 [04/19/2021-12:47:36] [V] [TRT] Fastest Tactic: -3456450830548107839 Time: 10.114 [04/19/2021-12:47:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise (CudaConvolution) [04/19/2021-12:47:36] [V] [TRT] Tactic: 0 time 1.3156 [04/19/2021-12:47:36] [V] [TRT] Tactic: 2 time 1.31571 [04/19/2021-12:47:39] [V] [TRT] Tactic: 5 time 170.148 [04/19/2021-12:47:39] [V] [TRT] Tactic: 6 time 20.651 [04/19/2021-12:47:39] [V] [TRT] Tactic: 57 time 1.31438 [04/19/2021-12:47:39] [V] [TRT] Fastest Tactic: 57 Time: 1.31438 [04/19/2021-12:47:39] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise (CudaDepthwiseConvolution) [04/19/2021-12:47:39] [V] [TRT] Tactic: -1 time 0.597897 [04/19/2021-12:47:39] [V] [TRT] Fastest Tactic: -1 Time: 0.597897 [04/19/2021-12:47:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [04/19/2021-12:47:39] [V] [TRT] [04/19/2021-12:47:39] [V] [TRT] *************** Autotuning format combination: Float(1,56,3136,451584) -> Float(1,56,3136,451584) *************** [04/19/2021-12:47:39] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block2b_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2b_activation/mul) (PointWise) [04/19/2021-12:47:39] [V] [TRT] Tactic: 128 time 0.971295 [04/19/2021-12:47:39] [V] [TRT] Tactic: 256 time 0.974831 [04/19/2021-12:47:39] [V] [TRT] Tactic: 512 time 0.9847 [04/19/2021-12:47:40] [V] [TRT] Tactic: -32 time 1.00858 [04/19/2021-12:47:40] [V] [TRT] Tactic: -64 time 0.986986 [04/19/2021-12:47:40] [V] [TRT] Tactic: -128 time 0.993828 [04/19/2021-12:47:40] [V] [TRT] Fastest Tactic: 128 Time: 0.971295 [04/19/2021-12:47:40] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block2b_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2b_activation/mul) (PointWiseV2) [04/19/2021-12:47:40] [V] [TRT] Tactic: 0 time 0.454948 [04/19/2021-12:47:40] [V] [TRT] Tactic: 1 time 0.333977 [04/19/2021-12:47:40] [V] [TRT] Tactic: 2 time 0.305195 [04/19/2021-12:47:40] [V] [TRT] Tactic: 3 time 0.280514 [04/19/2021-12:47:40] [V] [TRT] Tactic: 4 time 0.221035 [04/19/2021-12:47:40] [V] [TRT] Tactic: 5 time 0.230879 [04/19/2021-12:47:40] [V] [TRT] Tactic: 6 time 0.264323 [04/19/2021-12:47:40] [V] [TRT] Tactic: 7 time 0.204238 [04/19/2021-12:47:40] [V] [TRT] Tactic: 8 time 0.18752 [04/19/2021-12:47:40] [V] [TRT] Tactic: 9 time 0.192481 [04/19/2021-12:47:40] [V] [TRT] Tactic: 28 time 0.441478 [04/19/2021-12:47:40] [V] [TRT] Fastest Tactic: 8 Time: 0.18752 [04/19/2021-12:47:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [04/19/2021-12:47:40] [V] [TRT] [04/19/2021-12:47:40] [V] [TRT] *************** Autotuning format combination: Float(1,56,3136:32,15680) -> Float(1,56,3136:32,15680) *************** [04/19/2021-12:47:40] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block2b_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2b_activation/mul) (PointWise) [04/19/2021-12:47:40] [V] [TRT] Tactic: 128 time 1.51788 [04/19/2021-12:47:40] [V] [TRT] Tactic: 256 time 1.52128 [04/19/2021-12:47:40] [V] [TRT] Tactic: 512 time 1.53008 [04/19/2021-12:47:40] [V] [TRT] Tactic: -32 time 1.12821 [04/19/2021-12:47:40] [V] [TRT] Tactic: -64 time 1.11938 [04/19/2021-12:47:40] [V] [TRT] Tactic: -128 time 1.15512 [04/19/2021-12:47:40] [V] [TRT] Fastest Tactic: -64 Time: 1.11938 [04/19/2021-12:47:40] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block2b_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2b_activation/mul) (PointWiseV2) [04/19/2021-12:47:40] [V] [TRT] Tactic: 24 time 0.380124 [04/19/2021-12:47:40] [V] [TRT] Tactic: 25 time 0.324922 [04/19/2021-12:47:41] [V] [TRT] Tactic: 26 time 2.5237 [04/19/2021-12:47:41] [V] [TRT] Tactic: 27 time 2.41166 [04/19/2021-12:47:41] [V] [TRT] Tactic: 31 time 3.31454 [04/19/2021-12:47:41] [V] [TRT] Fastest Tactic: 25 Time: 0.324922 [04/19/2021-12:47:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [04/19/2021-12:47:41] [V] [TRT] [04/19/2021-12:47:41] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:47:41] [V] [TRT] Tactic: 1002 time 1.34479 [04/19/2021-12:47:41] [V] [TRT] Tactic: 0 time 1.52538 [04/19/2021-12:47:41] [V] [TRT] Fastest Tactic: 1002 Time: 1.34479 [04/19/2021-12:47:41] [V] [TRT] *************** Autotuning format combination: Float(1,56,3136,451584) -> Float(1,144) *************** [04/19/2021-12:47:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2b_se_squeeze/Mean (Reduce) [04/19/2021-12:47:41] [V] [TRT] Tactic: 1 time 0.246282 [04/19/2021-12:47:41] [V] [TRT] Tactic: 3 time 0.686745 [04/19/2021-12:47:41] [V] [TRT] Tactic: 6 time 7.56767 [04/19/2021-12:47:41] [V] [TRT] Fastest Tactic: 1 Time: 0.246282 [04/19/2021-12:47:41] [V] [TRT] *************** Autotuning format combination: Float(1,144) -> Float(1,1,1,144) *************** [04/19/2021-12:47:41] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2b_se_reshape/Reshape + StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd__75 (Shuffle) [04/19/2021-12:47:41] [V] [TRT] Tactic: 0 time 0.00330063 [04/19/2021-12:47:42] [V] [TRT] Tactic: 1 time 0.0102471 [04/19/2021-12:47:42] [V] [TRT] Fastest Tactic: 0 Time: 0.00330063 [04/19/2021-12:47:42] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,144) -> Float(1,1,1,6) *************** [04/19/2021-12:47:42] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:47:42] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:47:42] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:47:42] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:47:42] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:47:42] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:47:42] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:47:42] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:47:42] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:47:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd (FusedConvActConvolution) [04/19/2021-12:47:42] [V] [TRT] Tactic: 589823 time 0.0489516 [04/19/2021-12:47:42] [V] [TRT] Tactic: 786431 time 0.0196352 [04/19/2021-12:47:42] [V] [TRT] Tactic: 1179647 time 0.0103384 [04/19/2021-12:47:42] [V] [TRT] Tactic: 1310719 time 0.0656314 [04/19/2021-12:47:42] [V] [TRT] Tactic: 1376255 time 0.0384114 [04/19/2021-12:47:42] [V] [TRT] Tactic: 1441791 time 0.0126368 [04/19/2021-12:47:42] [V] [TRT] Tactic: 1638399 time 0.0126496 [04/19/2021-12:47:42] [V] [TRT] Tactic: 1835007 time 0.0190817 [04/19/2021-12:47:42] [V] [TRT] Tactic: 2162687 time 0.0400391 [04/19/2021-12:47:42] [V] [TRT] Tactic: 2293759 time 0.0355274 [04/19/2021-12:47:42] [V] [TRT] Tactic: 2359295 time 0.0288671 [04/19/2021-12:47:42] [V] [TRT] Tactic: 2686975 time 0.035905 [04/19/2021-12:47:42] [V] [TRT] Tactic: 3407871 time 0.0220249 [04/19/2021-12:47:42] [V] [TRT] Tactic: 3538943 time 0.0136847 [04/19/2021-12:47:42] [V] [TRT] Tactic: 3997695 time 0.0126626 [04/19/2021-12:47:42] [V] [TRT] Tactic: 4194303 time 0.0197269 [04/19/2021-12:47:42] [V] [TRT] Tactic: 4325375 time 0.0150127 [04/19/2021-12:47:42] [V] [TRT] Tactic: 4521983 time 0.0382161 [04/19/2021-12:47:42] [V] [TRT] Tactic: 4587519 time 0.0126561 [04/19/2021-12:47:42] [V] [TRT] Tactic: 4653055 time 0.0126563 [04/19/2021-12:47:42] [V] [TRT] Tactic: 4915199 time 0.0126431 [04/19/2021-12:47:42] [V] [TRT] Tactic: 4980735 time 0.025547 [04/19/2021-12:47:42] [V] [TRT] Tactic: 5177343 time 0.0103382 [04/19/2021-12:47:42] [V] [TRT] Tactic: 5242879 time 0.0197724 [04/19/2021-12:47:42] [V] [TRT] Tactic: 5373951 time 0.0103389 [04/19/2021-12:47:42] [V] [TRT] Tactic: 5439487 time 0.0172589 [04/19/2021-12:47:42] [V] [TRT] Tactic: 5701631 time 0.0329364 [04/19/2021-12:47:42] [V] [TRT] Tactic: 5767167 time 0.0172527 [04/19/2021-12:47:42] [V] [TRT] Tactic: 5832703 time 0.0197915 [04/19/2021-12:47:42] [V] [TRT] Tactic: 5898239 time 0.0126755 [04/19/2021-12:47:42] [V] [TRT] Tactic: 6029311 time 0.0318555 [04/19/2021-12:47:42] [V] [TRT] Tactic: 6225919 time 0.0127669 [04/19/2021-12:47:42] [V] [TRT] Tactic: 6291455 time 0.010358 [04/19/2021-12:47:42] [V] [TRT] Tactic: 6750207 time 0.0124217 [04/19/2021-12:47:42] [V] [TRT] Tactic: 6815743 time 0.0196159 [04/19/2021-12:47:42] [V] [TRT] Tactic: 6946815 time 0.0219531 [04/19/2021-12:47:42] [V] [TRT] Tactic: 7077887 time 0.0126821 [04/19/2021-12:47:42] [V] [TRT] Tactic: 7143423 time 0.017233 [04/19/2021-12:47:42] [V] [TRT] Tactic: 7208959 time 0.0196354 [04/19/2021-12:47:42] [V] [TRT] Tactic: 7340031 time 0.0126434 [04/19/2021-12:47:42] [V] [TRT] Tactic: 7405567 time 0.012669 [04/19/2021-12:47:42] [V] [TRT] Tactic: 7536639 time 0.026569 [04/19/2021-12:47:42] [V] [TRT] Tactic: 7602175 time 0.0218814 [04/19/2021-12:47:42] [V] [TRT] Tactic: 7733247 time 0.0149545 [04/19/2021-12:47:42] [V] [TRT] Tactic: 7798783 time 0.0196028 [04/19/2021-12:47:42] [V] [TRT] Tactic: 8191999 time 0.014974 [04/19/2021-12:47:42] [V] [TRT] Tactic: 8257535 time 0.0126432 [04/19/2021-12:47:42] [V] [TRT] Tactic: 8323071 time 0.0173505 [04/19/2021-12:47:42] [V] [TRT] Tactic: 8650751 time 0.0218686 [04/19/2021-12:47:42] [V] [TRT] Tactic: 8716287 time 0.0126695 [04/19/2021-12:47:42] [V] [TRT] Tactic: 9568255 time 0.0126432 [04/19/2021-12:47:42] [V] [TRT] Tactic: 9895935 time 0.0197004 [04/19/2021-12:47:42] [V] [TRT] Tactic: 10223615 time 0.0359246 [04/19/2021-12:47:42] [V] [TRT] Tactic: 10354687 time 0.0104165 [04/19/2021-12:47:42] [V] [TRT] Tactic: 10551295 time 0.0218945 [04/19/2021-12:47:42] [V] [TRT] Tactic: 10747903 time 0.0156315 [04/19/2021-12:47:42] [V] [TRT] Tactic: 10944511 time 0.025547 [04/19/2021-12:47:42] [V] [TRT] Fastest Tactic: 5177343 Time: 0.0103382 [04/19/2021-12:47:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd (CaskConvolution) [04/19/2021-12:47:42] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:47:42] [V] [TRT] Tactic: 1062367460111450758 time 0.0364909 [04/19/2021-12:47:42] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:47:42] [V] [TRT] Tactic: 4501471010995462441 time 0.0385548 [04/19/2021-12:47:42] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:47:42] [V] [TRT] Tactic: 5137655947464784826 time 0.0288609 [04/19/2021-12:47:42] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:47:42] [V] [TRT] Tactic: 5326823351883942011 time 0.0383267 [04/19/2021-12:47:42] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:47:42] [V] [TRT] Tactic: 6645123197870846056 time 0.0309962 [04/19/2021-12:47:42] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:47:42] [V] [TRT] Tactic: -6576203419454146580 time 0.0291864 [04/19/2021-12:47:42] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:47:42] [V] [TRT] Tactic: -3456450830548107839 time 0.0311719 [04/19/2021-12:47:42] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:47:42] [V] [TRT] Tactic: -410470605513481746 time 0.0381836 [04/19/2021-12:47:42] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:47:42] [V] [TRT] Tactic: -37215280111360163 time 0.0292318 [04/19/2021-12:47:42] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.0288609 [04/19/2021-12:47:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd (CudaConvolution) [04/19/2021-12:47:42] [V] [TRT] Tactic: 0 time 0.0300714 [04/19/2021-12:47:42] [V] [TRT] Tactic: 2 time 0.0909699 [04/19/2021-12:47:42] [V] [TRT] Tactic: 5 time 0.115846 [04/19/2021-12:47:42] [V] [TRT] Tactic: 57 time 0.0311719 [04/19/2021-12:47:42] [V] [TRT] Fastest Tactic: 0 Time: 0.0300714 [04/19/2021-12:47:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd (CudaDepthwiseConvolution) [04/19/2021-12:47:42] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/19/2021-12:47:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 5177343 [04/19/2021-12:47:42] [V] [TRT] [04/19/2021-12:47:42] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:47:42] [V] [TRT] Tactic: 1002 time 0.00803388 [04/19/2021-12:47:42] [V] [TRT] Tactic: 0 time 0.00514325 [04/19/2021-12:47:42] [V] [TRT] Fastest Tactic: 0 Time: 0.00514325 [04/19/2021-12:47:42] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:47:43] [V] [TRT] Tactic: 1002 time 0.00822913 [04/19/2021-12:47:43] [V] [TRT] Tactic: 0 time 0.00517563 [04/19/2021-12:47:43] [V] [TRT] Fastest Tactic: 0 Time: 0.00517563 [04/19/2021-12:47:43] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:47:43] [V] [TRT] Tactic: 1002 time 0.00766912 [04/19/2021-12:47:43] [V] [TRT] Tactic: 0 time 0.00514338 [04/19/2021-12:47:43] [V] [TRT] Fastest Tactic: 0 Time: 0.00514338 [04/19/2021-12:47:43] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,6) -> Float(1,1,1,6) *************** [04/19/2021-12:47:43] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/mul) (PointWise) [04/19/2021-12:47:43] [V] [TRT] Tactic: 128 time 0.0057095 [04/19/2021-12:47:43] [V] [TRT] Tactic: 256 time 0.00572912 [04/19/2021-12:47:43] [V] [TRT] Tactic: 512 time 0.00572275 [04/19/2021-12:47:43] [V] [TRT] Fastest Tactic: 128 Time: 0.0057095 [04/19/2021-12:47:43] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/mul) (PointWiseV2) [04/19/2021-12:47:43] [V] [TRT] Tactic: 0 time 0.00394513 [04/19/2021-12:47:43] [V] [TRT] Tactic: 1 time 0.0049935 [04/19/2021-12:47:43] [V] [TRT] Tactic: 2 time 0.00478525 [04/19/2021-12:47:43] [V] [TRT] Tactic: 3 time 0.00562487 [04/19/2021-12:47:43] [V] [TRT] Tactic: 4 time 0.00533837 [04/19/2021-12:47:43] [V] [TRT] Tactic: 5 time 0.004017 [04/19/2021-12:47:43] [V] [TRT] Tactic: 6 time 0.00556 [04/19/2021-12:47:43] [V] [TRT] Tactic: 7 time 0.00561213 [04/19/2021-12:47:43] [V] [TRT] Tactic: 8 time 0.00491525 [04/19/2021-12:47:43] [V] [TRT] Tactic: 9 time 0.00481125 [04/19/2021-12:47:43] [V] [TRT] Tactic: 28 time 0.00417975 [04/19/2021-12:47:43] [V] [TRT] Fastest Tactic: 0 Time: 0.00394513 [04/19/2021-12:47:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [04/19/2021-12:47:43] [V] [TRT] [04/19/2021-12:47:43] [V] [TRT] *************** Autotuning format combination: Float(1,1,1:32,1) -> Float(1,1,1:32,1) *************** [04/19/2021-12:47:43] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/mul) (PointWise) [04/19/2021-12:47:43] [V] [TRT] Tactic: 128 time 0.0057485 [04/19/2021-12:47:43] [V] [TRT] Tactic: 256 time 0.00570325 [04/19/2021-12:47:43] [V] [TRT] Tactic: 512 time 0.00569013 [04/19/2021-12:47:43] [V] [TRT] Tactic: -32 time 0.00576163 [04/19/2021-12:47:43] [V] [TRT] Tactic: -64 time 0.00570275 [04/19/2021-12:47:43] [V] [TRT] Tactic: -128 time 0.00576812 [04/19/2021-12:47:43] [V] [TRT] Fastest Tactic: 512 Time: 0.00569013 [04/19/2021-12:47:43] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/mul) (PointWiseV2) [04/19/2021-12:47:43] [V] [TRT] Tactic: 24 time 0.00570325 [04/19/2021-12:47:43] [V] [TRT] Tactic: 25 time 0.00567038 [04/19/2021-12:47:43] [V] [TRT] Tactic: 26 time 0.005625 [04/19/2021-12:47:43] [V] [TRT] Tactic: 27 time 0.00796187 [04/19/2021-12:47:43] [V] [TRT] Tactic: 31 time 0.00559263 [04/19/2021-12:47:43] [V] [TRT] Fastest Tactic: 31 Time: 0.00559263 [04/19/2021-12:47:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [04/19/2021-12:47:43] [V] [TRT] [04/19/2021-12:47:43] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,6) -> Float(1,1,1,144) *************** [04/19/2021-12:47:43] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:47:43] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:47:43] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:47:43] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:47:43] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:47:43] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:47:43] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:47:43] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:47:43] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:47:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd (FusedConvActConvolution) [04/19/2021-12:47:43] [V] [TRT] Tactic: 589823 time 0.010319 [04/19/2021-12:47:43] [V] [TRT] Tactic: 655359 time 0.011315 [04/19/2021-12:47:43] [V] [TRT] Tactic: 1376255 time 0.0103841 [04/19/2021-12:47:43] [V] [TRT] Tactic: 1900543 time 0.012728 [04/19/2021-12:47:43] [V] [TRT] Tactic: 2162687 time 0.0103518 [04/19/2021-12:47:43] [V] [TRT] Tactic: 2293759 time 0.00980437 [04/19/2021-12:47:43] [V] [TRT] Tactic: 2686975 time 0.0103063 [04/19/2021-12:47:43] [V] [TRT] Tactic: 3670015 time 0.0127606 [04/19/2021-12:47:43] [V] [TRT] Tactic: 3932159 time 0.007995 [04/19/2021-12:47:43] [V] [TRT] Tactic: 4521983 time 0.0103515 [04/19/2021-12:47:43] [V] [TRT] Tactic: 5701631 time 0.00802713 [04/19/2021-12:47:43] [V] [TRT] Tactic: 6029311 time 0.00804025 [04/19/2021-12:47:43] [V] [TRT] Tactic: 7536639 time 0.00571625 [04/19/2021-12:47:43] [V] [TRT] Tactic: 10223615 time 0.0103255 [04/19/2021-12:47:43] [V] [TRT] Fastest Tactic: 7536639 Time: 0.00571625 [04/19/2021-12:47:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd (CaskConvolution) [04/19/2021-12:47:43] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:47:43] [V] [TRT] Tactic: 1062367460111450758 time 0.0174871 [04/19/2021-12:47:43] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:47:43] [V] [TRT] Tactic: 4501471010995462441 time 0.0177604 [04/19/2021-12:47:43] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:47:43] [V] [TRT] Tactic: 5137655947464784826 time 0.0150716 [04/19/2021-12:47:43] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:47:43] [V] [TRT] Tactic: 5326823351883942011 time 0.017754 [04/19/2021-12:47:43] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:47:43] [V] [TRT] Tactic: 6645123197870846056 time 0.015267 [04/19/2021-12:47:43] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:47:43] [V] [TRT] Tactic: -6576203419454146580 time 0.0153645 [04/19/2021-12:47:43] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:47:43] [V] [TRT] Tactic: -3456450830548107839 time 0.0168294 [04/19/2021-12:47:43] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:47:43] [V] [TRT] Tactic: -410470605513481746 time 0.017858 [04/19/2021-12:47:43] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:47:43] [V] [TRT] Tactic: -37215280111360163 time 0.0153776 [04/19/2021-12:47:43] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.0150716 [04/19/2021-12:47:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd (CudaConvolution) [04/19/2021-12:47:43] [V] [TRT] Tactic: 0 time 0.011647 [04/19/2021-12:47:44] [V] [TRT] Tactic: 2 time 0.0192774 [04/19/2021-12:47:44] [V] [TRT] Tactic: 5 time 0.08638 [04/19/2021-12:47:44] [V] [TRT] Tactic: 57 time 0.0228646 [04/19/2021-12:47:44] [V] [TRT] Fastest Tactic: 0 Time: 0.011647 [04/19/2021-12:47:44] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd (CudaDepthwiseConvolution) [04/19/2021-12:47:44] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/19/2021-12:47:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 7536639 [04/19/2021-12:47:44] [V] [TRT] [04/19/2021-12:47:44] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:47:44] [V] [TRT] Tactic: 1002 time 0.0103189 [04/19/2021-12:47:44] [V] [TRT] Tactic: 0 time 0.005625 [04/19/2021-12:47:44] [V] [TRT] Fastest Tactic: 0 Time: 0.005625 [04/19/2021-12:47:44] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:47:44] [V] [TRT] Tactic: 1002 time 0.0105534 [04/19/2021-12:47:44] [V] [TRT] Tactic: 0 time 0.00540363 [04/19/2021-12:47:44] [V] [TRT] Fastest Tactic: 0 Time: 0.00540363 [04/19/2021-12:47:44] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:47:44] [V] [TRT] Tactic: 1002 time 0.0747463 [04/19/2021-12:47:44] [V] [TRT] Tactic: 0 time 0.00546212 [04/19/2021-12:47:44] [V] [TRT] Fastest Tactic: 0 Time: 0.00546212 [04/19/2021-12:47:44] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,144), Float(1,56,3136,451584) -> Float(1,56,3136,451584) *************** [04/19/2021-12:47:44] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2b_se_excite/mul) (PointWise) [04/19/2021-12:47:44] [V] [TRT] Tactic: 128 time 1.21286 [04/19/2021-12:47:44] [V] [TRT] Tactic: 256 time 1.21596 [04/19/2021-12:47:44] [V] [TRT] Tactic: 512 time 1.22111 [04/19/2021-12:47:44] [V] [TRT] Tactic: -32 time 1.05805 [04/19/2021-12:47:44] [V] [TRT] Tactic: -64 time 1.08044 [04/19/2021-12:47:44] [V] [TRT] Tactic: -128 time 1.08033 [04/19/2021-12:47:44] [V] [TRT] Fastest Tactic: -32 Time: 1.05805 [04/19/2021-12:47:44] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2b_se_excite/mul) (PointWiseV2) [04/19/2021-12:47:44] [V] [TRT] Tactic: 0 time 0.889076 [04/19/2021-12:47:44] [V] [TRT] Tactic: 1 time 0.575098 [04/19/2021-12:47:44] [V] [TRT] Tactic: 2 time 0.539408 [04/19/2021-12:47:44] [V] [TRT] Tactic: 3 time 0.668138 [04/19/2021-12:47:44] [V] [TRT] Tactic: 4 time 0.689004 [04/19/2021-12:47:44] [V] [TRT] Tactic: 5 time 0.607884 [04/19/2021-12:47:44] [V] [TRT] Tactic: 6 time 0.895098 [04/19/2021-12:47:44] [V] [TRT] Tactic: 7 time 0.840072 [04/19/2021-12:47:44] [V] [TRT] Tactic: 8 time 0.85405 [04/19/2021-12:47:44] [V] [TRT] Tactic: 9 time 0.761107 [04/19/2021-12:47:44] [V] [TRT] Tactic: 28 time 0.763158 [04/19/2021-12:47:44] [V] [TRT] Fastest Tactic: 2 Time: 0.539408 [04/19/2021-12:47:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [04/19/2021-12:47:44] [V] [TRT] [04/19/2021-12:47:44] [V] [TRT] *************** Autotuning format combination: Float(1,1,1:32,5), Float(1,56,3136:32,15680) -> Float(1,56,3136:32,15680) *************** [04/19/2021-12:47:49] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2b_se_excite/mul) (PointWise) [04/19/2021-12:47:49] [V] [TRT] Tactic: 128 time 4.16073 [04/19/2021-12:47:49] [V] [TRT] Tactic: 256 time 4.17256 [04/19/2021-12:47:49] [V] [TRT] Tactic: 512 time 4.20054 [04/19/2021-12:47:49] [V] [TRT] Tactic: -32 time 4.01922 [04/19/2021-12:47:49] [V] [TRT] Tactic: -64 time 3.88405 [04/19/2021-12:47:50] [V] [TRT] Tactic: -128 time 3.88288 [04/19/2021-12:47:50] [V] [TRT] Fastest Tactic: -128 Time: 3.88288 [04/19/2021-12:47:50] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2b_se_excite/mul) (PointWiseV2) [04/19/2021-12:47:50] [V] [TRT] Tactic: 24 time 0.908815 [04/19/2021-12:47:50] [V] [TRT] Tactic: 25 time 0.704707 [04/19/2021-12:47:50] [V] [TRT] Tactic: 26 time 0.711582 [04/19/2021-12:47:50] [V] [TRT] Tactic: 27 time 0.689499 [04/19/2021-12:47:50] [V] [TRT] Tactic: 31 time 0.896458 [04/19/2021-12:47:50] [V] [TRT] Fastest Tactic: 27 Time: 0.689499 [04/19/2021-12:47:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [04/19/2021-12:47:50] [V] [TRT] [04/19/2021-12:47:50] [V] [TRT] *************** Autotuning format combination: Float(1,56,3136,451584), Float(1,56,3136,75264) -> Float(1,56,3136,75264) *************** [04/19/2021-12:47:50] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block2b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:47:50] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block2b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:47:50] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block2b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:47:50] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block2b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:47:50] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block2b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:47:50] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block2b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:47:50] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block2b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:47:50] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block2b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:47:50] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block2b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:47:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block2b_add/add (CaskConvolution) [04/19/2021-12:47:50] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block2b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:47:50] [V] [TRT] Tactic: 1062367460111450758 time 0.296042 [04/19/2021-12:47:50] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block2b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:47:50] [V] [TRT] Tactic: 4501471010995462441 time 0.820859 [04/19/2021-12:47:50] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block2b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:47:50] [V] [TRT] Tactic: 5137655947464784826 time 0.410703 [04/19/2021-12:47:50] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block2b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:47:50] [V] [TRT] Tactic: 5326823351883942011 time 0.791003 [04/19/2021-12:47:50] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block2b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:47:50] [V] [TRT] Tactic: 6645123197870846056 time 0.423535 [04/19/2021-12:47:50] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block2b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:47:50] [V] [TRT] Tactic: -6576203419454146580 time 0.269837 [04/19/2021-12:47:50] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block2b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:47:50] [V] [TRT] Tactic: -3456450830548107839 time 0.280319 [04/19/2021-12:47:50] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block2b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:47:50] [V] [TRT] Tactic: -410470605513481746 time 0.790619 [04/19/2021-12:47:50] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block2b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:47:50] [V] [TRT] Tactic: -37215280111360163 time 0.40849 [04/19/2021-12:47:50] [V] [TRT] Fastest Tactic: -6576203419454146580 Time: 0.269837 [04/19/2021-12:47:50] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block2b_add/add (CudaConvolution) [04/19/2021-12:47:50] [V] [TRT] Tactic: 0 time 0.501068 [04/19/2021-12:47:50] [V] [TRT] Tactic: 2 time 0.88446 [04/19/2021-12:47:50] [V] [TRT] Tactic: 5 time 1.54317 [04/19/2021-12:47:50] [V] [TRT] Tactic: 57 time 0.418724 [04/19/2021-12:47:51] [V] [TRT] Fastest Tactic: 57 Time: 0.418724 [04/19/2021-12:47:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6576203419454146580 [04/19/2021-12:47:51] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block2b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:47:51] [V] [TRT] [04/19/2021-12:47:51] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block2b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:47:51] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block2b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:47:51] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block2b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:47:51] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block2b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:47:51] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block2b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:47:51] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block2b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:47:51] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block2b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:47:51] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block2b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:47:51] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block2b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:47:51] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block2b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:47:51] [V] [TRT] *************** Autotuning format combination: Float(1,56,3136,75264) -> Float(1,56,3136,451584) *************** [04/19/2021-12:47:51] [V] [TRT] *************** Autotuning format combination: Float(1,56,3136,451584) -> Float(1,56,3136,451584) *************** [04/19/2021-12:47:51] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block3a_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3a_expand_activation/mul) (PointWise) [04/19/2021-12:47:51] [V] [TRT] Tactic: 128 time 0.97181 [04/19/2021-12:47:51] [V] [TRT] Tactic: 256 time 0.974128 [04/19/2021-12:47:51] [V] [TRT] Tactic: 512 time 0.984004 [04/19/2021-12:47:52] [V] [TRT] Tactic: -32 time 1.00755 [04/19/2021-12:47:52] [V] [TRT] Tactic: -64 time 0.98653 [04/19/2021-12:47:52] [V] [TRT] Tactic: -128 time 0.993027 [04/19/2021-12:47:52] [V] [TRT] Fastest Tactic: 128 Time: 0.97181 [04/19/2021-12:47:52] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block3a_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3a_expand_activation/mul) (PointWiseV2) [04/19/2021-12:47:52] [V] [TRT] Tactic: 0 time 0.454251 [04/19/2021-12:47:52] [V] [TRT] Tactic: 1 time 0.333704 [04/19/2021-12:47:52] [V] [TRT] Tactic: 2 time 0.30597 [04/19/2021-12:47:52] [V] [TRT] Tactic: 3 time 0.28151 [04/19/2021-12:47:52] [V] [TRT] Tactic: 4 time 0.221393 [04/19/2021-12:47:52] [V] [TRT] Tactic: 5 time 0.230898 [04/19/2021-12:47:52] [V] [TRT] Tactic: 6 time 0.26918 [04/19/2021-12:47:52] [V] [TRT] Tactic: 7 time 0.202526 [04/19/2021-12:47:52] [V] [TRT] Tactic: 8 time 0.184883 [04/19/2021-12:47:52] [V] [TRT] Tactic: 9 time 0.189557 [04/19/2021-12:47:52] [V] [TRT] Tactic: 28 time 0.440599 [04/19/2021-12:47:52] [V] [TRT] Fastest Tactic: 8 Time: 0.184883 [04/19/2021-12:47:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [04/19/2021-12:47:52] [V] [TRT] [04/19/2021-12:47:52] [V] [TRT] *************** Autotuning format combination: Float(1,56,3136:32,15680) -> Float(1,56,3136:32,15680) *************** [04/19/2021-12:47:52] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block3a_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3a_expand_activation/mul) (PointWise) [04/19/2021-12:47:52] [V] [TRT] Tactic: 128 time 1.51669 [04/19/2021-12:47:52] [V] [TRT] Tactic: 256 time 1.52032 [04/19/2021-12:47:52] [V] [TRT] Tactic: 512 time 1.529 [04/19/2021-12:47:52] [V] [TRT] Tactic: -32 time 1.1266 [04/19/2021-12:47:52] [V] [TRT] Tactic: -64 time 1.11854 [04/19/2021-12:47:52] [V] [TRT] Tactic: -128 time 1.15454 [04/19/2021-12:47:52] [V] [TRT] Fastest Tactic: -64 Time: 1.11854 [04/19/2021-12:47:52] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block3a_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3a_expand_activation/mul) (PointWiseV2) [04/19/2021-12:47:52] [V] [TRT] Tactic: 24 time 0.391693 [04/19/2021-12:47:52] [V] [TRT] Tactic: 25 time 0.325436 [04/19/2021-12:47:52] [V] [TRT] Tactic: 26 time 0.323138 [04/19/2021-12:47:52] [V] [TRT] Tactic: 27 time 0.314902 [04/19/2021-12:47:52] [V] [TRT] Tactic: 31 time 0.379662 [04/19/2021-12:47:52] [V] [TRT] Fastest Tactic: 27 Time: 0.314902 [04/19/2021-12:47:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [04/19/2021-12:47:52] [V] [TRT] [04/19/2021-12:47:52] [V] [TRT] *************** Autotuning format combination: Float(1,56,3136,451584) -> Float(1,28,784,112896) *************** [04/19/2021-12:47:52] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:47:52] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [04/19/2021-12:47:52] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:47:52] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:47:52] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:47:52] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [04/19/2021-12:47:52] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [04/19/2021-12:47:52] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:47:52] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:47:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block3a_dwconv/depthwise (FusedConvActConvolution) [04/19/2021-12:47:52] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/19/2021-12:47:52] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block3a_dwconv/depthwise (CaskConvolution) [04/19/2021-12:47:52] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:47:53] [V] [TRT] Tactic: 1062367460111450758 time 5.65958 [04/19/2021-12:47:53] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [04/19/2021-12:47:53] [V] [TRT] Tactic: 4337000649858996379 time 7.27887 [04/19/2021-12:47:53] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:47:53] [V] [TRT] Tactic: 4501471010995462441 time 11.2323 [04/19/2021-12:47:53] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:47:53] [V] [TRT] Tactic: 5137655947464784826 time 6.20078 [04/19/2021-12:47:53] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:47:53] [V] [TRT] Tactic: 6645123197870846056 time 6.34899 [04/19/2021-12:47:53] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [04/19/2021-12:47:54] [V] [TRT] Tactic: -9137461792520977713 time 11.2575 [04/19/2021-12:47:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [04/19/2021-12:47:54] [V] [TRT] Tactic: -6092040395344634144 time 5.38359 [04/19/2021-12:47:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:47:54] [V] [TRT] Tactic: -3456450830548107839 time 4.86836 [04/19/2021-12:47:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:47:54] [V] [TRT] Tactic: -410470605513481746 time 10.9369 [04/19/2021-12:47:54] [V] [TRT] Fastest Tactic: -3456450830548107839 Time: 4.86836 [04/19/2021-12:47:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block3a_dwconv/depthwise (CudaConvolution) [04/19/2021-12:47:54] [V] [TRT] Tactic: 0 time 3.96749 [04/19/2021-12:47:54] [V] [TRT] Tactic: 2 time 1.27833 [04/19/2021-12:47:57] [V] [TRT] Tactic: 5 time 169.362 [04/19/2021-12:47:57] [V] [TRT] Tactic: 57 time 4.73395 [04/19/2021-12:47:57] [V] [TRT] Fastest Tactic: 2 Time: 1.27833 [04/19/2021-12:47:57] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block3a_dwconv/depthwise (CudaDepthwiseConvolution) [04/19/2021-12:47:57] [V] [TRT] Tactic: -1 time 0.856458 [04/19/2021-12:47:57] [V] [TRT] Fastest Tactic: -1 Time: 0.856458 [04/19/2021-12:47:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [04/19/2021-12:47:57] [V] [TRT] [04/19/2021-12:47:57] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:47:57] [V] [TRT] Tactic: 1002 time 0.261055 [04/19/2021-12:47:57] [V] [TRT] Tactic: 0 time 0.266198 [04/19/2021-12:47:57] [V] [TRT] Fastest Tactic: 1002 Time: 0.261055 [04/19/2021-12:47:57] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:47:57] [V] [TRT] Tactic: 1002 time 0.260397 [04/19/2021-12:47:57] [V] [TRT] Tactic: 0 time 0.26582 [04/19/2021-12:47:57] [V] [TRT] Fastest Tactic: 1002 Time: 0.260397 [04/19/2021-12:47:57] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:47:57] [V] [TRT] Tactic: 1002 time 0.401608 [04/19/2021-12:47:57] [V] [TRT] Tactic: 0 time 0.212142 [04/19/2021-12:47:57] [V] [TRT] Fastest Tactic: 0 Time: 0.212142 [04/19/2021-12:47:57] [V] [TRT] *************** Autotuning format combination: Float(1,28,784,112896) -> Float(1,28,784,112896) *************** [04/19/2021-12:47:57] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block3a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3a_activation/mul) (PointWise) [04/19/2021-12:47:57] [V] [TRT] Tactic: 128 time 0.249499 [04/19/2021-12:47:57] [V] [TRT] Tactic: 256 time 0.249922 [04/19/2021-12:47:57] [V] [TRT] Tactic: 512 time 0.252598 [04/19/2021-12:47:57] [V] [TRT] Tactic: -32 time 0.278483 [04/19/2021-12:47:57] [V] [TRT] Tactic: -64 time 0.263262 [04/19/2021-12:47:57] [V] [TRT] Tactic: -128 time 0.261888 [04/19/2021-12:47:57] [V] [TRT] Fastest Tactic: 128 Time: 0.249499 [04/19/2021-12:47:57] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block3a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3a_activation/mul) (PointWiseV2) [04/19/2021-12:47:57] [V] [TRT] Tactic: 0 time 0.119687 [04/19/2021-12:47:57] [V] [TRT] Tactic: 1 time 0.0886197 [04/19/2021-12:47:57] [V] [TRT] Tactic: 2 time 0.0819595 [04/19/2021-12:47:57] [V] [TRT] Tactic: 3 time 0.0755989 [04/19/2021-12:47:57] [V] [TRT] Tactic: 4 time 0.060013 [04/19/2021-12:47:57] [V] [TRT] Tactic: 5 time 0.0627149 [04/19/2021-12:47:57] [V] [TRT] Tactic: 6 time 0.0721874 [04/19/2021-12:47:57] [V] [TRT] Tactic: 7 time 0.0560546 [04/19/2021-12:47:57] [V] [TRT] Tactic: 8 time 0.0507421 [04/19/2021-12:47:57] [V] [TRT] Tactic: 9 time 0.0532939 [04/19/2021-12:47:57] [V] [TRT] Tactic: 28 time 0.116283 [04/19/2021-12:47:57] [V] [TRT] Fastest Tactic: 8 Time: 0.0507421 [04/19/2021-12:47:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [04/19/2021-12:47:57] [V] [TRT] [04/19/2021-12:47:58] [V] [TRT] *************** Autotuning format combination: Float(1,28,784:32,3920) -> Float(1,28,784:32,3920) *************** [04/19/2021-12:47:58] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block3a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3a_activation/mul) (PointWise) [04/19/2021-12:47:58] [V] [TRT] Tactic: 128 time 0.386882 [04/19/2021-12:47:58] [V] [TRT] Tactic: 256 time 0.387435 [04/19/2021-12:47:58] [V] [TRT] Tactic: 512 time 0.389545 [04/19/2021-12:47:58] [V] [TRT] Tactic: -32 time 0.30554 [04/19/2021-12:47:58] [V] [TRT] Tactic: -64 time 0.293717 [04/19/2021-12:47:58] [V] [TRT] Tactic: -128 time 0.301107 [04/19/2021-12:47:58] [V] [TRT] Fastest Tactic: -64 Time: 0.293717 [04/19/2021-12:47:58] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block3a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3a_activation/mul) (PointWiseV2) [04/19/2021-12:47:58] [V] [TRT] Tactic: 24 time 0.104154 [04/19/2021-12:47:58] [V] [TRT] Tactic: 25 time 0.0871876 [04/19/2021-12:47:58] [V] [TRT] Tactic: 26 time 0.0868295 [04/19/2021-12:47:58] [V] [TRT] Tactic: 27 time 0.0860287 [04/19/2021-12:47:58] [V] [TRT] Tactic: 31 time 0.0996616 [04/19/2021-12:47:58] [V] [TRT] Fastest Tactic: 27 Time: 0.0860287 [04/19/2021-12:47:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [04/19/2021-12:47:58] [V] [TRT] [04/19/2021-12:47:58] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:47:58] [V] [TRT] Tactic: 1002 time 0.399336 [04/19/2021-12:47:58] [V] [TRT] Tactic: 0 time 0.211823 [04/19/2021-12:47:58] [V] [TRT] Fastest Tactic: 0 Time: 0.211823 [04/19/2021-12:47:58] [V] [TRT] *************** Autotuning format combination: Float(1,28,784,112896) -> Float(1,144) *************** [04/19/2021-12:47:58] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block3a_se_squeeze/Mean (Reduce) [04/19/2021-12:47:58] [V] [TRT] Tactic: 1 time 0.145241 [04/19/2021-12:47:58] [V] [TRT] Tactic: 3 time 0.164121 [04/19/2021-12:47:58] [V] [TRT] Tactic: 6 time 1.85759 [04/19/2021-12:47:58] [V] [TRT] Fastest Tactic: 1 Time: 0.145241 [04/19/2021-12:47:58] [V] [TRT] *************** Autotuning format combination: Float(1,144) -> Float(1,1,1,144) *************** [04/19/2021-12:47:58] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block3a_se_reshape/Reshape + StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/BiasAdd__95 (Shuffle) [04/19/2021-12:47:58] [V] [TRT] Tactic: 0 time 0.00335938 [04/19/2021-12:47:58] [V] [TRT] Tactic: 1 time 0.0110808 [04/19/2021-12:47:58] [V] [TRT] Fastest Tactic: 0 Time: 0.00335938 [04/19/2021-12:47:58] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,144) -> Float(1,1,1,6) *************** [04/19/2021-12:47:58] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,6) -> Float(1,1,1,6) *************** [04/19/2021-12:47:58] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/mul) (PointWise) [04/19/2021-12:47:58] [V] [TRT] Tactic: 128 time 0.00567687 [04/19/2021-12:47:58] [V] [TRT] Tactic: 256 time 0.0056835 [04/19/2021-12:47:58] [V] [TRT] Tactic: 512 time 0.00568375 [04/19/2021-12:47:58] [V] [TRT] Fastest Tactic: 128 Time: 0.00567687 [04/19/2021-12:47:58] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/mul) (PointWiseV2) [04/19/2021-12:47:58] [V] [TRT] Tactic: 0 time 0.00343088 [04/19/2021-12:47:58] [V] [TRT] Tactic: 1 time 0.00480462 [04/19/2021-12:47:58] [V] [TRT] Tactic: 2 time 0.00445963 [04/19/2021-12:47:58] [V] [TRT] Tactic: 3 time 0.005638 [04/19/2021-12:47:58] [V] [TRT] Tactic: 4 time 0.00505863 [04/19/2021-12:47:58] [V] [TRT] Tactic: 5 time 0.00416662 [04/19/2021-12:47:59] [V] [TRT] Tactic: 6 time 0.00558588 [04/19/2021-12:47:59] [V] [TRT] Tactic: 7 time 0.00554675 [04/19/2021-12:47:59] [V] [TRT] Tactic: 8 time 0.00486975 [04/19/2021-12:47:59] [V] [TRT] Tactic: 9 time 0.00484387 [04/19/2021-12:47:59] [V] [TRT] Tactic: 28 time 0.00397762 [04/19/2021-12:47:59] [V] [TRT] Fastest Tactic: 0 Time: 0.00343088 [04/19/2021-12:47:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [04/19/2021-12:47:59] [V] [TRT] [04/19/2021-12:47:59] [V] [TRT] *************** Autotuning format combination: Float(1,1,1:32,1) -> Float(1,1,1:32,1) *************** [04/19/2021-12:47:59] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/mul) (PointWise) [04/19/2021-12:47:59] [V] [TRT] Tactic: 128 time 0.00551437 [04/19/2021-12:47:59] [V] [TRT] Tactic: 256 time 0.00574225 [04/19/2021-12:47:59] [V] [TRT] Tactic: 512 time 0.00580725 [04/19/2021-12:47:59] [V] [TRT] Tactic: -32 time 0.00570962 [04/19/2021-12:47:59] [V] [TRT] Tactic: -64 time 0.005677 [04/19/2021-12:47:59] [V] [TRT] Tactic: -128 time 0.0056965 [04/19/2021-12:47:59] [V] [TRT] Fastest Tactic: 128 Time: 0.00551437 [04/19/2021-12:47:59] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/mul) (PointWiseV2) [04/19/2021-12:47:59] [V] [TRT] Tactic: 24 time 0.00554037 [04/19/2021-12:47:59] [V] [TRT] Tactic: 25 time 0.00555987 [04/19/2021-12:47:59] [V] [TRT] Tactic: 26 time 0.00564438 [04/19/2021-12:47:59] [V] [TRT] Tactic: 27 time 0.00793612 [04/19/2021-12:47:59] [V] [TRT] Tactic: 31 time 0.005664 [04/19/2021-12:47:59] [V] [TRT] Fastest Tactic: 24 Time: 0.00554037 [04/19/2021-12:47:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [04/19/2021-12:47:59] [V] [TRT] [04/19/2021-12:47:59] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,6) -> Float(1,1,1,144) *************** [04/19/2021-12:47:59] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,144), Float(1,28,784,112896) -> Float(1,28,784,112896) *************** [04/19/2021-12:47:59] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block3a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3a_se_excite/mul) (PointWise) [04/19/2021-12:47:59] [V] [TRT] Tactic: 128 time 0.310228 [04/19/2021-12:47:59] [V] [TRT] Tactic: 256 time 0.310742 [04/19/2021-12:47:59] [V] [TRT] Tactic: 512 time 0.312663 [04/19/2021-12:47:59] [V] [TRT] Tactic: -32 time 0.282806 [04/19/2021-12:47:59] [V] [TRT] Tactic: -64 time 0.281504 [04/19/2021-12:47:59] [V] [TRT] Tactic: -128 time 0.278783 [04/19/2021-12:47:59] [V] [TRT] Fastest Tactic: -128 Time: 0.278783 [04/19/2021-12:47:59] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block3a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3a_se_excite/mul) (PointWiseV2) [04/19/2021-12:47:59] [V] [TRT] Tactic: 0 time 0.228887 [04/19/2021-12:47:59] [V] [TRT] Tactic: 1 time 0.273757 [04/19/2021-12:47:59] [V] [TRT] Tactic: 2 time 0.250716 [04/19/2021-12:47:59] [V] [TRT] Tactic: 3 time 0.322292 [04/19/2021-12:47:59] [V] [TRT] Tactic: 4 time 0.330787 [04/19/2021-12:47:59] [V] [TRT] Tactic: 5 time 0.284024 [04/19/2021-12:47:59] [V] [TRT] Tactic: 6 time 0.434544 [04/19/2021-12:47:59] [V] [TRT] Tactic: 7 time 0.405085 [04/19/2021-12:47:59] [V] [TRT] Tactic: 8 time 0.412513 [04/19/2021-12:47:59] [V] [TRT] Tactic: 9 time 0.360006 [04/19/2021-12:47:59] [V] [TRT] Tactic: 28 time 0.197357 [04/19/2021-12:47:59] [V] [TRT] Fastest Tactic: 28 Time: 0.197357 [04/19/2021-12:47:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [04/19/2021-12:47:59] [V] [TRT] [04/19/2021-12:48:00] [V] [TRT] *************** Autotuning format combination: Float(1,1,1:32,5), Float(1,28,784:32,3920) -> Float(1,28,784:32,3920) *************** [04/19/2021-12:48:00] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block3a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3a_se_excite/mul) (PointWise) [04/19/2021-12:48:00] [V] [TRT] Tactic: 128 time 0.438783 [04/19/2021-12:48:00] [V] [TRT] Tactic: 256 time 0.44041 [04/19/2021-12:48:00] [V] [TRT] Tactic: 512 time 0.441732 [04/19/2021-12:48:00] [V] [TRT] Tactic: -32 time 0.491426 [04/19/2021-12:48:00] [V] [TRT] Tactic: -64 time 0.493164 [04/19/2021-12:48:00] [V] [TRT] Tactic: -128 time 0.493119 [04/19/2021-12:48:00] [V] [TRT] Fastest Tactic: 128 Time: 0.438783 [04/19/2021-12:48:00] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block3a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3a_se_excite/mul) (PointWiseV2) [04/19/2021-12:48:00] [V] [TRT] Tactic: 24 time 0.12334 [04/19/2021-12:48:00] [V] [TRT] Tactic: 25 time 0.120475 [04/19/2021-12:48:00] [V] [TRT] Tactic: 26 time 0.116556 [04/19/2021-12:48:00] [V] [TRT] Tactic: 27 time 0.107461 [04/19/2021-12:48:00] [V] [TRT] Tactic: 31 time 0.122272 [04/19/2021-12:48:00] [V] [TRT] Fastest Tactic: 27 Time: 0.107461 [04/19/2021-12:48:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [04/19/2021-12:48:00] [V] [TRT] [04/19/2021-12:48:00] [V] [TRT] *************** Autotuning format combination: Float(1,28,784,112896) -> Float(1,28,784,31360) *************** [04/19/2021-12:48:00] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:00] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:00] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:00] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:00] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:00] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:48:00] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:00] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:00] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:48:00] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D (FusedConvActConvolution) [04/19/2021-12:48:00] [V] [TRT] Tactic: 589823 time 0.268151 [04/19/2021-12:48:00] [V] [TRT] Tactic: 655359 time 0.348027 [04/19/2021-12:48:00] [V] [TRT] Tactic: 786431 time 0.284746 [04/19/2021-12:48:00] [V] [TRT] Tactic: 851967 time 0.380547 [04/19/2021-12:48:00] [V] [TRT] Tactic: 1179647 time 0.234004 [04/19/2021-12:48:00] [V] [TRT] Tactic: 1310719 time 0.498399 [04/19/2021-12:48:00] [V] [TRT] Tactic: 1376255 time 0.2 [04/19/2021-12:48:00] [V] [TRT] Tactic: 1441791 time 0.26067 [04/19/2021-12:48:00] [V] [TRT] Tactic: 1507327 time 0.353451 [04/19/2021-12:48:00] [V] [TRT] Tactic: 1638399 time 0.292747 [04/19/2021-12:48:00] [V] [TRT] Tactic: 1835007 time 0.256667 [04/19/2021-12:48:00] [V] [TRT] Tactic: 1900543 time 0.375657 [04/19/2021-12:48:00] [V] [TRT] Tactic: 2162687 time 0.205273 [04/19/2021-12:48:00] [V] [TRT] Tactic: 2293759 time 0.20097 [04/19/2021-12:48:01] [V] [TRT] Tactic: 2359295 time 0.216361 [04/19/2021-12:48:01] [V] [TRT] Tactic: 2686975 time 0.195404 [04/19/2021-12:48:01] [V] [TRT] Tactic: 3080191 time 0.340762 [04/19/2021-12:48:01] [V] [TRT] Tactic: 3342335 time 0.374499 [04/19/2021-12:48:01] [V] [TRT] Tactic: 3407871 time 0.206882 [04/19/2021-12:48:01] [V] [TRT] Tactic: 3538943 time 0.203405 [04/19/2021-12:48:01] [V] [TRT] Tactic: 3670015 time 0.374219 [04/19/2021-12:48:01] [V] [TRT] Tactic: 3932159 time 0.331979 [04/19/2021-12:48:01] [V] [TRT] Tactic: 3997695 time 0.279896 [04/19/2021-12:48:01] [V] [TRT] Tactic: 4063231 time 0.373496 [04/19/2021-12:48:01] [V] [TRT] Tactic: 4194303 time 0.245287 [04/19/2021-12:48:01] [V] [TRT] Tactic: 4325375 time 0.257233 [04/19/2021-12:48:01] [V] [TRT] Tactic: 4521983 time 0.2714 [04/19/2021-12:48:01] [V] [TRT] Tactic: 4587519 time 0.312005 [04/19/2021-12:48:01] [V] [TRT] Tactic: 4653055 time 0.280397 [04/19/2021-12:48:01] [V] [TRT] Tactic: 4915199 time 0.248555 [04/19/2021-12:48:01] [V] [TRT] Tactic: 4980735 time 0.265443 [04/19/2021-12:48:01] [V] [TRT] Tactic: 5177343 time 0.222175 [04/19/2021-12:48:01] [V] [TRT] Tactic: 5242879 time 0.196536 [04/19/2021-12:48:01] [V] [TRT] Tactic: 5373951 time 0.325703 [04/19/2021-12:48:01] [V] [TRT] Tactic: 5439487 time 0.354037 [04/19/2021-12:48:01] [V] [TRT] Tactic: 5570559 time 0.339466 [04/19/2021-12:48:01] [V] [TRT] Tactic: 5636095 time 0.375553 [04/19/2021-12:48:01] [V] [TRT] Tactic: 5701631 time 0.217852 [04/19/2021-12:48:01] [V] [TRT] Tactic: 5767167 time 0.636615 [04/19/2021-12:48:01] [V] [TRT] Tactic: 5832703 time 0.20457 [04/19/2021-12:48:01] [V] [TRT] Tactic: 5898239 time 0.184219 [04/19/2021-12:48:01] [V] [TRT] Tactic: 6029311 time 0.190775 [04/19/2021-12:48:01] [V] [TRT] Tactic: 6225919 time 0.18711 [04/19/2021-12:48:01] [V] [TRT] Tactic: 6291455 time 0.236015 [04/19/2021-12:48:01] [V] [TRT] Tactic: 6422527 time 0.307031 [04/19/2021-12:48:01] [V] [TRT] Tactic: 6750207 time 0.256628 [04/19/2021-12:48:01] [V] [TRT] Tactic: 6815743 time 0.232643 [04/19/2021-12:48:01] [V] [TRT] Tactic: 6946815 time 0.384993 [04/19/2021-12:48:01] [V] [TRT] Tactic: 7077887 time 0.201374 [04/19/2021-12:48:01] [V] [TRT] Tactic: 7143423 time 0.384746 [04/19/2021-12:48:01] [V] [TRT] Tactic: 7208959 time 0.202995 [04/19/2021-12:48:01] [V] [TRT] Tactic: 7340031 time 0.186231 [04/19/2021-12:48:01] [V] [TRT] Tactic: 7405567 time 0.226348 [04/19/2021-12:48:01] [V] [TRT] Tactic: 7536639 time 0.249544 [04/19/2021-12:48:01] [V] [TRT] Tactic: 7602175 time 0.324128 [04/19/2021-12:48:01] [V] [TRT] Tactic: 7733247 time 0.1964 [04/19/2021-12:48:02] [V] [TRT] Tactic: 7798783 time 0.28433 [04/19/2021-12:48:02] [V] [TRT] Tactic: 8191999 time 0.382793 [04/19/2021-12:48:02] [V] [TRT] Tactic: 8257535 time 0.253073 [04/19/2021-12:48:02] [V] [TRT] Tactic: 8323071 time 0.260703 [04/19/2021-12:48:02] [V] [TRT] Tactic: 8650751 time 0.310475 [04/19/2021-12:48:02] [V] [TRT] Tactic: 8716287 time 0.253353 [04/19/2021-12:48:02] [V] [TRT] Tactic: 9568255 time 0.248698 [04/19/2021-12:48:02] [V] [TRT] Tactic: 9895935 time 0.244733 [04/19/2021-12:48:02] [V] [TRT] Tactic: 10223615 time 0.193926 [04/19/2021-12:48:02] [V] [TRT] Tactic: 10354687 time 0.284348 [04/19/2021-12:48:02] [V] [TRT] Tactic: 10551295 time 0.229902 [04/19/2021-12:48:02] [V] [TRT] Tactic: 10747903 time 0.189701 [04/19/2021-12:48:02] [V] [TRT] Tactic: 10944511 time 0.265365 [04/19/2021-12:48:02] [V] [TRT] Fastest Tactic: 5898239 Time: 0.184219 [04/19/2021-12:48:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D (CaskConvolution) [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:02] [V] [TRT] Tactic: 1062367460111450758 time 0.151745 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:02] [V] [TRT] Tactic: 4501471010995462441 time 0.211315 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:02] [V] [TRT] Tactic: 5137655947464784826 time 0.114603 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:02] [V] [TRT] Tactic: 5326823351883942011 time 0.207168 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:02] [V] [TRT] Tactic: 6645123197870846056 time 0.118164 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:48:02] [V] [TRT] Tactic: -6576203419454146580 time 0.137383 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:02] [V] [TRT] Tactic: -3456450830548107839 time 0.140345 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:02] [V] [TRT] Tactic: -410470605513481746 time 0.206738 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:48:02] [V] [TRT] Tactic: -37215280111360163 time 0.114238 [04/19/2021-12:48:02] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.114238 [04/19/2021-12:48:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D (CudaConvolution) [04/19/2021-12:48:02] [V] [TRT] Tactic: 0 time 0.220736 [04/19/2021-12:48:02] [V] [TRT] Tactic: 2 time 0.310632 [04/19/2021-12:48:02] [V] [TRT] Tactic: 5 time 0.666907 [04/19/2021-12:48:02] [V] [TRT] Tactic: 57 time 0.183926 [04/19/2021-12:48:02] [V] [TRT] Fastest Tactic: 57 Time: 0.183926 [04/19/2021-12:48:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D (CudaDepthwiseConvolution) [04/19/2021-12:48:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/19/2021-12:48:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:48:02] [V] [TRT] [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:48:02] [V] [TRT] *************** Autotuning format combination: Float(1,28,784,31360) -> Float(1,28,784,188160) *************** [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:48:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D (FusedConvActConvolution) [04/19/2021-12:48:02] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/19/2021-12:48:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D (CaskConvolution) [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:02] [V] [TRT] Tactic: 1062367460111450758 time 0.227057 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:02] [V] [TRT] Tactic: 4501471010995462441 time 0.1761 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:02] [V] [TRT] Tactic: 5137655947464784826 time 0.178893 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:02] [V] [TRT] Tactic: 5326823351883942011 time 0.171061 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:02] [V] [TRT] Tactic: 6645123197870846056 time 0.17763 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:48:02] [V] [TRT] Tactic: -6576203419454146580 time 0.207318 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:02] [V] [TRT] Tactic: -3456450830548107839 time 0.213477 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:02] [V] [TRT] Tactic: -410470605513481746 time 0.178529 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:48:02] [V] [TRT] Tactic: -37215280111360163 time 0.174238 [04/19/2021-12:48:02] [V] [TRT] Fastest Tactic: 5326823351883942011 Time: 0.171061 [04/19/2021-12:48:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D (CudaConvolution) [04/19/2021-12:48:02] [V] [TRT] Tactic: 0 time 0.392637 [04/19/2021-12:48:02] [V] [TRT] Tactic: 2 time 0.406126 [04/19/2021-12:48:02] [V] [TRT] Tactic: 5 time 1.11505 [04/19/2021-12:48:02] [V] [TRT] Tactic: 57 time 0.302754 [04/19/2021-12:48:02] [V] [TRT] Fastest Tactic: 57 Time: 0.302754 [04/19/2021-12:48:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D (CudaDepthwiseConvolution) [04/19/2021-12:48:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/19/2021-12:48:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5326823351883942011 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:02] [V] [TRT] [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:48:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:02] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:48:02] [V] [TRT] Tactic: 1002 time 0.423874 [04/19/2021-12:48:02] [V] [TRT] Tactic: 0 time 0.437227 [04/19/2021-12:48:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.423874 [04/19/2021-12:48:02] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:48:02] [V] [TRT] Tactic: 1002 time 0.423021 [04/19/2021-12:48:02] [V] [TRT] Tactic: 0 time 0.436433 [04/19/2021-12:48:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.423021 [04/19/2021-12:48:02] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:48:02] [V] [TRT] Tactic: 1002 time 0.651322 [04/19/2021-12:48:02] [V] [TRT] Tactic: 0 time 0.344063 [04/19/2021-12:48:02] [V] [TRT] Fastest Tactic: 0 Time: 0.344063 [04/19/2021-12:48:02] [V] [TRT] *************** Autotuning format combination: Float(1,28,784,188160) -> Float(1,28,784,188160) *************** [04/19/2021-12:48:02] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block3b_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3b_expand_activation/mul) (PointWise) [04/19/2021-12:48:02] [V] [TRT] Tactic: 128 time 0.410306 [04/19/2021-12:48:02] [V] [TRT] Tactic: 256 time 0.411784 [04/19/2021-12:48:02] [V] [TRT] Tactic: 512 time 0.415605 [04/19/2021-12:48:02] [V] [TRT] Tactic: -32 time 0.440495 [04/19/2021-12:48:03] [V] [TRT] Tactic: -64 time 0.438848 [04/19/2021-12:48:03] [V] [TRT] Tactic: -128 time 0.427637 [04/19/2021-12:48:03] [V] [TRT] Fastest Tactic: 128 Time: 0.410306 [04/19/2021-12:48:03] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block3b_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3b_expand_activation/mul) (PointWiseV2) [04/19/2021-12:48:03] [V] [TRT] Tactic: 0 time 0.194785 [04/19/2021-12:48:03] [V] [TRT] Tactic: 1 time 0.143685 [04/19/2021-12:48:03] [V] [TRT] Tactic: 2 time 0.131146 [04/19/2021-12:48:03] [V] [TRT] Tactic: 3 time 0.120814 [04/19/2021-12:48:03] [V] [TRT] Tactic: 4 time 0.0960938 [04/19/2021-12:48:03] [V] [TRT] Tactic: 5 time 0.0999086 [04/19/2021-12:48:03] [V] [TRT] Tactic: 6 time 0.117376 [04/19/2021-12:48:03] [V] [TRT] Tactic: 7 time 0.0927539 [04/19/2021-12:48:03] [V] [TRT] Tactic: 8 time 0.0821486 [04/19/2021-12:48:03] [V] [TRT] Tactic: 9 time 0.0847657 [04/19/2021-12:48:03] [V] [TRT] Tactic: 28 time 0.18804 [04/19/2021-12:48:03] [V] [TRT] Fastest Tactic: 8 Time: 0.0821486 [04/19/2021-12:48:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [04/19/2021-12:48:03] [V] [TRT] [04/19/2021-12:48:03] [V] [TRT] *************** Autotuning format combination: Float(1,28,784:32,6272) -> Float(1,28,784:32,6272) *************** [04/19/2021-12:48:03] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block3b_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3b_expand_activation/mul) (PointWise) [04/19/2021-12:48:03] [V] [TRT] Tactic: 128 time 0.612571 [04/19/2021-12:48:03] [V] [TRT] Tactic: 256 time 0.613659 [04/19/2021-12:48:03] [V] [TRT] Tactic: 512 time 0.617904 [04/19/2021-12:48:03] [V] [TRT] Tactic: -32 time 0.467031 [04/19/2021-12:48:03] [V] [TRT] Tactic: -64 time 0.459596 [04/19/2021-12:48:03] [V] [TRT] Tactic: -128 time 0.474076 [04/19/2021-12:48:03] [V] [TRT] Fastest Tactic: -64 Time: 0.459596 [04/19/2021-12:48:03] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block3b_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3b_expand_activation/mul) (PointWiseV2) [04/19/2021-12:48:03] [V] [TRT] Tactic: 24 time 0.157982 [04/19/2021-12:48:03] [V] [TRT] Tactic: 25 time 0.136712 [04/19/2021-12:48:03] [V] [TRT] Tactic: 26 time 0.136582 [04/19/2021-12:48:03] [V] [TRT] Tactic: 27 time 0.13791 [04/19/2021-12:48:03] [V] [TRT] Tactic: 31 time 0.154206 [04/19/2021-12:48:03] [V] [TRT] Fastest Tactic: 26 Time: 0.136582 [04/19/2021-12:48:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [04/19/2021-12:48:03] [V] [TRT] [04/19/2021-12:48:03] [V] [TRT] *************** Autotuning format combination: Float(1,28,784,188160) -> Float(1,28,784,188160) *************** [04/19/2021-12:48:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [04/19/2021-12:48:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [04/19/2021-12:48:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [04/19/2021-12:48:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:03] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block3b_dwconv/depthwise (FusedConvActConvolution) [04/19/2021-12:48:03] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/19/2021-12:48:03] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block3b_dwconv/depthwise (CaskConvolution) [04/19/2021-12:48:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:03] [V] [TRT] Tactic: 1062367460111450758 time 12.1056 [04/19/2021-12:48:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [04/19/2021-12:48:04] [V] [TRT] Tactic: 4337000649858996379 time 13.4573 [04/19/2021-12:48:04] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:04] [V] [TRT] Tactic: 4501471010995462441 time 19.1976 [04/19/2021-12:48:04] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:04] [V] [TRT] Tactic: 5137655947464784826 time 10.3358 [04/19/2021-12:48:04] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:04] [V] [TRT] Tactic: 6645123197870846056 time 10.8672 [04/19/2021-12:48:04] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [04/19/2021-12:48:05] [V] [TRT] Tactic: -9137461792520977713 time 19.2255 [04/19/2021-12:48:05] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [04/19/2021-12:48:05] [V] [TRT] Tactic: -6092040395344634144 time 9.45686 [04/19/2021-12:48:05] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:05] [V] [TRT] Tactic: -3456450830548107839 time 8.20559 [04/19/2021-12:48:05] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:06] [V] [TRT] Tactic: -410470605513481746 time 18.3285 [04/19/2021-12:48:06] [V] [TRT] Fastest Tactic: -3456450830548107839 Time: 8.20559 [04/19/2021-12:48:06] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block3b_dwconv/depthwise (CudaConvolution) [04/19/2021-12:48:06] [V] [TRT] Tactic: 0 time 5.91193 [04/19/2021-12:48:06] [V] [TRT] Tactic: 2 time 1.30656 [04/19/2021-12:48:07] [V] [TRT] Tactic: 5 time 75.0222 [04/19/2021-12:48:07] [V] [TRT] Tactic: 57 time 8.24214 [04/19/2021-12:48:07] [V] [TRT] Fastest Tactic: 2 Time: 1.30656 [04/19/2021-12:48:07] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block3b_dwconv/depthwise (CudaDepthwiseConvolution) [04/19/2021-12:48:07] [V] [TRT] Tactic: -1 time 1.19386 [04/19/2021-12:48:07] [V] [TRT] Fastest Tactic: -1 Time: 1.19386 [04/19/2021-12:48:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [04/19/2021-12:48:07] [V] [TRT] [04/19/2021-12:48:07] [V] [TRT] *************** Autotuning format combination: Float(1,28,784,188160) -> Float(1,28,784,188160) *************** [04/19/2021-12:48:08] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block3b_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3b_activation/mul) (PointWise) [04/19/2021-12:48:08] [V] [TRT] Tactic: 128 time 0.409577 [04/19/2021-12:48:08] [V] [TRT] Tactic: 256 time 0.411016 [04/19/2021-12:48:08] [V] [TRT] Tactic: 512 time 0.415768 [04/19/2021-12:48:08] [V] [TRT] Tactic: -32 time 0.439329 [04/19/2021-12:48:08] [V] [TRT] Tactic: -64 time 0.437962 [04/19/2021-12:48:08] [V] [TRT] Tactic: -128 time 0.427161 [04/19/2021-12:48:08] [V] [TRT] Fastest Tactic: 128 Time: 0.409577 [04/19/2021-12:48:08] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block3b_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3b_activation/mul) (PointWiseV2) [04/19/2021-12:48:08] [V] [TRT] Tactic: 0 time 0.193743 [04/19/2021-12:48:08] [V] [TRT] Tactic: 1 time 0.143086 [04/19/2021-12:48:08] [V] [TRT] Tactic: 2 time 0.131445 [04/19/2021-12:48:08] [V] [TRT] Tactic: 3 time 0.121028 [04/19/2021-12:48:08] [V] [TRT] Tactic: 4 time 0.095905 [04/19/2021-12:48:08] [V] [TRT] Tactic: 5 time 0.10041 [04/19/2021-12:48:08] [V] [TRT] Tactic: 6 time 0.11446 [04/19/2021-12:48:08] [V] [TRT] Tactic: 7 time 0.0914191 [04/19/2021-12:48:08] [V] [TRT] Tactic: 8 time 0.0821745 [04/19/2021-12:48:08] [V] [TRT] Tactic: 9 time 0.0848958 [04/19/2021-12:48:08] [V] [TRT] Tactic: 28 time 0.188346 [04/19/2021-12:48:08] [V] [TRT] Fastest Tactic: 8 Time: 0.0821745 [04/19/2021-12:48:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [04/19/2021-12:48:08] [V] [TRT] [04/19/2021-12:48:08] [V] [TRT] *************** Autotuning format combination: Float(1,28,784:32,6272) -> Float(1,28,784:32,6272) *************** [04/19/2021-12:48:08] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block3b_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3b_activation/mul) (PointWise) [04/19/2021-12:48:08] [V] [TRT] Tactic: 128 time 0.612754 [04/19/2021-12:48:08] [V] [TRT] Tactic: 256 time 0.614258 [04/19/2021-12:48:08] [V] [TRT] Tactic: 512 time 0.61821 [04/19/2021-12:48:08] [V] [TRT] Tactic: -32 time 0.466933 [04/19/2021-12:48:08] [V] [TRT] Tactic: -64 time 0.458952 [04/19/2021-12:48:08] [V] [TRT] Tactic: -128 time 0.47416 [04/19/2021-12:48:08] [V] [TRT] Fastest Tactic: -64 Time: 0.458952 [04/19/2021-12:48:08] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block3b_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3b_activation/mul) (PointWiseV2) [04/19/2021-12:48:08] [V] [TRT] Tactic: 24 time 0.15571 [04/19/2021-12:48:08] [V] [TRT] Tactic: 25 time 0.137135 [04/19/2021-12:48:08] [V] [TRT] Tactic: 26 time 0.135749 [04/19/2021-12:48:08] [V] [TRT] Tactic: 27 time 0.137064 [04/19/2021-12:48:08] [V] [TRT] Tactic: 31 time 0.155293 [04/19/2021-12:48:08] [V] [TRT] Fastest Tactic: 26 Time: 0.135749 [04/19/2021-12:48:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [04/19/2021-12:48:08] [V] [TRT] [04/19/2021-12:48:08] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:48:08] [V] [TRT] Tactic: 1002 time 0.651829 [04/19/2021-12:48:08] [V] [TRT] Tactic: 0 time 0.345195 [04/19/2021-12:48:08] [V] [TRT] Fastest Tactic: 0 Time: 0.345195 [04/19/2021-12:48:08] [V] [TRT] *************** Autotuning format combination: Float(1,28,784,188160) -> Float(1,240) *************** [04/19/2021-12:48:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block3b_se_squeeze/Mean (Reduce) [04/19/2021-12:48:08] [V] [TRT] Tactic: 1 time 0.23235 [04/19/2021-12:48:08] [V] [TRT] Tactic: 3 time 0.256354 [04/19/2021-12:48:08] [V] [TRT] Tactic: 6 time 1.9935 [04/19/2021-12:48:08] [V] [TRT] Fastest Tactic: 1 Time: 0.23235 [04/19/2021-12:48:08] [V] [TRT] *************** Autotuning format combination: Float(1,240) -> Float(1,1,1,240) *************** [04/19/2021-12:48:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block3b_se_reshape/Reshape + StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd__115 (Shuffle) [04/19/2021-12:48:08] [V] [TRT] Tactic: 0 time 0.00329425 [04/19/2021-12:48:08] [V] [TRT] Tactic: 1 time 0.0113342 [04/19/2021-12:48:08] [V] [TRT] Fastest Tactic: 0 Time: 0.00329425 [04/19/2021-12:48:08] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,240) -> Float(1,1,1,10) *************** [04/19/2021-12:48:08] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:08] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:08] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:08] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:08] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:08] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:48:08] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:08] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:08] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:48:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd (FusedConvActConvolution) [04/19/2021-12:48:08] [V] [TRT] Tactic: 589823 time 0.0768358 [04/19/2021-12:48:08] [V] [TRT] Tactic: 786431 time 0.026582 [04/19/2021-12:48:08] [V] [TRT] Tactic: 1179647 time 0.0127019 [04/19/2021-12:48:08] [V] [TRT] Tactic: 1310719 time 0.100781 [04/19/2021-12:48:08] [V] [TRT] Tactic: 1376255 time 0.0567511 [04/19/2021-12:48:08] [V] [TRT] Tactic: 1441791 time 0.0166864 [04/19/2021-12:48:08] [V] [TRT] Tactic: 1638399 time 0.0180208 [04/19/2021-12:48:08] [V] [TRT] Tactic: 1835007 time 0.024603 [04/19/2021-12:48:09] [V] [TRT] Tactic: 2162687 time 0.0590366 [04/19/2021-12:48:09] [V] [TRT] Tactic: 2293759 time 0.0539712 [04/19/2021-12:48:09] [V] [TRT] Tactic: 2359295 time 0.0382683 [04/19/2021-12:48:09] [V] [TRT] Tactic: 2686975 time 0.054297 [04/19/2021-12:48:09] [V] [TRT] Tactic: 3407871 time 0.0313997 [04/19/2021-12:48:09] [V] [TRT] Tactic: 3538943 time 0.0191341 [04/19/2021-12:48:09] [V] [TRT] Tactic: 3997695 time 0.0166408 [04/19/2021-12:48:09] [V] [TRT] Tactic: 4194303 time 0.0266666 [04/19/2021-12:48:09] [V] [TRT] Tactic: 4325375 time 0.0218946 [04/19/2021-12:48:09] [V] [TRT] Tactic: 4521983 time 0.0567124 [04/19/2021-12:48:09] [V] [TRT] Tactic: 4587519 time 0.0150066 [04/19/2021-12:48:09] [V] [TRT] Tactic: 4653055 time 0.0150196 [04/19/2021-12:48:09] [V] [TRT] Tactic: 4915199 time 0.0156445 [04/19/2021-12:48:09] [V] [TRT] Tactic: 4980735 time 0.035638 [04/19/2021-12:48:09] [V] [TRT] Tactic: 5177343 time 0.0126954 [04/19/2021-12:48:09] [V] [TRT] Tactic: 5242879 time 0.0288935 [04/19/2021-12:48:09] [V] [TRT] Tactic: 5373951 time 0.0127019 [04/19/2021-12:48:09] [V] [TRT] Tactic: 5439487 time 0.0243099 [04/19/2021-12:48:09] [V] [TRT] Tactic: 5701631 time 0.049844 [04/19/2021-12:48:09] [V] [TRT] Tactic: 5767167 time 0.0258591 [04/19/2021-12:48:09] [V] [TRT] Tactic: 5832703 time 0.0289387 [04/19/2021-12:48:09] [V] [TRT] Tactic: 5898239 time 0.01737 [04/19/2021-12:48:09] [V] [TRT] Tactic: 6029311 time 0.0485029 [04/19/2021-12:48:09] [V] [TRT] Tactic: 6225919 time 0.0172981 [04/19/2021-12:48:09] [V] [TRT] Tactic: 6291455 time 0.012741 [04/19/2021-12:48:09] [V] [TRT] Tactic: 6750207 time 0.0150588 [04/19/2021-12:48:09] [V] [TRT] Tactic: 6815743 time 0.0288868 [04/19/2021-12:48:09] [V] [TRT] Tactic: 6946815 time 0.0327149 [04/19/2021-12:48:09] [V] [TRT] Tactic: 7077887 time 0.0172982 [04/19/2021-12:48:09] [V] [TRT] Tactic: 7143423 time 0.0264649 [04/19/2021-12:48:09] [V] [TRT] Tactic: 7208959 time 0.0288801 [04/19/2021-12:48:09] [V] [TRT] Tactic: 7340031 time 0.0172916 [04/19/2021-12:48:09] [V] [TRT] Tactic: 7405567 time 0.0173175 [04/19/2021-12:48:09] [V] [TRT] Tactic: 7536639 time 0.0403189 [04/19/2021-12:48:09] [V] [TRT] Tactic: 7602175 time 0.0324092 [04/19/2021-12:48:09] [V] [TRT] Tactic: 7733247 time 0.0219208 [04/19/2021-12:48:09] [V] [TRT] Tactic: 7798783 time 0.026634 [04/19/2021-12:48:09] [V] [TRT] Tactic: 8191999 time 0.0201435 [04/19/2021-12:48:09] [V] [TRT] Tactic: 8257535 time 0.0150909 [04/19/2021-12:48:09] [V] [TRT] Tactic: 8323071 time 0.0242969 [04/19/2021-12:48:09] [V] [TRT] Tactic: 8650751 time 0.0328061 [04/19/2021-12:48:09] [V] [TRT] Tactic: 8716287 time 0.0174675 [04/19/2021-12:48:09] [V] [TRT] Tactic: 9568255 time 0.0155209 [04/19/2021-12:48:09] [V] [TRT] Tactic: 9895935 time 0.0267773 [04/19/2021-12:48:09] [V] [TRT] Tactic: 10223615 time 0.054616 [04/19/2021-12:48:09] [V] [TRT] Tactic: 10354687 time 0.0149156 [04/19/2021-12:48:09] [V] [TRT] Tactic: 10551295 time 0.0333267 [04/19/2021-12:48:09] [V] [TRT] Tactic: 10747903 time 0.0219399 [04/19/2021-12:48:09] [V] [TRT] Tactic: 10944511 time 0.0352409 [04/19/2021-12:48:09] [V] [TRT] Fastest Tactic: 5177343 Time: 0.0126954 [04/19/2021-12:48:09] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd (CaskConvolution) [04/19/2021-12:48:09] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:09] [V] [TRT] Tactic: 1062367460111450758 time 0.0514126 [04/19/2021-12:48:09] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:09] [V] [TRT] Tactic: 4501471010995462441 time 0.0568034 [04/19/2021-12:48:09] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:09] [V] [TRT] Tactic: 5137655947464784826 time 0.0400394 [04/19/2021-12:48:09] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:09] [V] [TRT] Tactic: 5326823351883942011 time 0.0548564 [04/19/2021-12:48:09] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:09] [V] [TRT] Tactic: 6645123197870846056 time 0.0427277 [04/19/2021-12:48:09] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:48:09] [V] [TRT] Tactic: -6576203419454146580 time 0.0408723 [04/19/2021-12:48:09] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:09] [V] [TRT] Tactic: -3456450830548107839 time 0.0428061 [04/19/2021-12:48:09] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:09] [V] [TRT] Tactic: -410470605513481746 time 0.0550064 [04/19/2021-12:48:09] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:48:09] [V] [TRT] Tactic: -37215280111360163 time 0.0385287 [04/19/2021-12:48:09] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.0385287 [04/19/2021-12:48:09] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd (CudaConvolution) [04/19/2021-12:48:09] [V] [TRT] Tactic: 0 time 0.0427406 [04/19/2021-12:48:09] [V] [TRT] Tactic: 2 time 0.141497 [04/19/2021-12:48:09] [V] [TRT] Tactic: 5 time 0.239166 [04/19/2021-12:48:09] [V] [TRT] Tactic: 57 time 0.040247 [04/19/2021-12:48:09] [V] [TRT] Fastest Tactic: 57 Time: 0.040247 [04/19/2021-12:48:09] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd (CudaDepthwiseConvolution) [04/19/2021-12:48:09] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/19/2021-12:48:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 5177343 [04/19/2021-12:48:09] [V] [TRT] [04/19/2021-12:48:09] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:48:09] [V] [TRT] Tactic: 1002 time 0.00802725 [04/19/2021-12:48:09] [V] [TRT] Tactic: 0 time 0.00565725 [04/19/2021-12:48:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00565725 [04/19/2021-12:48:09] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:48:09] [V] [TRT] Tactic: 1002 time 0.00811213 [04/19/2021-12:48:09] [V] [TRT] Tactic: 0 time 0.00508437 [04/19/2021-12:48:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00508437 [04/19/2021-12:48:09] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:48:09] [V] [TRT] Tactic: 1002 time 0.00798163 [04/19/2021-12:48:09] [V] [TRT] Tactic: 0 time 0.00539713 [04/19/2021-12:48:09] [V] [TRT] Fastest Tactic: 0 Time: 0.00539713 [04/19/2021-12:48:09] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,10) -> Float(1,1,1,10) *************** [04/19/2021-12:48:09] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/mul) (PointWise) [04/19/2021-12:48:09] [V] [TRT] Tactic: 128 time 0.00573563 [04/19/2021-12:48:09] [V] [TRT] Tactic: 256 time 0.00569013 [04/19/2021-12:48:09] [V] [TRT] Tactic: 512 time 0.00575538 [04/19/2021-12:48:09] [V] [TRT] Fastest Tactic: 256 Time: 0.00569013 [04/19/2021-12:48:09] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/mul) (PointWiseV2) [04/19/2021-12:48:10] [V] [TRT] Tactic: 0 time 0.00449225 [04/19/2021-12:48:10] [V] [TRT] Tactic: 1 time 0.00461587 [04/19/2021-12:48:10] [V] [TRT] Tactic: 2 time 0.00433625 [04/19/2021-12:48:10] [V] [TRT] Tactic: 3 time 0.00516925 [04/19/2021-12:48:10] [V] [TRT] Tactic: 4 time 0.00481137 [04/19/2021-12:48:10] [V] [TRT] Tactic: 5 time 0.00423175 [04/19/2021-12:48:10] [V] [TRT] Tactic: 6 time 0.00560537 [04/19/2021-12:48:10] [V] [TRT] Tactic: 7 time 0.0056315 [04/19/2021-12:48:10] [V] [TRT] Tactic: 8 time 0.00514312 [04/19/2021-12:48:10] [V] [TRT] Tactic: 9 time 0.004818 [04/19/2021-12:48:10] [V] [TRT] Tactic: 28 time 0.0039585 [04/19/2021-12:48:10] [V] [TRT] Fastest Tactic: 28 Time: 0.0039585 [04/19/2021-12:48:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [04/19/2021-12:48:10] [V] [TRT] [04/19/2021-12:48:10] [V] [TRT] *************** Autotuning format combination: Float(1,1,1:32,1) -> Float(1,1,1:32,1) *************** [04/19/2021-12:48:10] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/mul) (PointWise) [04/19/2021-12:48:10] [V] [TRT] Tactic: 128 time 0.00567062 [04/19/2021-12:48:10] [V] [TRT] Tactic: 256 time 0.00572263 [04/19/2021-12:48:10] [V] [TRT] Tactic: 512 time 0.00572263 [04/19/2021-12:48:10] [V] [TRT] Tactic: -32 time 0.00576812 [04/19/2021-12:48:10] [V] [TRT] Tactic: -64 time 0.00580075 [04/19/2021-12:48:10] [V] [TRT] Tactic: -128 time 0.00577488 [04/19/2021-12:48:10] [V] [TRT] Fastest Tactic: 128 Time: 0.00567062 [04/19/2021-12:48:10] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/mul) (PointWiseV2) [04/19/2021-12:48:10] [V] [TRT] Tactic: 24 time 0.005612 [04/19/2021-12:48:10] [V] [TRT] Tactic: 25 time 0.00566413 [04/19/2021-12:48:10] [V] [TRT] Tactic: 26 time 0.00566388 [04/19/2021-12:48:10] [V] [TRT] Tactic: 27 time 0.0081705 [04/19/2021-12:48:10] [V] [TRT] Tactic: 31 time 0.00564437 [04/19/2021-12:48:10] [V] [TRT] Fastest Tactic: 24 Time: 0.005612 [04/19/2021-12:48:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [04/19/2021-12:48:10] [V] [TRT] [04/19/2021-12:48:10] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,10) -> Float(1,1,1,240) *************** [04/19/2021-12:48:10] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:10] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:10] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:10] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:10] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:10] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:48:10] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:10] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:10] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:48:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd (FusedConvActConvolution) [04/19/2021-12:48:10] [V] [TRT] Tactic: 589823 time 0.0126108 [04/19/2021-12:48:10] [V] [TRT] Tactic: 655359 time 0.0127345 [04/19/2021-12:48:10] [V] [TRT] Tactic: 1376255 time 0.0104101 [04/19/2021-12:48:10] [V] [TRT] Tactic: 1900543 time 0.0149544 [04/19/2021-12:48:10] [V] [TRT] Tactic: 2162687 time 0.0126953 [04/19/2021-12:48:10] [V] [TRT] Tactic: 2293759 time 0.0103128 [04/19/2021-12:48:10] [V] [TRT] Tactic: 2686975 time 0.0103648 [04/19/2021-12:48:10] [V] [TRT] Tactic: 3670015 time 0.0150716 [04/19/2021-12:48:10] [V] [TRT] Tactic: 3932159 time 0.00802725 [04/19/2021-12:48:10] [V] [TRT] Tactic: 4521983 time 0.0119143 [04/19/2021-12:48:10] [V] [TRT] Tactic: 5701631 time 0.00819663 [04/19/2021-12:48:10] [V] [TRT] Tactic: 6029311 time 0.010013 [04/19/2021-12:48:10] [V] [TRT] Tactic: 7536639 time 0.00787775 [04/19/2021-12:48:10] [V] [TRT] Tactic: 10223615 time 0.0103905 [04/19/2021-12:48:10] [V] [TRT] Fastest Tactic: 7536639 Time: 0.00787775 [04/19/2021-12:48:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd (CaskConvolution) [04/19/2021-12:48:10] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:10] [V] [TRT] Tactic: 1062367460111450758 time 0.0292187 [04/19/2021-12:48:10] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:10] [V] [TRT] Tactic: 4501471010995462441 time 0.0218097 [04/19/2021-12:48:10] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:10] [V] [TRT] Tactic: 5137655947464784826 time 0.0220898 [04/19/2021-12:48:10] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:10] [V] [TRT] Tactic: 5326823351883942011 time 0.020599 [04/19/2021-12:48:10] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:10] [V] [TRT] Tactic: 6645123197870846056 time 0.0222655 [04/19/2021-12:48:10] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:48:10] [V] [TRT] Tactic: -6576203419454146580 time 0.0277477 [04/19/2021-12:48:10] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:10] [V] [TRT] Tactic: -3456450830548107839 time 0.0288217 [04/19/2021-12:48:10] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:10] [V] [TRT] Tactic: -410470605513481746 time 0.0218553 [04/19/2021-12:48:10] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:48:10] [V] [TRT] Tactic: -37215280111360163 time 0.0219597 [04/19/2021-12:48:10] [V] [TRT] Fastest Tactic: 5326823351883942011 Time: 0.020599 [04/19/2021-12:48:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd (CudaConvolution) [04/19/2021-12:48:10] [V] [TRT] Tactic: 0 time 0.0135419 [04/19/2021-12:48:10] [V] [TRT] Tactic: 2 time 0.0214648 [04/19/2021-12:48:10] [V] [TRT] Tactic: 5 time 0.227207 [04/19/2021-12:48:10] [V] [TRT] Tactic: 57 time 0.0161002 [04/19/2021-12:48:10] [V] [TRT] Fastest Tactic: 0 Time: 0.0135419 [04/19/2021-12:48:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd (CudaDepthwiseConvolution) [04/19/2021-12:48:10] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/19/2021-12:48:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 7536639 [04/19/2021-12:48:10] [V] [TRT] [04/19/2021-12:48:10] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:48:10] [V] [TRT] Tactic: 1002 time 0.0104426 [04/19/2021-12:48:10] [V] [TRT] Tactic: 0 time 0.00521512 [04/19/2021-12:48:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00521512 [04/19/2021-12:48:10] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:48:10] [V] [TRT] Tactic: 1002 time 0.0102345 [04/19/2021-12:48:10] [V] [TRT] Tactic: 0 time 0.00560538 [04/19/2021-12:48:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00560538 [04/19/2021-12:48:10] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:48:10] [V] [TRT] Tactic: 1002 time 0.010332 [04/19/2021-12:48:10] [V] [TRT] Tactic: 0 time 0.00561188 [04/19/2021-12:48:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00561188 [04/19/2021-12:48:11] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,240), Float(1,28,784,188160) -> Float(1,28,784,188160) *************** [04/19/2021-12:48:11] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3b_se_excite/mul) (PointWise) [04/19/2021-12:48:11] [V] [TRT] Tactic: 128 time 0.510677 [04/19/2021-12:48:11] [V] [TRT] Tactic: 256 time 0.512025 [04/19/2021-12:48:11] [V] [TRT] Tactic: 512 time 0.514114 [04/19/2021-12:48:11] [V] [TRT] Tactic: -32 time 0.455469 [04/19/2021-12:48:11] [V] [TRT] Tactic: -64 time 0.460313 [04/19/2021-12:48:11] [V] [TRT] Tactic: -128 time 0.455677 [04/19/2021-12:48:11] [V] [TRT] Fastest Tactic: -32 Time: 0.455469 [04/19/2021-12:48:11] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3b_se_excite/mul) (PointWiseV2) [04/19/2021-12:48:11] [V] [TRT] Tactic: 0 time 0.375918 [04/19/2021-12:48:11] [V] [TRT] Tactic: 1 time 0.450905 [04/19/2021-12:48:11] [V] [TRT] Tactic: 2 time 0.411679 [04/19/2021-12:48:11] [V] [TRT] Tactic: 3 time 0.531302 [04/19/2021-12:48:11] [V] [TRT] Tactic: 4 time 0.546055 [04/19/2021-12:48:11] [V] [TRT] Tactic: 5 time 0.467552 [04/19/2021-12:48:11] [V] [TRT] Tactic: 6 time 0.719063 [04/19/2021-12:48:11] [V] [TRT] Tactic: 7 time 0.670072 [04/19/2021-12:48:11] [V] [TRT] Tactic: 8 time 0.680775 [04/19/2021-12:48:11] [V] [TRT] Tactic: 9 time 0.593444 [04/19/2021-12:48:11] [V] [TRT] Tactic: 28 time 0.32321 [04/19/2021-12:48:11] [V] [TRT] Fastest Tactic: 28 Time: 0.32321 [04/19/2021-12:48:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [04/19/2021-12:48:11] [V] [TRT] [04/19/2021-12:48:11] [V] [TRT] *************** Autotuning format combination: Float(1,1,1:32,8), Float(1,28,784:32,6272) -> Float(1,28,784:32,6272) *************** [04/19/2021-12:48:11] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3b_se_excite/mul) (PointWise) [04/19/2021-12:48:11] [V] [TRT] Tactic: 128 time 0.697031 [04/19/2021-12:48:11] [V] [TRT] Tactic: 256 time 0.698255 [04/19/2021-12:48:11] [V] [TRT] Tactic: 512 time 0.701934 [04/19/2021-12:48:11] [V] [TRT] Tactic: -32 time 0.779681 [04/19/2021-12:48:11] [V] [TRT] Tactic: -64 time 0.782689 [04/19/2021-12:48:11] [V] [TRT] Tactic: -128 time 0.782604 [04/19/2021-12:48:11] [V] [TRT] Fastest Tactic: 128 Time: 0.697031 [04/19/2021-12:48:11] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3b_se_excite/mul) (PointWiseV2) [04/19/2021-12:48:11] [V] [TRT] Tactic: 24 time 0.191771 [04/19/2021-12:48:11] [V] [TRT] Tactic: 25 time 0.190104 [04/19/2021-12:48:11] [V] [TRT] Tactic: 26 time 0.187663 [04/19/2021-12:48:11] [V] [TRT] Tactic: 27 time 0.172187 [04/19/2021-12:48:11] [V] [TRT] Tactic: 31 time 0.190528 [04/19/2021-12:48:11] [V] [TRT] Fastest Tactic: 27 Time: 0.172187 [04/19/2021-12:48:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [04/19/2021-12:48:11] [V] [TRT] [04/19/2021-12:48:11] [V] [TRT] *************** Autotuning format combination: Float(1,28,784,188160), Float(1,28,784,31360) -> Float(1,28,784,31360) *************** [04/19/2021-12:48:11] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block3b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:11] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block3b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:11] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block3b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:11] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block3b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:11] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block3b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:11] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block3b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:48:11] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block3b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:11] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block3b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:11] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block3b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:48:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block3b_add/add (CaskConvolution) [04/19/2021-12:48:11] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block3b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:11] [V] [TRT] Tactic: 1062367460111450758 time 0.237682 [04/19/2021-12:48:11] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block3b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:11] [V] [TRT] Tactic: 4501471010995462441 time 0.32806 [04/19/2021-12:48:11] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block3b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:11] [V] [TRT] Tactic: 5137655947464784826 time 0.175586 [04/19/2021-12:48:11] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block3b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:11] [V] [TRT] Tactic: 5326823351883942011 time 0.317187 [04/19/2021-12:48:11] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block3b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:11] [V] [TRT] Tactic: 6645123197870846056 time 0.181061 [04/19/2021-12:48:11] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block3b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:48:11] [V] [TRT] Tactic: -6576203419454146580 time 0.209349 [04/19/2021-12:48:11] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block3b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:11] [V] [TRT] Tactic: -3456450830548107839 time 0.219479 [04/19/2021-12:48:11] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block3b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:11] [V] [TRT] Tactic: -410470605513481746 time 0.318503 [04/19/2021-12:48:11] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block3b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:48:11] [V] [TRT] Tactic: -37215280111360163 time 0.172845 [04/19/2021-12:48:11] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.172845 [04/19/2021-12:48:11] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block3b_add/add (CudaConvolution) [04/19/2021-12:48:12] [V] [TRT] Tactic: 0 time 0.352559 [04/19/2021-12:48:12] [V] [TRT] Tactic: 2 time 0.491394 [04/19/2021-12:48:12] [V] [TRT] Tactic: 5 time 1.01514 [04/19/2021-12:48:12] [V] [TRT] Tactic: 57 time 0.290703 [04/19/2021-12:48:12] [V] [TRT] Fastest Tactic: 57 Time: 0.290703 [04/19/2021-12:48:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163 [04/19/2021-12:48:12] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block3b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:48:12] [V] [TRT] [04/19/2021-12:48:12] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block3b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:12] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block3b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:12] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block3b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:12] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block3b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:12] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block3b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:12] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block3b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:48:12] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block3b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:12] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block3b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:12] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block3b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:48:12] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block3b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:48:12] [V] [TRT] *************** Autotuning format combination: Float(1,28,784,31360) -> Float(1,28,784,188160) *************** [04/19/2021-12:48:12] [V] [TRT] *************** Autotuning format combination: Float(1,28,784,188160) -> Float(1,28,784,188160) *************** [04/19/2021-12:48:12] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4a_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4a_expand_activation/mul) (PointWise) [04/19/2021-12:48:12] [V] [TRT] Tactic: 128 time 0.410495 [04/19/2021-12:48:12] [V] [TRT] Tactic: 256 time 0.411875 [04/19/2021-12:48:12] [V] [TRT] Tactic: 512 time 0.415527 [04/19/2021-12:48:12] [V] [TRT] Tactic: -32 time 0.439473 [04/19/2021-12:48:12] [V] [TRT] Tactic: -64 time 0.438255 [04/19/2021-12:48:12] [V] [TRT] Tactic: -128 time 0.427533 [04/19/2021-12:48:12] [V] [TRT] Fastest Tactic: 128 Time: 0.410495 [04/19/2021-12:48:12] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4a_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4a_expand_activation/mul) (PointWiseV2) [04/19/2021-12:48:12] [V] [TRT] Tactic: 0 time 0.194375 [04/19/2021-12:48:12] [V] [TRT] Tactic: 1 time 0.143373 [04/19/2021-12:48:12] [V] [TRT] Tactic: 2 time 0.131895 [04/19/2021-12:48:12] [V] [TRT] Tactic: 3 time 0.122233 [04/19/2021-12:48:12] [V] [TRT] Tactic: 4 time 0.0965039 [04/19/2021-12:48:12] [V] [TRT] Tactic: 5 time 0.100579 [04/19/2021-12:48:12] [V] [TRT] Tactic: 6 time 0.115195 [04/19/2021-12:48:12] [V] [TRT] Tactic: 7 time 0.09013 [04/19/2021-12:48:12] [V] [TRT] Tactic: 8 time 0.0818492 [04/19/2021-12:48:12] [V] [TRT] Tactic: 9 time 0.084349 [04/19/2021-12:48:12] [V] [TRT] Tactic: 28 time 0.188151 [04/19/2021-12:48:12] [V] [TRT] Fastest Tactic: 8 Time: 0.0818492 [04/19/2021-12:48:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [04/19/2021-12:48:12] [V] [TRT] [04/19/2021-12:48:12] [V] [TRT] *************** Autotuning format combination: Float(1,28,784:32,6272) -> Float(1,28,784:32,6272) *************** [04/19/2021-12:48:12] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4a_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4a_expand_activation/mul) (PointWise) [04/19/2021-12:48:12] [V] [TRT] Tactic: 128 time 0.612448 [04/19/2021-12:48:12] [V] [TRT] Tactic: 256 time 0.61433 [04/19/2021-12:48:12] [V] [TRT] Tactic: 512 time 0.617858 [04/19/2021-12:48:12] [V] [TRT] Tactic: -32 time 0.466374 [04/19/2021-12:48:12] [V] [TRT] Tactic: -64 time 0.459915 [04/19/2021-12:48:12] [V] [TRT] Tactic: -128 time 0.474857 [04/19/2021-12:48:12] [V] [TRT] Fastest Tactic: -64 Time: 0.459915 [04/19/2021-12:48:12] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4a_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4a_expand_activation/mul) (PointWiseV2) [04/19/2021-12:48:12] [V] [TRT] Tactic: 24 time 0.157246 [04/19/2021-12:48:12] [V] [TRT] Tactic: 25 time 0.135794 [04/19/2021-12:48:12] [V] [TRT] Tactic: 26 time 0.135716 [04/19/2021-12:48:12] [V] [TRT] Tactic: 27 time 0.139297 [04/19/2021-12:48:12] [V] [TRT] Tactic: 31 time 0.155703 [04/19/2021-12:48:12] [V] [TRT] Fastest Tactic: 26 Time: 0.135716 [04/19/2021-12:48:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [04/19/2021-12:48:12] [V] [TRT] [04/19/2021-12:48:12] [V] [TRT] *************** Autotuning format combination: Float(1,28,784,188160) -> Float(1,14,196,47040) *************** [04/19/2021-12:48:12] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:12] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [04/19/2021-12:48:12] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:12] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:12] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:12] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [04/19/2021-12:48:12] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [04/19/2021-12:48:12] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:12] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block4a_dwconv/depthwise (FusedConvActConvolution) [04/19/2021-12:48:12] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/19/2021-12:48:12] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block4a_dwconv/depthwise (CaskConvolution) [04/19/2021-12:48:12] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:13] [V] [TRT] Tactic: 1062367460111450758 time 12.8047 [04/19/2021-12:48:13] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [04/19/2021-12:48:13] [V] [TRT] Tactic: 4337000649858996379 time 13.1283 [04/19/2021-12:48:13] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:13] [V] [TRT] Tactic: 4501471010995462441 time 6.72596 [04/19/2021-12:48:13] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:13] [V] [TRT] Tactic: 5137655947464784826 time 6.41947 [04/19/2021-12:48:13] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:14] [V] [TRT] Tactic: 6645123197870846056 time 6.79033 [04/19/2021-12:48:14] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [04/19/2021-12:48:14] [V] [TRT] Tactic: -9137461792520977713 time 7.03174 [04/19/2021-12:48:14] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [04/19/2021-12:48:14] [V] [TRT] Tactic: -6092040395344634144 time 6.80986 [04/19/2021-12:48:14] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:14] [V] [TRT] Tactic: -3456450830548107839 time 7.04662 [04/19/2021-12:48:14] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:14] [V] [TRT] Tactic: -410470605513481746 time 6.4353 [04/19/2021-12:48:14] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 6.41947 [04/19/2021-12:48:14] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block4a_dwconv/depthwise (CudaConvolution) [04/19/2021-12:48:14] [V] [TRT] Tactic: 0 time 0.375709 [04/19/2021-12:48:14] [V] [TRT] Tactic: 2 time 0.374967 [04/19/2021-12:48:16] [V] [TRT] Tactic: 5 time 75.4211 [04/19/2021-12:48:16] [V] [TRT] Tactic: 57 time 0.374818 [04/19/2021-12:48:16] [V] [TRT] Fastest Tactic: 57 Time: 0.374818 [04/19/2021-12:48:16] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block4a_dwconv/depthwise (CudaDepthwiseConvolution) [04/19/2021-12:48:16] [V] [TRT] Tactic: -1 time 0.194805 [04/19/2021-12:48:16] [V] [TRT] Fastest Tactic: -1 Time: 0.194805 [04/19/2021-12:48:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [04/19/2021-12:48:16] [V] [TRT] [04/19/2021-12:48:16] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:48:16] [V] [TRT] Tactic: 1002 time 0.125573 [04/19/2021-12:48:16] [V] [TRT] Tactic: 0 time 0.113867 [04/19/2021-12:48:16] [V] [TRT] Fastest Tactic: 0 Time: 0.113867 [04/19/2021-12:48:16] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:48:16] [V] [TRT] Tactic: 1002 time 0.125273 [04/19/2021-12:48:16] [V] [TRT] Tactic: 0 time 0.113581 [04/19/2021-12:48:16] [V] [TRT] Fastest Tactic: 0 Time: 0.113581 [04/19/2021-12:48:16] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:48:16] [V] [TRT] Tactic: 1002 time 0.179974 [04/19/2021-12:48:16] [V] [TRT] Tactic: 0 time 0.0864324 [04/19/2021-12:48:16] [V] [TRT] Fastest Tactic: 0 Time: 0.0864324 [04/19/2021-12:48:16] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,47040) -> Float(1,14,196,47040) *************** [04/19/2021-12:48:16] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4a_activation/mul) (PointWise) [04/19/2021-12:48:16] [V] [TRT] Tactic: 128 time 0.108171 [04/19/2021-12:48:16] [V] [TRT] Tactic: 256 time 0.108223 [04/19/2021-12:48:16] [V] [TRT] Tactic: 512 time 0.109505 [04/19/2021-12:48:16] [V] [TRT] Tactic: -32 time 0.133757 [04/19/2021-12:48:16] [V] [TRT] Tactic: -64 time 0.124147 [04/19/2021-12:48:16] [V] [TRT] Tactic: -128 time 0.115312 [04/19/2021-12:48:16] [V] [TRT] Fastest Tactic: 128 Time: 0.108171 [04/19/2021-12:48:16] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4a_activation/mul) (PointWiseV2) [04/19/2021-12:48:16] [V] [TRT] Tactic: 0 time 0.0527211 [04/19/2021-12:48:16] [V] [TRT] Tactic: 1 time 0.0400456 [04/19/2021-12:48:16] [V] [TRT] Tactic: 2 time 0.0370573 [04/19/2021-12:48:16] [V] [TRT] Tactic: 3 time 0.0353646 [04/19/2021-12:48:16] [V] [TRT] Tactic: 4 time 0.0281118 [04/19/2021-12:48:16] [V] [TRT] Tactic: 5 time 0.029245 [04/19/2021-12:48:16] [V] [TRT] Tactic: 6 time 0.0335611 [04/19/2021-12:48:16] [V] [TRT] Tactic: 7 time 0.0268882 [04/19/2021-12:48:16] [V] [TRT] Tactic: 8 time 0.0241991 [04/19/2021-12:48:16] [V] [TRT] Tactic: 9 time 0.0254036 [04/19/2021-12:48:16] [V] [TRT] Tactic: 28 time 0.0515036 [04/19/2021-12:48:16] [V] [TRT] Fastest Tactic: 8 Time: 0.0241991 [04/19/2021-12:48:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [04/19/2021-12:48:16] [V] [TRT] [04/19/2021-12:48:16] [V] [TRT] *************** Autotuning format combination: Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [04/19/2021-12:48:16] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4a_activation/mul) (PointWise) [04/19/2021-12:48:16] [V] [TRT] Tactic: 128 time 0.159023 [04/19/2021-12:48:16] [V] [TRT] Tactic: 256 time 0.159674 [04/19/2021-12:48:16] [V] [TRT] Tactic: 512 time 0.16095 [04/19/2021-12:48:16] [V] [TRT] Tactic: -32 time 0.12972 [04/19/2021-12:48:16] [V] [TRT] Tactic: -64 time 0.126165 [04/19/2021-12:48:16] [V] [TRT] Tactic: -128 time 0.127637 [04/19/2021-12:48:16] [V] [TRT] Fastest Tactic: -64 Time: 0.126165 [04/19/2021-12:48:16] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4a_activation/mul) (PointWiseV2) [04/19/2021-12:48:16] [V] [TRT] Tactic: 24 time 0.0448764 [04/19/2021-12:48:16] [V] [TRT] Tactic: 25 time 0.0396094 [04/19/2021-12:48:16] [V] [TRT] Tactic: 26 time 0.0403973 [04/19/2021-12:48:16] [V] [TRT] Tactic: 27 time 0.0401952 [04/19/2021-12:48:16] [V] [TRT] Tactic: 31 time 0.0444532 [04/19/2021-12:48:16] [V] [TRT] Fastest Tactic: 25 Time: 0.0396094 [04/19/2021-12:48:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [04/19/2021-12:48:16] [V] [TRT] [04/19/2021-12:48:16] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:48:16] [V] [TRT] Tactic: 1002 time 0.179453 [04/19/2021-12:48:16] [V] [TRT] Tactic: 0 time 0.086543 [04/19/2021-12:48:16] [V] [TRT] Fastest Tactic: 0 Time: 0.086543 [04/19/2021-12:48:16] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,47040) -> Float(1,240) *************** [04/19/2021-12:48:16] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block4a_se_squeeze/Mean (Reduce) [04/19/2021-12:48:17] [V] [TRT] Tactic: 1 time 0.201602 [04/19/2021-12:48:17] [V] [TRT] Tactic: 3 time 0.0706446 [04/19/2021-12:48:17] [V] [TRT] Tactic: 6 time 0.530827 [04/19/2021-12:48:17] [V] [TRT] Fastest Tactic: 3 Time: 0.0706446 [04/19/2021-12:48:17] [V] [TRT] *************** Autotuning format combination: Float(1,240) -> Float(1,1,1,240) *************** [04/19/2021-12:48:17] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block4a_se_reshape/Reshape + StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/BiasAdd__135 (Shuffle) [04/19/2021-12:48:17] [V] [TRT] Tactic: 0 time 0.00329425 [04/19/2021-12:48:17] [V] [TRT] Tactic: 1 time 0.0115169 [04/19/2021-12:48:17] [V] [TRT] Fastest Tactic: 0 Time: 0.00329425 [04/19/2021-12:48:17] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,240) -> Float(1,1,1,10) *************** [04/19/2021-12:48:17] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,10) -> Float(1,1,1,10) *************** [04/19/2021-12:48:17] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/mul) (PointWise) [04/19/2021-12:48:17] [V] [TRT] Tactic: 128 time 0.005716 [04/19/2021-12:48:17] [V] [TRT] Tactic: 256 time 0.00570325 [04/19/2021-12:48:17] [V] [TRT] Tactic: 512 time 0.00575513 [04/19/2021-12:48:17] [V] [TRT] Fastest Tactic: 256 Time: 0.00570325 [04/19/2021-12:48:17] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/mul) (PointWiseV2) [04/19/2021-12:48:17] [V] [TRT] Tactic: 0 time 0.004004 [04/19/2021-12:48:17] [V] [TRT] Tactic: 1 time 0.00479175 [04/19/2021-12:48:17] [V] [TRT] Tactic: 2 time 0.00428388 [04/19/2021-12:48:17] [V] [TRT] Tactic: 3 time 0.00550775 [04/19/2021-12:48:17] [V] [TRT] Tactic: 4 time 0.00511063 [04/19/2021-12:48:17] [V] [TRT] Tactic: 5 time 0.00455725 [04/19/2021-12:48:17] [V] [TRT] Tactic: 6 time 0.00573563 [04/19/2021-12:48:17] [V] [TRT] Tactic: 7 time 0.00569663 [04/19/2021-12:48:17] [V] [TRT] Tactic: 8 time 0.00516912 [04/19/2021-12:48:17] [V] [TRT] Tactic: 9 time 0.00492825 [04/19/2021-12:48:17] [V] [TRT] Tactic: 28 time 0.00363963 [04/19/2021-12:48:17] [V] [TRT] Fastest Tactic: 28 Time: 0.00363963 [04/19/2021-12:48:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [04/19/2021-12:48:17] [V] [TRT] [04/19/2021-12:48:17] [V] [TRT] *************** Autotuning format combination: Float(1,1,1:32,1) -> Float(1,1,1:32,1) *************** [04/19/2021-12:48:17] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/mul) (PointWise) [04/19/2021-12:48:17] [V] [TRT] Tactic: 128 time 0.00571613 [04/19/2021-12:48:17] [V] [TRT] Tactic: 256 time 0.00567712 [04/19/2021-12:48:17] [V] [TRT] Tactic: 512 time 0.00569637 [04/19/2021-12:48:17] [V] [TRT] Tactic: -32 time 0.00577475 [04/19/2021-12:48:17] [V] [TRT] Tactic: -64 time 0.00585912 [04/19/2021-12:48:17] [V] [TRT] Tactic: -128 time 0.00569025 [04/19/2021-12:48:17] [V] [TRT] Fastest Tactic: 256 Time: 0.00567712 [04/19/2021-12:48:17] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/mul) (PointWiseV2) [04/19/2021-12:48:17] [V] [TRT] Tactic: 24 time 0.00565125 [04/19/2021-12:48:17] [V] [TRT] Tactic: 25 time 0.00565112 [04/19/2021-12:48:17] [V] [TRT] Tactic: 26 time 0.0056185 [04/19/2021-12:48:17] [V] [TRT] Tactic: 27 time 0.00794913 [04/19/2021-12:48:17] [V] [TRT] Tactic: 31 time 0.00555325 [04/19/2021-12:48:17] [V] [TRT] Fastest Tactic: 31 Time: 0.00555325 [04/19/2021-12:48:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [04/19/2021-12:48:17] [V] [TRT] [04/19/2021-12:48:17] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,10) -> Float(1,1,1,240) *************** [04/19/2021-12:48:18] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,240), Float(1,14,196,47040) -> Float(1,14,196,47040) *************** [04/19/2021-12:48:18] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4a_se_excite/mul) (PointWise) [04/19/2021-12:48:18] [V] [TRT] Tactic: 128 time 0.133971 [04/19/2021-12:48:18] [V] [TRT] Tactic: 256 time 0.134017 [04/19/2021-12:48:18] [V] [TRT] Tactic: 512 time 0.134466 [04/19/2021-12:48:18] [V] [TRT] Tactic: -32 time 0.138496 [04/19/2021-12:48:18] [V] [TRT] Tactic: -64 time 0.156875 [04/19/2021-12:48:18] [V] [TRT] Tactic: -128 time 0.154108 [04/19/2021-12:48:18] [V] [TRT] Fastest Tactic: 128 Time: 0.133971 [04/19/2021-12:48:18] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4a_se_excite/mul) (PointWiseV2) [04/19/2021-12:48:18] [V] [TRT] Tactic: 0 time 0.192344 [04/19/2021-12:48:18] [V] [TRT] Tactic: 1 time 0.229798 [04/19/2021-12:48:18] [V] [TRT] Tactic: 2 time 0.210117 [04/19/2021-12:48:18] [V] [TRT] Tactic: 3 time 0.269401 [04/19/2021-12:48:18] [V] [TRT] Tactic: 4 time 0.277266 [04/19/2021-12:48:18] [V] [TRT] Tactic: 5 time 0.237793 [04/19/2021-12:48:18] [V] [TRT] Tactic: 6 time 0.360892 [04/19/2021-12:48:18] [V] [TRT] Tactic: 7 time 0.33888 [04/19/2021-12:48:18] [V] [TRT] Tactic: 8 time 0.345039 [04/19/2021-12:48:18] [V] [TRT] Tactic: 9 time 0.300918 [04/19/2021-12:48:18] [V] [TRT] Tactic: 28 time 0.0863283 [04/19/2021-12:48:18] [V] [TRT] Fastest Tactic: 28 Time: 0.0863283 [04/19/2021-12:48:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [04/19/2021-12:48:18] [V] [TRT] [04/19/2021-12:48:18] [V] [TRT] *************** Autotuning format combination: Float(1,1,1:32,8), Float(1,14,196:32,1568) -> Float(1,14,196:32,1568) *************** [04/19/2021-12:48:18] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4a_se_excite/mul) (PointWise) [04/19/2021-12:48:18] [V] [TRT] Tactic: 128 time 0.180482 [04/19/2021-12:48:18] [V] [TRT] Tactic: 256 time 0.181471 [04/19/2021-12:48:18] [V] [TRT] Tactic: 512 time 0.182246 [04/19/2021-12:48:18] [V] [TRT] Tactic: -32 time 0.202474 [04/19/2021-12:48:18] [V] [TRT] Tactic: -64 time 0.203841 [04/19/2021-12:48:18] [V] [TRT] Tactic: -128 time 0.203008 [04/19/2021-12:48:18] [V] [TRT] Fastest Tactic: 128 Time: 0.180482 [04/19/2021-12:48:18] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4a_se_excite/mul) (PointWiseV2) [04/19/2021-12:48:18] [V] [TRT] Tactic: 24 time 0.0592121 [04/19/2021-12:48:18] [V] [TRT] Tactic: 25 time 0.054642 [04/19/2021-12:48:18] [V] [TRT] Tactic: 26 time 0.0544791 [04/19/2021-12:48:18] [V] [TRT] Tactic: 27 time 0.0593749 [04/19/2021-12:48:18] [V] [TRT] Tactic: 31 time 0.0527216 [04/19/2021-12:48:18] [V] [TRT] Fastest Tactic: 31 Time: 0.0527216 [04/19/2021-12:48:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [04/19/2021-12:48:18] [V] [TRT] [04/19/2021-12:48:18] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,47040) -> Float(1,14,196,15680) *************** [04/19/2021-12:48:18] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:18] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:18] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:18] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:18] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:18] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:48:18] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:18] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:18] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:48:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D (FusedConvActConvolution) [04/19/2021-12:48:18] [V] [TRT] Tactic: 589823 time 0.195007 [04/19/2021-12:48:18] [V] [TRT] Tactic: 655359 time 0.198932 [04/19/2021-12:48:18] [V] [TRT] Tactic: 786431 time 0.164694 [04/19/2021-12:48:18] [V] [TRT] Tactic: 851967 time 0.174225 [04/19/2021-12:48:18] [V] [TRT] Tactic: 1179647 time 0.171237 [04/19/2021-12:48:18] [V] [TRT] Tactic: 1310719 time 0.357871 [04/19/2021-12:48:18] [V] [TRT] Tactic: 1376255 time 0.1525 [04/19/2021-12:48:19] [V] [TRT] Tactic: 1441791 time 0.227331 [04/19/2021-12:48:19] [V] [TRT] Tactic: 1507327 time 0.215938 [04/19/2021-12:48:19] [V] [TRT] Tactic: 1638399 time 0.211243 [04/19/2021-12:48:19] [V] [TRT] Tactic: 1835007 time 0.168203 [04/19/2021-12:48:19] [V] [TRT] Tactic: 1900543 time 0.214095 [04/19/2021-12:48:19] [V] [TRT] Tactic: 2162687 time 0.152748 [04/19/2021-12:48:19] [V] [TRT] Tactic: 2293759 time 0.155573 [04/19/2021-12:48:19] [V] [TRT] Tactic: 2359295 time 0.208457 [04/19/2021-12:48:19] [V] [TRT] Tactic: 2686975 time 0.204564 [04/19/2021-12:48:19] [V] [TRT] Tactic: 3080191 time 0.157845 [04/19/2021-12:48:19] [V] [TRT] Tactic: 3342335 time 0.183574 [04/19/2021-12:48:19] [V] [TRT] Tactic: 3407871 time 0.158301 [04/19/2021-12:48:19] [V] [TRT] Tactic: 3538943 time 0.155879 [04/19/2021-12:48:19] [V] [TRT] Tactic: 3670015 time 0.213327 [04/19/2021-12:48:19] [V] [TRT] Tactic: 3932159 time 0.197956 [04/19/2021-12:48:19] [V] [TRT] Tactic: 3997695 time 0.165195 [04/19/2021-12:48:19] [V] [TRT] Tactic: 4063231 time 0.152943 [04/19/2021-12:48:19] [V] [TRT] Tactic: 4194303 time 0.166465 [04/19/2021-12:48:19] [V] [TRT] Tactic: 4325375 time 0.194186 [04/19/2021-12:48:19] [V] [TRT] Tactic: 4521983 time 0.24681 [04/19/2021-12:48:19] [V] [TRT] Tactic: 4587519 time 0.182949 [04/19/2021-12:48:19] [V] [TRT] Tactic: 4653055 time 0.204342 [04/19/2021-12:48:19] [V] [TRT] Tactic: 4915199 time 0.155443 [04/19/2021-12:48:19] [V] [TRT] Tactic: 4980735 time 0.198359 [04/19/2021-12:48:19] [V] [TRT] Tactic: 5177343 time 0.194649 [04/19/2021-12:48:19] [V] [TRT] Tactic: 5242879 time 0.140951 [04/19/2021-12:48:19] [V] [TRT] Tactic: 5373951 time 0.198294 [04/19/2021-12:48:19] [V] [TRT] Tactic: 5439487 time 0.166042 [04/19/2021-12:48:19] [V] [TRT] Tactic: 5570559 time 0.176191 [04/19/2021-12:48:19] [V] [TRT] Tactic: 5636095 time 0.152995 [04/19/2021-12:48:19] [V] [TRT] Tactic: 5701631 time 0.197415 [04/19/2021-12:48:19] [V] [TRT] Tactic: 5767167 time 0.217018 [04/19/2021-12:48:19] [V] [TRT] Tactic: 5832703 time 0.155378 [04/19/2021-12:48:19] [V] [TRT] Tactic: 5898239 time 0.150918 [04/19/2021-12:48:19] [V] [TRT] Tactic: 6029311 time 0.144492 [04/19/2021-12:48:19] [V] [TRT] Tactic: 6225919 time 0.137643 [04/19/2021-12:48:19] [V] [TRT] Tactic: 6291455 time 0.171855 [04/19/2021-12:48:19] [V] [TRT] Tactic: 6422527 time 0.145586 [04/19/2021-12:48:19] [V] [TRT] Tactic: 6750207 time 0.148483 [04/19/2021-12:48:19] [V] [TRT] Tactic: 6815743 time 0.146914 [04/19/2021-12:48:19] [V] [TRT] Tactic: 6946815 time 0.213366 [04/19/2021-12:48:19] [V] [TRT] Tactic: 7077887 time 0.15248 [04/19/2021-12:48:19] [V] [TRT] Tactic: 7143423 time 0.226693 [04/19/2021-12:48:19] [V] [TRT] Tactic: 7208959 time 0.176615 [04/19/2021-12:48:19] [V] [TRT] Tactic: 7340031 time 0.155078 [04/19/2021-12:48:19] [V] [TRT] Tactic: 7405567 time 0.167656 [04/19/2021-12:48:19] [V] [TRT] Tactic: 7536639 time 0.19345 [04/19/2021-12:48:19] [V] [TRT] Tactic: 7602175 time 0.197891 [04/19/2021-12:48:19] [V] [TRT] Tactic: 7733247 time 0.159955 [04/19/2021-12:48:19] [V] [TRT] Tactic: 7798783 time 0.164921 [04/19/2021-12:48:19] [V] [TRT] Tactic: 8191999 time 0.239089 [04/19/2021-12:48:19] [V] [TRT] Tactic: 8257535 time 0.157956 [04/19/2021-12:48:19] [V] [TRT] Tactic: 8323071 time 0.156458 [04/19/2021-12:48:19] [V] [TRT] Tactic: 8650751 time 0.21265 [04/19/2021-12:48:19] [V] [TRT] Tactic: 8716287 time 0.149714 [04/19/2021-12:48:19] [V] [TRT] Tactic: 9568255 time 0.156725 [04/19/2021-12:48:19] [V] [TRT] Tactic: 9895935 time 0.166224 [04/19/2021-12:48:20] [V] [TRT] Tactic: 10223615 time 0.204785 [04/19/2021-12:48:20] [V] [TRT] Tactic: 10354687 time 0.183743 [04/19/2021-12:48:20] [V] [TRT] Tactic: 10551295 time 0.153815 [04/19/2021-12:48:20] [V] [TRT] Tactic: 10747903 time 0.15263 [04/19/2021-12:48:20] [V] [TRT] Tactic: 10944511 time 0.198184 [04/19/2021-12:48:20] [V] [TRT] Fastest Tactic: 6225919 Time: 0.137643 [04/19/2021-12:48:20] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D (CaskConvolution) [04/19/2021-12:48:20] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:20] [V] [TRT] Tactic: 1062367460111450758 time 0.101283 [04/19/2021-12:48:20] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:20] [V] [TRT] Tactic: 4501471010995462441 time 0.100658 [04/19/2021-12:48:20] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:20] [V] [TRT] Tactic: 5137655947464784826 time 0.101296 [04/19/2021-12:48:20] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:20] [V] [TRT] Tactic: 5326823351883942011 time 0.0958657 [04/19/2021-12:48:20] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:20] [V] [TRT] Tactic: 6645123197870846056 time 0.105996 [04/19/2021-12:48:20] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:48:20] [V] [TRT] Tactic: -6576203419454146580 time 0.0919271 [04/19/2021-12:48:20] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:20] [V] [TRT] Tactic: -3456450830548107839 time 0.0973827 [04/19/2021-12:48:20] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:20] [V] [TRT] Tactic: -410470605513481746 time 0.0974219 [04/19/2021-12:48:20] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:48:20] [V] [TRT] Tactic: -37215280111360163 time 0.103008 [04/19/2021-12:48:20] [V] [TRT] Fastest Tactic: -6576203419454146580 Time: 0.0919271 [04/19/2021-12:48:20] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D (CudaConvolution) [04/19/2021-12:48:20] [V] [TRT] Tactic: 0 time 0.170228 [04/19/2021-12:48:20] [V] [TRT] Tactic: 2 time 0.321185 [04/19/2021-12:48:20] [V] [TRT] Tactic: 5 time 1.26912 [04/19/2021-12:48:20] [V] [TRT] Tactic: 57 time 0.149356 [04/19/2021-12:48:20] [V] [TRT] Fastest Tactic: 57 Time: 0.149356 [04/19/2021-12:48:20] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D (CudaDepthwiseConvolution) [04/19/2021-12:48:20] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/19/2021-12:48:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6576203419454146580 [04/19/2021-12:48:20] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:48:20] [V] [TRT] [04/19/2021-12:48:20] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:20] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:20] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:20] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:20] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:20] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:48:20] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:20] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:20] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:48:20] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:48:20] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,15680) -> Float(1,14,196,94080) *************** [04/19/2021-12:48:20] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:20] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:20] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:20] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:20] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:20] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:48:20] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:20] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:20] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:48:20] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D (FusedConvActConvolution) [04/19/2021-12:48:20] [V] [TRT] Tactic: 589823 time 0.433926 [04/19/2021-12:48:20] [V] [TRT] Tactic: 655359 time 0.370846 [04/19/2021-12:48:20] [V] [TRT] Tactic: 786431 time 0.420964 [04/19/2021-12:48:20] [V] [TRT] Tactic: 851967 time 0.449525 [04/19/2021-12:48:20] [V] [TRT] Tactic: 1179647 time 0.414036 [04/19/2021-12:48:20] [V] [TRT] Tactic: 1310719 time 0.745963 [04/19/2021-12:48:20] [V] [TRT] Tactic: 1376255 time 0.333809 [04/19/2021-12:48:20] [V] [TRT] Tactic: 1441791 time 0.557617 [04/19/2021-12:48:20] [V] [TRT] Tactic: 1507327 time 0.441992 [04/19/2021-12:48:20] [V] [TRT] Tactic: 1638399 time 0.544733 [04/19/2021-12:48:20] [V] [TRT] Tactic: 1835007 time 0.421589 [04/19/2021-12:48:20] [V] [TRT] Tactic: 1900543 time 0.434623 [04/19/2021-12:48:20] [V] [TRT] Tactic: 2162687 time 0.343288 [04/19/2021-12:48:20] [V] [TRT] Tactic: 2293759 time 0.321563 [04/19/2021-12:48:20] [V] [TRT] Tactic: 2359295 time 0.420404 [04/19/2021-12:48:20] [V] [TRT] Tactic: 2686975 time 0.350104 [04/19/2021-12:48:20] [V] [TRT] Tactic: 3080191 time 0.380905 [04/19/2021-12:48:20] [V] [TRT] Tactic: 3342335 time 0.443119 [04/19/2021-12:48:20] [V] [TRT] Tactic: 3407871 time 0.357904 [04/19/2021-12:48:20] [V] [TRT] Tactic: 3538943 time 0.350189 [04/19/2021-12:48:20] [V] [TRT] Tactic: 3670015 time 0.383769 [04/19/2021-12:48:20] [V] [TRT] Tactic: 3932159 time 0.408516 [04/19/2021-12:48:20] [V] [TRT] Tactic: 3997695 time 0.41612 [04/19/2021-12:48:20] [V] [TRT] Tactic: 4063231 time 0.406803 [04/19/2021-12:48:20] [V] [TRT] Tactic: 4194303 time 0.416856 [04/19/2021-12:48:21] [V] [TRT] Tactic: 4325375 time 0.451029 [04/19/2021-12:48:21] [V] [TRT] Tactic: 4521983 time 0.440768 [04/19/2021-12:48:22] [V] [TRT] Tactic: 4587519 time 1.07603 [04/19/2021-12:48:22] [V] [TRT] Tactic: 4653055 time 1.03103 [04/19/2021-12:48:22] [V] [TRT] Tactic: 4915199 time 0.965612 [04/19/2021-12:48:22] [V] [TRT] Tactic: 4980735 time 1.0667 [04/19/2021-12:48:22] [V] [TRT] Tactic: 5177343 time 1.01828 [04/19/2021-12:48:22] [V] [TRT] Tactic: 5242879 time 0.787513 [04/19/2021-12:48:22] [V] [TRT] Tactic: 5373951 time 0.947845 [04/19/2021-12:48:22] [V] [TRT] Tactic: 5439487 time 0.998093 [04/19/2021-12:48:22] [V] [TRT] Tactic: 5570559 time 0.811725 [04/19/2021-12:48:22] [V] [TRT] Tactic: 5636095 time 0.858327 [04/19/2021-12:48:22] [V] [TRT] Tactic: 5701631 time 0.669069 [04/19/2021-12:48:22] [V] [TRT] Tactic: 5767167 time 0.946439 [04/19/2021-12:48:22] [V] [TRT] Tactic: 5832703 time 0.66985 [04/19/2021-12:48:22] [V] [TRT] Tactic: 5898239 time 0.671882 [04/19/2021-12:48:22] [V] [TRT] Tactic: 6029311 time 0.589108 [04/19/2021-12:48:22] [V] [TRT] Tactic: 6225919 time 0.639232 [04/19/2021-12:48:22] [V] [TRT] Tactic: 6291455 time 0.764577 [04/19/2021-12:48:22] [V] [TRT] Tactic: 6422527 time 0.536608 [04/19/2021-12:48:22] [V] [TRT] Tactic: 6750207 time 0.677252 [04/19/2021-12:48:22] [V] [TRT] Tactic: 6815743 time 0.617519 [04/19/2021-12:48:23] [V] [TRT] Tactic: 6946815 time 0.809577 [04/19/2021-12:48:23] [V] [TRT] Tactic: 7077887 time 0.563268 [04/19/2021-12:48:23] [V] [TRT] Tactic: 7143423 time 0.8461 [04/19/2021-12:48:23] [V] [TRT] Tactic: 7208959 time 0.65071 [04/19/2021-12:48:23] [V] [TRT] Tactic: 7340031 time 0.579661 [04/19/2021-12:48:23] [V] [TRT] Tactic: 7405567 time 0.625833 [04/19/2021-12:48:23] [V] [TRT] Tactic: 7536639 time 0.610879 [04/19/2021-12:48:23] [V] [TRT] Tactic: 7602175 time 0.752435 [04/19/2021-12:48:23] [V] [TRT] Tactic: 7733247 time 0.582005 [04/19/2021-12:48:23] [V] [TRT] Tactic: 7798783 time 0.694759 [04/19/2021-12:48:23] [V] [TRT] Tactic: 8191999 time 0.907676 [04/19/2021-12:48:23] [V] [TRT] Tactic: 8257535 time 0.60556 [04/19/2021-12:48:23] [V] [TRT] Tactic: 8323071 time 0.590254 [04/19/2021-12:48:23] [V] [TRT] Tactic: 8650751 time 0.738249 [04/19/2021-12:48:23] [V] [TRT] Tactic: 8716287 time 0.553079 [04/19/2021-12:48:23] [V] [TRT] Tactic: 9568255 time 0.598659 [04/19/2021-12:48:23] [V] [TRT] Tactic: 9895935 time 0.607995 [04/19/2021-12:48:23] [V] [TRT] Tactic: 10223615 time 0.490332 [04/19/2021-12:48:23] [V] [TRT] Tactic: 10354687 time 0.713672 [04/19/2021-12:48:23] [V] [TRT] Tactic: 10551295 time 0.516211 [04/19/2021-12:48:23] [V] [TRT] Tactic: 10747903 time 0.487799 [04/19/2021-12:48:23] [V] [TRT] Tactic: 10944511 time 0.673477 [04/19/2021-12:48:23] [V] [TRT] Fastest Tactic: 2293759 Time: 0.321563 [04/19/2021-12:48:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D (CaskConvolution) [04/19/2021-12:48:23] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:23] [V] [TRT] Tactic: 1062367460111450758 time 0.275625 [04/19/2021-12:48:23] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:23] [V] [TRT] Tactic: 4501471010995462441 time 0.231543 [04/19/2021-12:48:23] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:23] [V] [TRT] Tactic: 5137655947464784826 time 0.231569 [04/19/2021-12:48:23] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:23] [V] [TRT] Tactic: 5326823351883942011 time 0.220436 [04/19/2021-12:48:23] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:23] [V] [TRT] Tactic: 6645123197870846056 time 0.237565 [04/19/2021-12:48:23] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:48:23] [V] [TRT] Tactic: -6576203419454146580 time 0.250104 [04/19/2021-12:48:23] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:23] [V] [TRT] Tactic: -3456450830548107839 time 0.259232 [04/19/2021-12:48:23] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:23] [V] [TRT] Tactic: -410470605513481746 time 0.225612 [04/19/2021-12:48:23] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:48:23] [V] [TRT] Tactic: -37215280111360163 time 0.227493 [04/19/2021-12:48:23] [V] [TRT] Fastest Tactic: 5326823351883942011 Time: 0.220436 [04/19/2021-12:48:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D (CudaConvolution) [04/19/2021-12:48:23] [V] [TRT] Tactic: 0 time 0.518932 [04/19/2021-12:48:23] [V] [TRT] Tactic: 2 time 0.562051 [04/19/2021-12:48:24] [V] [TRT] Tactic: 5 time 3.66626 [04/19/2021-12:48:24] [V] [TRT] Tactic: 57 time 0.323346 [04/19/2021-12:48:24] [V] [TRT] Fastest Tactic: 57 Time: 0.323346 [04/19/2021-12:48:24] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D (CudaDepthwiseConvolution) [04/19/2021-12:48:24] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/19/2021-12:48:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5326823351883942011 [04/19/2021-12:48:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:24] [V] [TRT] [04/19/2021-12:48:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:48:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:48:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:24] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:48:24] [V] [TRT] Tactic: 1002 time 0.235488 [04/19/2021-12:48:24] [V] [TRT] Tactic: 0 time 0.218138 [04/19/2021-12:48:24] [V] [TRT] Fastest Tactic: 0 Time: 0.218138 [04/19/2021-12:48:24] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:48:24] [V] [TRT] Tactic: 1002 time 0.235618 [04/19/2021-12:48:24] [V] [TRT] Tactic: 0 time 0.218828 [04/19/2021-12:48:24] [V] [TRT] Fastest Tactic: 0 Time: 0.218828 [04/19/2021-12:48:24] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:48:24] [V] [TRT] Tactic: 1002 time 0.327116 [04/19/2021-12:48:24] [V] [TRT] Tactic: 0 time 0.165287 [04/19/2021-12:48:24] [V] [TRT] Fastest Tactic: 0 Time: 0.165287 [04/19/2021-12:48:24] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,94080) -> Float(1,14,196,94080) *************** [04/19/2021-12:48:24] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4b_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4b_expand_activation/mul) (PointWise) [04/19/2021-12:48:24] [V] [TRT] Tactic: 128 time 0.209616 [04/19/2021-12:48:24] [V] [TRT] Tactic: 256 time 0.209954 [04/19/2021-12:48:24] [V] [TRT] Tactic: 512 time 0.211888 [04/19/2021-12:48:24] [V] [TRT] Tactic: -32 time 0.227799 [04/19/2021-12:48:24] [V] [TRT] Tactic: -64 time 0.227123 [04/19/2021-12:48:24] [V] [TRT] Tactic: -128 time 0.220176 [04/19/2021-12:48:24] [V] [TRT] Fastest Tactic: 128 Time: 0.209616 [04/19/2021-12:48:24] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4b_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4b_expand_activation/mul) (PointWiseV2) [04/19/2021-12:48:24] [V] [TRT] Tactic: 0 time 0.10054 [04/19/2021-12:48:24] [V] [TRT] Tactic: 1 time 0.075104 [04/19/2021-12:48:24] [V] [TRT] Tactic: 2 time 0.0687633 [04/19/2021-12:48:24] [V] [TRT] Tactic: 3 time 0.0640629 [04/19/2021-12:48:24] [V] [TRT] Tactic: 4 time 0.0510286 [04/19/2021-12:48:24] [V] [TRT] Tactic: 5 time 0.0530013 [04/19/2021-12:48:24] [V] [TRT] Tactic: 6 time 0.0607354 [04/19/2021-12:48:24] [V] [TRT] Tactic: 7 time 0.0478383 [04/19/2021-12:48:24] [V] [TRT] Tactic: 8 time 0.0434505 [04/19/2021-12:48:24] [V] [TRT] Tactic: 9 time 0.045052 [04/19/2021-12:48:24] [V] [TRT] Tactic: 28 time 0.0973957 [04/19/2021-12:48:24] [V] [TRT] Fastest Tactic: 8 Time: 0.0434505 [04/19/2021-12:48:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [04/19/2021-12:48:24] [V] [TRT] [04/19/2021-12:48:24] [V] [TRT] *************** Autotuning format combination: Float(1,14,196:32,2940) -> Float(1,14,196:32,2940) *************** [04/19/2021-12:48:24] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4b_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4b_expand_activation/mul) (PointWise) [04/19/2021-12:48:24] [V] [TRT] Tactic: 128 time 0.209407 [04/19/2021-12:48:24] [V] [TRT] Tactic: 256 time 0.20944 [04/19/2021-12:48:24] [V] [TRT] Tactic: 512 time 0.212429 [04/19/2021-12:48:24] [V] [TRT] Tactic: -32 time 0.227962 [04/19/2021-12:48:24] [V] [TRT] Tactic: -64 time 0.227507 [04/19/2021-12:48:24] [V] [TRT] Tactic: -128 time 0.220176 [04/19/2021-12:48:24] [V] [TRT] Fastest Tactic: 128 Time: 0.209407 [04/19/2021-12:48:24] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4b_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4b_expand_activation/mul) (PointWiseV2) [04/19/2021-12:48:24] [V] [TRT] Tactic: 24 time 0.073138 [04/19/2021-12:48:24] [V] [TRT] Tactic: 25 time 0.0655014 [04/19/2021-12:48:24] [V] [TRT] Tactic: 26 time 0.0664843 [04/19/2021-12:48:24] [V] [TRT] Tactic: 27 time 0.0686783 [04/19/2021-12:48:24] [V] [TRT] Tactic: 31 time 0.0726692 [04/19/2021-12:48:24] [V] [TRT] Fastest Tactic: 25 Time: 0.0655014 [04/19/2021-12:48:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [04/19/2021-12:48:24] [V] [TRT] [04/19/2021-12:48:24] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,94080) -> Float(1,14,196,94080) *************** [04/19/2021-12:48:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [04/19/2021-12:48:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [04/19/2021-12:48:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [04/19/2021-12:48:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [04/19/2021-12:48:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [04/19/2021-12:48:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [04/19/2021-12:48:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [04/19/2021-12:48:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 [04/19/2021-12:48:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [04/19/2021-12:48:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:24] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise (FusedConvActConvolution) [04/19/2021-12:48:24] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/19/2021-12:48:24] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise (CaskConvolution) [04/19/2021-12:48:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:25] [V] [TRT] Tactic: 1062367460111450758 time 13.4559 [04/19/2021-12:48:25] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [04/19/2021-12:48:25] [V] [TRT] Tactic: 3827454225649558724 time 12.5763 [04/19/2021-12:48:25] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [04/19/2021-12:48:25] [V] [TRT] Tactic: 4337000649858996379 time 13.87 [04/19/2021-12:48:25] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:26] [V] [TRT] Tactic: 4501471010995462441 time 12.9818 [04/19/2021-12:48:26] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:26] [V] [TRT] Tactic: 5137655947464784826 time 12.319 [04/19/2021-12:48:26] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [04/19/2021-12:48:26] [V] [TRT] Tactic: 5921334924264294896 time 11.8291 [04/19/2021-12:48:26] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:27] [V] [TRT] Tactic: 6645123197870846056 time 14.1308 [04/19/2021-12:48:27] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [04/19/2021-12:48:27] [V] [TRT] Tactic: 7852627285308570038 time 12.5035 [04/19/2021-12:48:27] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [04/19/2021-12:48:27] [V] [TRT] Tactic: -9137461792520977713 time 14.5831 [04/19/2021-12:48:27] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [04/19/2021-12:48:28] [V] [TRT] Tactic: -8776506421218919509 time 12.5213 [04/19/2021-12:48:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [04/19/2021-12:48:28] [V] [TRT] Tactic: -6092040395344634144 time 14.0476 [04/19/2021-12:48:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:28] [V] [TRT] Tactic: -3456450830548107839 time 14.5482 [04/19/2021-12:48:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 [04/19/2021-12:48:29] [V] [TRT] Tactic: -2318106587342035239 time 12.4251 [04/19/2021-12:48:29] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [04/19/2021-12:48:29] [V] [TRT] Tactic: -1343271414618805657 time 12.4897 [04/19/2021-12:48:29] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:29] [V] [TRT] Tactic: -410470605513481746 time 13.2827 [04/19/2021-12:48:29] [V] [TRT] Fastest Tactic: 5921334924264294896 Time: 11.8291 [04/19/2021-12:48:29] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise (CudaConvolution) [04/19/2021-12:48:29] [V] [TRT] Tactic: 0 time 0.339805 [04/19/2021-12:48:29] [V] [TRT] Tactic: 2 time 0.340149 [04/19/2021-12:48:32] [V] [TRT] Tactic: 5 time 152.448 [04/19/2021-12:48:32] [V] [TRT] Tactic: 6 time 24.2995 [04/19/2021-12:48:32] [V] [TRT] Tactic: 57 time 0.339942 [04/19/2021-12:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.339805 [04/19/2021-12:48:32] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise (CudaDepthwiseConvolution) [04/19/2021-12:48:32] [V] [TRT] Tactic: -1 time 0.269212 [04/19/2021-12:48:32] [V] [TRT] Fastest Tactic: -1 Time: 0.269212 [04/19/2021-12:48:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [04/19/2021-12:48:32] [V] [TRT] [04/19/2021-12:48:33] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,94080) -> Float(1,14,196,94080) *************** [04/19/2021-12:48:33] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4b_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4b_activation/mul) (PointWise) [04/19/2021-12:48:33] [V] [TRT] Tactic: 128 time 0.209583 [04/19/2021-12:48:33] [V] [TRT] Tactic: 256 time 0.210032 [04/19/2021-12:48:33] [V] [TRT] Tactic: 512 time 0.211881 [04/19/2021-12:48:33] [V] [TRT] Tactic: -32 time 0.227168 [04/19/2021-12:48:33] [V] [TRT] Tactic: -64 time 0.226725 [04/19/2021-12:48:33] [V] [TRT] Tactic: -128 time 0.22071 [04/19/2021-12:48:33] [V] [TRT] Fastest Tactic: 128 Time: 0.209583 [04/19/2021-12:48:33] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4b_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4b_activation/mul) (PointWiseV2) [04/19/2021-12:48:33] [V] [TRT] Tactic: 0 time 0.100573 [04/19/2021-12:48:33] [V] [TRT] Tactic: 1 time 0.0758659 [04/19/2021-12:48:33] [V] [TRT] Tactic: 2 time 0.0684961 [04/19/2021-12:48:33] [V] [TRT] Tactic: 3 time 0.0636134 [04/19/2021-12:48:33] [V] [TRT] Tactic: 4 time 0.0504619 [04/19/2021-12:48:33] [V] [TRT] Tactic: 5 time 0.0528972 [04/19/2021-12:48:33] [V] [TRT] Tactic: 6 time 0.061302 [04/19/2021-12:48:33] [V] [TRT] Tactic: 7 time 0.0476951 [04/19/2021-12:48:33] [V] [TRT] Tactic: 8 time 0.043776 [04/19/2021-12:48:33] [V] [TRT] Tactic: 9 time 0.0452861 [04/19/2021-12:48:33] [V] [TRT] Tactic: 28 time 0.0980404 [04/19/2021-12:48:33] [V] [TRT] Fastest Tactic: 8 Time: 0.043776 [04/19/2021-12:48:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [04/19/2021-12:48:33] [V] [TRT] [04/19/2021-12:48:33] [V] [TRT] *************** Autotuning format combination: Float(1,14,196:32,2940) -> Float(1,14,196:32,2940) *************** [04/19/2021-12:48:33] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4b_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4b_activation/mul) (PointWise) [04/19/2021-12:48:33] [V] [TRT] Tactic: 128 time 0.209388 [04/19/2021-12:48:33] [V] [TRT] Tactic: 256 time 0.209779 [04/19/2021-12:48:33] [V] [TRT] Tactic: 512 time 0.21237 [04/19/2021-12:48:33] [V] [TRT] Tactic: -32 time 0.228216 [04/19/2021-12:48:33] [V] [TRT] Tactic: -64 time 0.226992 [04/19/2021-12:48:33] [V] [TRT] Tactic: -128 time 0.220573 [04/19/2021-12:48:33] [V] [TRT] Fastest Tactic: 128 Time: 0.209388 [04/19/2021-12:48:33] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4b_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4b_activation/mul) (PointWiseV2) [04/19/2021-12:48:33] [V] [TRT] Tactic: 24 time 0.0726238 [04/19/2021-12:48:33] [V] [TRT] Tactic: 25 time 0.065905 [04/19/2021-12:48:33] [V] [TRT] Tactic: 26 time 0.0658787 [04/19/2021-12:48:33] [V] [TRT] Tactic: 27 time 0.0686587 [04/19/2021-12:48:33] [V] [TRT] Tactic: 31 time 0.0725585 [04/19/2021-12:48:33] [V] [TRT] Fastest Tactic: 26 Time: 0.0658787 [04/19/2021-12:48:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [04/19/2021-12:48:33] [V] [TRT] [04/19/2021-12:48:33] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:48:33] [V] [TRT] Tactic: 1002 time 0.327252 [04/19/2021-12:48:33] [V] [TRT] Tactic: 0 time 0.164928 [04/19/2021-12:48:33] [V] [TRT] Fastest Tactic: 0 Time: 0.164928 [04/19/2021-12:48:33] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,94080) -> Float(1,480) *************** [04/19/2021-12:48:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block4b_se_squeeze/Mean (Reduce) [04/19/2021-12:48:33] [V] [TRT] Tactic: 1 time 0.392396 [04/19/2021-12:48:33] [V] [TRT] Tactic: 3 time 0.139473 [04/19/2021-12:48:33] [V] [TRT] Tactic: 6 time 0.619388 [04/19/2021-12:48:33] [V] [TRT] Fastest Tactic: 3 Time: 0.139473 [04/19/2021-12:48:33] [V] [TRT] *************** Autotuning format combination: Float(1,480) -> Float(1,1,1,480) *************** [04/19/2021-12:48:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block4b_se_reshape/Reshape + StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd__155 (Shuffle) [04/19/2021-12:48:33] [V] [TRT] Tactic: 0 time 0.00334 [04/19/2021-12:48:33] [V] [TRT] Tactic: 1 time 0.0115754 [04/19/2021-12:48:33] [V] [TRT] Fastest Tactic: 0 Time: 0.00334 [04/19/2021-12:48:33] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,480) -> Float(1,1,1,20) *************** [04/19/2021-12:48:33] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:33] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:33] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:33] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:33] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:33] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:48:33] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:33] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:33] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:48:33] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd (FusedConvActConvolution) [04/19/2021-12:48:33] [V] [TRT] Tactic: 589823 time 0.14459 [04/19/2021-12:48:33] [V] [TRT] Tactic: 655359 time 0.098242 [04/19/2021-12:48:33] [V] [TRT] Tactic: 786431 time 0.0446743 [04/19/2021-12:48:33] [V] [TRT] Tactic: 851967 time 0.0335418 [04/19/2021-12:48:33] [V] [TRT] Tactic: 1179647 time 0.0219206 [04/19/2021-12:48:33] [V] [TRT] Tactic: 1310719 time 0.188821 [04/19/2021-12:48:33] [V] [TRT] Tactic: 1376255 time 0.105423 [04/19/2021-12:48:33] [V] [TRT] Tactic: 1441791 time 0.0266926 [04/19/2021-12:48:34] [V] [TRT] Tactic: 1507327 time 0.0611653 [04/19/2021-12:48:34] [V] [TRT] Tactic: 1638399 time 0.0312175 [04/19/2021-12:48:34] [V] [TRT] Tactic: 1835007 time 0.0423761 [04/19/2021-12:48:34] [V] [TRT] Tactic: 1900543 time 0.107988 [04/19/2021-12:48:34] [V] [TRT] Tactic: 2097151 time 0.0193358 [04/19/2021-12:48:34] [V] [TRT] Tactic: 2162687 time 0.107637 [04/19/2021-12:48:34] [V] [TRT] Tactic: 2293759 time 0.0983592 [04/19/2021-12:48:34] [V] [TRT] Tactic: 2359295 time 0.0659309 [04/19/2021-12:48:34] [V] [TRT] Tactic: 2686975 time 0.09903 [04/19/2021-12:48:34] [V] [TRT] Tactic: 3080191 time 0.0541992 [04/19/2021-12:48:34] [V] [TRT] Tactic: 3342335 time 0.0610352 [04/19/2021-12:48:34] [V] [TRT] Tactic: 3407871 time 0.0543426 [04/19/2021-12:48:34] [V] [TRT] Tactic: 3538943 time 0.0312631 [04/19/2021-12:48:34] [V] [TRT] Tactic: 3670015 time 0.201465 [04/19/2021-12:48:34] [V] [TRT] Tactic: 3932159 time 0.0822067 [04/19/2021-12:48:34] [V] [TRT] Tactic: 3997695 time 0.0254819 [04/19/2021-12:48:34] [V] [TRT] Tactic: 4063231 time 0.0320573 [04/19/2021-12:48:34] [V] [TRT] Tactic: 4194303 time 0.0428059 [04/19/2021-12:48:34] [V] [TRT] Tactic: 4259839 time 0.0173893 [04/19/2021-12:48:34] [V] [TRT] Tactic: 4325375 time 0.0347915 [04/19/2021-12:48:34] [V] [TRT] Tactic: 4521983 time 0.103021 [04/19/2021-12:48:34] [V] [TRT] Tactic: 4587519 time 0.0239324 [04/19/2021-12:48:34] [V] [TRT] Tactic: 4653055 time 0.0243618 [04/19/2021-12:48:34] [V] [TRT] Tactic: 4915199 time 0.0241995 [04/19/2021-12:48:34] [V] [TRT] Tactic: 4980735 time 0.0590104 [04/19/2021-12:48:34] [V] [TRT] Tactic: 5177343 time 0.0218294 [04/19/2021-12:48:34] [V] [TRT] Tactic: 5242879 time 0.0497395 [04/19/2021-12:48:34] [V] [TRT] Tactic: 5373951 time 0.0219921 [04/19/2021-12:48:34] [V] [TRT] Tactic: 5439487 time 0.04265 [04/19/2021-12:48:34] [V] [TRT] Tactic: 5570559 time 0.0573505 [04/19/2021-12:48:34] [V] [TRT] Tactic: 5636095 time 0.0321094 [04/19/2021-12:48:34] [V] [TRT] Tactic: 5701631 time 0.092552 [04/19/2021-12:48:34] [V] [TRT] Tactic: 5767167 time 0.0470899 [04/19/2021-12:48:34] [V] [TRT] Tactic: 5832703 time 0.0506381 [04/19/2021-12:48:34] [V] [TRT] Tactic: 5898239 time 0.0288737 [04/19/2021-12:48:34] [V] [TRT] Tactic: 6029311 time 0.0892122 [04/19/2021-12:48:34] [V] [TRT] Tactic: 6225919 time 0.0287696 [04/19/2021-12:48:34] [V] [TRT] Tactic: 6291455 time 0.0219076 [04/19/2021-12:48:34] [V] [TRT] Tactic: 6422527 time 0.049004 [04/19/2021-12:48:34] [V] [TRT] Tactic: 6750207 time 0.0242447 [04/19/2021-12:48:34] [V] [TRT] Tactic: 6815743 time 0.0496749 [04/19/2021-12:48:34] [V] [TRT] Tactic: 6946815 time 0.0568359 [04/19/2021-12:48:34] [V] [TRT] Tactic: 7012351 time 0.0189455 [04/19/2021-12:48:34] [V] [TRT] Tactic: 7077887 time 0.0288801 [04/19/2021-12:48:34] [V] [TRT] Tactic: 7143423 time 0.0474024 [04/19/2021-12:48:34] [V] [TRT] Tactic: 7208959 time 0.0500846 [04/19/2021-12:48:34] [V] [TRT] Tactic: 7340031 time 0.0288931 [04/19/2021-12:48:34] [V] [TRT] Tactic: 7405567 time 0.0290167 [04/19/2021-12:48:34] [V] [TRT] Tactic: 7536639 time 0.075065 [04/19/2021-12:48:34] [V] [TRT] Tactic: 7602175 time 0.0567121 [04/19/2021-12:48:34] [V] [TRT] Tactic: 7733247 time 0.0355469 [04/19/2021-12:48:34] [V] [TRT] Tactic: 7798783 time 0.0441407 [04/19/2021-12:48:34] [V] [TRT] Tactic: 8191999 time 0.0335611 [04/19/2021-12:48:34] [V] [TRT] Tactic: 8257535 time 0.0242839 [04/19/2021-12:48:34] [V] [TRT] Tactic: 8323071 time 0.0426887 [04/19/2021-12:48:34] [V] [TRT] Tactic: 8650751 time 0.0566991 [04/19/2021-12:48:34] [V] [TRT] Tactic: 8716287 time 0.0289192 [04/19/2021-12:48:34] [V] [TRT] Tactic: 9109503 time 0.0182164 [04/19/2021-12:48:34] [V] [TRT] Tactic: 9568255 time 0.0243165 [04/19/2021-12:48:34] [V] [TRT] Tactic: 9895935 time 0.042754 [04/19/2021-12:48:34] [V] [TRT] Tactic: 10223615 time 0.0990886 [04/19/2021-12:48:34] [V] [TRT] Tactic: 10354687 time 0.0219857 [04/19/2021-12:48:34] [V] [TRT] Tactic: 10551295 time 0.0589125 [04/19/2021-12:48:34] [V] [TRT] Tactic: 10747903 time 0.0357877 [04/19/2021-12:48:34] [V] [TRT] Tactic: 10944511 time 0.0590235 [04/19/2021-12:48:34] [V] [TRT] Fastest Tactic: 4259839 Time: 0.0173893 [04/19/2021-12:48:34] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd (CaskConvolution) [04/19/2021-12:48:34] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:34] [V] [TRT] Tactic: 1062367460111450758 time 0.0890885 [04/19/2021-12:48:34] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:34] [V] [TRT] Tactic: 4501471010995462441 time 0.0999545 [04/19/2021-12:48:34] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:34] [V] [TRT] Tactic: 5137655947464784826 time 0.0662695 [04/19/2021-12:48:34] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:34] [V] [TRT] Tactic: 5326823351883942011 time 0.0968034 [04/19/2021-12:48:34] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:34] [V] [TRT] Tactic: 6645123197870846056 time 0.072578 [04/19/2021-12:48:34] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:48:34] [V] [TRT] Tactic: -6576203419454146580 time 0.068457 [04/19/2021-12:48:34] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:34] [V] [TRT] Tactic: -3456450830548107839 time 0.0734895 [04/19/2021-12:48:34] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:34] [V] [TRT] Tactic: -410470605513481746 time 0.097806 [04/19/2021-12:48:34] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:48:34] [V] [TRT] Tactic: -37215280111360163 time 0.0653581 [04/19/2021-12:48:34] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.0653581 [04/19/2021-12:48:34] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd (CudaConvolution) [04/19/2021-12:48:34] [V] [TRT] Tactic: 0 time 0.07431 [04/19/2021-12:48:34] [V] [TRT] Tactic: 2 time 0.16791 [04/19/2021-12:48:34] [V] [TRT] Tactic: 5 time 0.455749 [04/19/2021-12:48:34] [V] [TRT] Tactic: 57 time 0.0666732 [04/19/2021-12:48:34] [V] [TRT] Fastest Tactic: 57 Time: 0.0666732 [04/19/2021-12:48:34] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd (CudaDepthwiseConvolution) [04/19/2021-12:48:34] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/19/2021-12:48:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 4259839 [04/19/2021-12:48:34] [V] [TRT] [04/19/2021-12:48:34] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:48:34] [V] [TRT] Tactic: 1002 time 0.0081315 [04/19/2021-12:48:34] [V] [TRT] Tactic: 0 time 0.00559238 [04/19/2021-12:48:34] [V] [TRT] Fastest Tactic: 0 Time: 0.00559238 [04/19/2021-12:48:34] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:48:35] [V] [TRT] Tactic: 1002 time 0.00799462 [04/19/2021-12:48:35] [V] [TRT] Tactic: 0 time 0.00541663 [04/19/2021-12:48:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00541663 [04/19/2021-12:48:35] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:48:35] [V] [TRT] Tactic: 1002 time 0.00809225 [04/19/2021-12:48:35] [V] [TRT] Tactic: 0 time 0.00542963 [04/19/2021-12:48:35] [V] [TRT] Fastest Tactic: 0 Time: 0.00542963 [04/19/2021-12:48:35] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,20) -> Float(1,1,1,20) *************** [04/19/2021-12:48:35] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/mul) (PointWise) [04/19/2021-12:48:35] [V] [TRT] Tactic: 128 time 0.00570325 [04/19/2021-12:48:35] [V] [TRT] Tactic: 256 time 0.005794 [04/19/2021-12:48:35] [V] [TRT] Tactic: 512 time 0.00576162 [04/19/2021-12:48:35] [V] [TRT] Fastest Tactic: 128 Time: 0.00570325 [04/19/2021-12:48:35] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/mul) (PointWiseV2) [04/19/2021-12:48:35] [V] [TRT] Tactic: 0 time 0.00398425 [04/19/2021-12:48:35] [V] [TRT] Tactic: 1 time 0.0047395 [04/19/2021-12:48:35] [V] [TRT] Tactic: 2 time 0.00449875 [04/19/2021-12:48:35] [V] [TRT] Tactic: 3 time 0.005664 [04/19/2021-12:48:35] [V] [TRT] Tactic: 4 time 0.00510425 [04/19/2021-12:48:35] [V] [TRT] Tactic: 5 time 0.00425125 [04/19/2021-12:48:35] [V] [TRT] Tactic: 6 time 0.005638 [04/19/2021-12:48:35] [V] [TRT] Tactic: 7 time 0.00563813 [04/19/2021-12:48:35] [V] [TRT] Tactic: 8 time 0.00517575 [04/19/2021-12:48:35] [V] [TRT] Tactic: 9 time 0.004863 [04/19/2021-12:48:35] [V] [TRT] Tactic: 28 time 0.00382775 [04/19/2021-12:48:35] [V] [TRT] Fastest Tactic: 28 Time: 0.00382775 [04/19/2021-12:48:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [04/19/2021-12:48:35] [V] [TRT] [04/19/2021-12:48:35] [V] [TRT] *************** Autotuning format combination: Float(1,1,1:32,1) -> Float(1,1,1:32,1) *************** [04/19/2021-12:48:35] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/mul) (PointWise) [04/19/2021-12:48:35] [V] [TRT] Tactic: 128 time 0.0056965 [04/19/2021-12:48:35] [V] [TRT] Tactic: 256 time 0.005729 [04/19/2021-12:48:35] [V] [TRT] Tactic: 512 time 0.00567712 [04/19/2021-12:48:35] [V] [TRT] Tactic: -32 time 0.00570337 [04/19/2021-12:48:35] [V] [TRT] Tactic: -64 time 0.00572262 [04/19/2021-12:48:35] [V] [TRT] Tactic: -128 time 0.00574237 [04/19/2021-12:48:35] [V] [TRT] Fastest Tactic: 512 Time: 0.00567712 [04/19/2021-12:48:35] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/mul) (PointWiseV2) [04/19/2021-12:48:35] [V] [TRT] Tactic: 24 time 0.00570338 [04/19/2021-12:48:35] [V] [TRT] Tactic: 25 time 0.00558588 [04/19/2021-12:48:35] [V] [TRT] Tactic: 26 time 0.005625 [04/19/2021-12:48:35] [V] [TRT] Tactic: 27 time 0.00796875 [04/19/2021-12:48:35] [V] [TRT] Tactic: 31 time 0.00562525 [04/19/2021-12:48:35] [V] [TRT] Fastest Tactic: 25 Time: 0.00558588 [04/19/2021-12:48:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [04/19/2021-12:48:35] [V] [TRT] [04/19/2021-12:48:35] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,20) -> Float(1,1,1,480) *************** [04/19/2021-12:48:35] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:35] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:35] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:35] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:35] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:35] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:48:35] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:35] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:35] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:48:35] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd (FusedConvActConvolution) [04/19/2021-12:48:35] [V] [TRT] Tactic: 589823 time 0.0183922 [04/19/2021-12:48:35] [V] [TRT] Tactic: 655359 time 0.015111 [04/19/2021-12:48:35] [V] [TRT] Tactic: 1310719 time 0.0316864 [04/19/2021-12:48:35] [V] [TRT] Tactic: 1376255 time 0.0128974 [04/19/2021-12:48:35] [V] [TRT] Tactic: 1507327 time 0.0208981 [04/19/2021-12:48:35] [V] [TRT] Tactic: 1900543 time 0.0174542 [04/19/2021-12:48:35] [V] [TRT] Tactic: 2162687 time 0.0150716 [04/19/2021-12:48:35] [V] [TRT] Tactic: 2293759 time 0.0128388 [04/19/2021-12:48:35] [V] [TRT] Tactic: 2359295 time 0.0171615 [04/19/2021-12:48:35] [V] [TRT] Tactic: 2686975 time 0.0128191 [04/19/2021-12:48:35] [V] [TRT] Tactic: 3080191 time 0.0122332 [04/19/2021-12:48:35] [V] [TRT] Tactic: 3342335 time 0.0205534 [04/19/2021-12:48:35] [V] [TRT] Tactic: 3407871 time 0.0128061 [04/19/2021-12:48:35] [V] [TRT] Tactic: 3670015 time 0.0196419 [04/19/2021-12:48:35] [V] [TRT] Tactic: 3932159 time 0.0103775 [04/19/2021-12:48:35] [V] [TRT] Tactic: 4521983 time 0.017194 [04/19/2021-12:48:35] [V] [TRT] Tactic: 4980735 time 0.0193944 [04/19/2021-12:48:35] [V] [TRT] Tactic: 5242879 time 0.0105145 [04/19/2021-12:48:35] [V] [TRT] Tactic: 5570559 time 0.0194791 [04/19/2021-12:48:35] [V] [TRT] Tactic: 5701631 time 0.0109241 [04/19/2021-12:48:35] [V] [TRT] Tactic: 5767167 time 0.00809263 [04/19/2021-12:48:36] [V] [TRT] Tactic: 5832703 time 0.010612 [04/19/2021-12:48:36] [V] [TRT] Tactic: 6029311 time 0.0112042 [04/19/2021-12:48:36] [V] [TRT] Tactic: 6422527 time 0.0101629 [04/19/2021-12:48:36] [V] [TRT] Tactic: 6815743 time 0.0105011 [04/19/2021-12:48:36] [V] [TRT] Tactic: 7143423 time 0.00810525 [04/19/2021-12:48:36] [V] [TRT] Tactic: 7208959 time 0.0104493 [04/19/2021-12:48:36] [V] [TRT] Tactic: 7536639 time 0.00937488 [04/19/2021-12:48:36] [V] [TRT] Tactic: 10223615 time 0.0127735 [04/19/2021-12:48:36] [V] [TRT] Tactic: 10551295 time 0.0105271 [04/19/2021-12:48:36] [V] [TRT] Tactic: 10944511 time 0.0193684 [04/19/2021-12:48:36] [V] [TRT] Fastest Tactic: 5767167 Time: 0.00809263 [04/19/2021-12:48:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd (CaskConvolution) [04/19/2021-12:48:36] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:36] [V] [TRT] Tactic: 1062367460111450758 time 0.0547851 [04/19/2021-12:48:36] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:36] [V] [TRT] Tactic: 4501471010995462441 time 0.0437435 [04/19/2021-12:48:36] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:36] [V] [TRT] Tactic: 5137655947464784826 time 0.0438477 [04/19/2021-12:48:36] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:36] [V] [TRT] Tactic: 5326823351883942011 time 0.0418879 [04/19/2021-12:48:36] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:36] [V] [TRT] Tactic: 6645123197870846056 time 0.0443621 [04/19/2021-12:48:36] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:48:36] [V] [TRT] Tactic: -6576203419454146580 time 0.0511849 [04/19/2021-12:48:36] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:36] [V] [TRT] Tactic: -3456450830548107839 time 0.0522589 [04/19/2021-12:48:36] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:36] [V] [TRT] Tactic: -410470605513481746 time 0.0437567 [04/19/2021-12:48:36] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:48:36] [V] [TRT] Tactic: -37215280111360163 time 0.0432098 [04/19/2021-12:48:36] [V] [TRT] Fastest Tactic: 5326823351883942011 Time: 0.0418879 [04/19/2021-12:48:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd (CudaConvolution) [04/19/2021-12:48:36] [V] [TRT] Tactic: 0 time 0.0216144 [04/19/2021-12:48:36] [V] [TRT] Tactic: 2 time 0.0297983 [04/19/2021-12:48:36] [V] [TRT] Tactic: 5 time 0.686316 [04/19/2021-12:48:36] [V] [TRT] Tactic: 57 time 0.0220184 [04/19/2021-12:48:36] [V] [TRT] Fastest Tactic: 0 Time: 0.0216144 [04/19/2021-12:48:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd (CudaDepthwiseConvolution) [04/19/2021-12:48:36] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/19/2021-12:48:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 5767167 [04/19/2021-12:48:36] [V] [TRT] [04/19/2021-12:48:36] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:48:36] [V] [TRT] Tactic: 1002 time 0.01028 [04/19/2021-12:48:36] [V] [TRT] Tactic: 0 time 0.00562488 [04/19/2021-12:48:36] [V] [TRT] Fastest Tactic: 0 Time: 0.00562488 [04/19/2021-12:48:36] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:48:36] [V] [TRT] Tactic: 1002 time 0.0104364 [04/19/2021-12:48:36] [V] [TRT] Tactic: 0 time 0.0056315 [04/19/2021-12:48:37] [V] [TRT] Fastest Tactic: 0 Time: 0.0056315 [04/19/2021-12:48:37] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:48:37] [V] [TRT] Tactic: 1002 time 0.0144725 [04/19/2021-12:48:37] [V] [TRT] Tactic: 0 time 0.00645187 [04/19/2021-12:48:37] [V] [TRT] Fastest Tactic: 0 Time: 0.00645187 [04/19/2021-12:48:37] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,480), Float(1,14,196,94080) -> Float(1,14,196,94080) *************** [04/19/2021-12:48:37] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4b_se_excite/mul) (PointWise) [04/19/2021-12:48:37] [V] [TRT] Tactic: 128 time 0.259876 [04/19/2021-12:48:37] [V] [TRT] Tactic: 256 time 0.26054 [04/19/2021-12:48:37] [V] [TRT] Tactic: 512 time 0.262162 [04/19/2021-12:48:38] [V] [TRT] Tactic: -32 time 0.26541 [04/19/2021-12:48:38] [V] [TRT] Tactic: -64 time 0.302936 [04/19/2021-12:48:38] [V] [TRT] Tactic: -128 time 0.298353 [04/19/2021-12:48:38] [V] [TRT] Fastest Tactic: 128 Time: 0.259876 [04/19/2021-12:48:38] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4b_se_excite/mul) (PointWiseV2) [04/19/2021-12:48:38] [V] [TRT] Tactic: 0 time 0.375599 [04/19/2021-12:48:38] [V] [TRT] Tactic: 1 time 0.450566 [04/19/2021-12:48:38] [V] [TRT] Tactic: 2 time 0.412129 [04/19/2021-12:48:38] [V] [TRT] Tactic: 3 time 0.530137 [04/19/2021-12:48:38] [V] [TRT] Tactic: 4 time 0.544733 [04/19/2021-12:48:38] [V] [TRT] Tactic: 5 time 0.467382 [04/19/2021-12:48:38] [V] [TRT] Tactic: 6 time 0.712689 [04/19/2021-12:48:38] [V] [TRT] Tactic: 7 time 0.668809 [04/19/2021-12:48:38] [V] [TRT] Tactic: 8 time 0.680508 [04/19/2021-12:48:38] [V] [TRT] Tactic: 9 time 0.593177 [04/19/2021-12:48:38] [V] [TRT] Tactic: 28 time 0.1661 [04/19/2021-12:48:38] [V] [TRT] Fastest Tactic: 28 Time: 0.1661 [04/19/2021-12:48:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [04/19/2021-12:48:38] [V] [TRT] [04/19/2021-12:48:38] [V] [TRT] *************** Autotuning format combination: Float(1,1,1:32,15), Float(1,14,196:32,2940) -> Float(1,14,196:32,2940) *************** [04/19/2021-12:48:38] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4b_se_excite/mul) (PointWise) [04/19/2021-12:48:38] [V] [TRT] Tactic: 128 time 0.295677 [04/19/2021-12:48:38] [V] [TRT] Tactic: 256 time 0.296999 [04/19/2021-12:48:38] [V] [TRT] Tactic: 512 time 0.298412 [04/19/2021-12:48:38] [V] [TRT] Tactic: -32 time 0.347396 [04/19/2021-12:48:38] [V] [TRT] Tactic: -64 time 0.351178 [04/19/2021-12:48:38] [V] [TRT] Tactic: -128 time 0.351393 [04/19/2021-12:48:38] [V] [TRT] Fastest Tactic: 128 Time: 0.295677 [04/19/2021-12:48:38] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4b_se_excite/mul) (PointWiseV2) [04/19/2021-12:48:38] [V] [TRT] Tactic: 24 time 0.0919206 [04/19/2021-12:48:38] [V] [TRT] Tactic: 25 time 0.086159 [04/19/2021-12:48:38] [V] [TRT] Tactic: 26 time 0.087741 [04/19/2021-12:48:38] [V] [TRT] Tactic: 27 time 0.0956315 [04/19/2021-12:48:38] [V] [TRT] Tactic: 31 time 0.0845116 [04/19/2021-12:48:38] [V] [TRT] Fastest Tactic: 31 Time: 0.0845116 [04/19/2021-12:48:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [04/19/2021-12:48:38] [V] [TRT] [04/19/2021-12:48:38] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,94080), Float(1,14,196,15680) -> Float(1,14,196,15680) *************** [04/19/2021-12:48:38] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block4b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:38] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block4b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:38] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block4b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:38] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block4b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:38] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block4b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:38] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block4b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:48:38] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block4b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:38] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block4b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:38] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block4b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:48:38] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block4b_add/add (CaskConvolution) [04/19/2021-12:48:38] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block4b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:38] [V] [TRT] Tactic: 1062367460111450758 time 0.189505 [04/19/2021-12:48:38] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block4b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:38] [V] [TRT] Tactic: 4501471010995462441 time 0.1786 [04/19/2021-12:48:38] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block4b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:38] [V] [TRT] Tactic: 5137655947464784826 time 0.187669 [04/19/2021-12:48:38] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block4b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:38] [V] [TRT] Tactic: 5326823351883942011 time 0.171328 [04/19/2021-12:48:38] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block4b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:38] [V] [TRT] Tactic: 6645123197870846056 time 0.195599 [04/19/2021-12:48:38] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block4b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:48:38] [V] [TRT] Tactic: -6576203419454146580 time 0.172435 [04/19/2021-12:48:38] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block4b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:38] [V] [TRT] Tactic: -3456450830548107839 time 0.179928 [04/19/2021-12:48:38] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block4b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:38] [V] [TRT] Tactic: -410470605513481746 time 0.175202 [04/19/2021-12:48:38] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block4b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:48:38] [V] [TRT] Tactic: -37215280111360163 time 0.185319 [04/19/2021-12:48:38] [V] [TRT] Fastest Tactic: 5326823351883942011 Time: 0.171328 [04/19/2021-12:48:38] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block4b_add/add (CudaConvolution) [04/19/2021-12:48:38] [V] [TRT] Tactic: 0 time 0.328353 [04/19/2021-12:48:38] [V] [TRT] Tactic: 2 time 0.448737 [04/19/2021-12:48:38] [V] [TRT] Tactic: 5 time 2.4 [04/19/2021-12:48:38] [V] [TRT] Tactic: 57 time 0.273678 [04/19/2021-12:48:38] [V] [TRT] Fastest Tactic: 57 Time: 0.273678 [04/19/2021-12:48:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5326823351883942011 [04/19/2021-12:48:38] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block4b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:38] [V] [TRT] [04/19/2021-12:48:38] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block4b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:38] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block4b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:38] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block4b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:38] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block4b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:38] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block4b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:38] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block4b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:48:38] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block4b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:38] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block4b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:38] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block4b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:48:38] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block4b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:38] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,15680) -> Float(1,14,196,94080) *************** [04/19/2021-12:48:39] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,94080) -> Float(1,14,196,94080) *************** [04/19/2021-12:48:39] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4c_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4c_expand_activation/mul) (PointWise) [04/19/2021-12:48:39] [V] [TRT] Tactic: 128 time 0.209616 [04/19/2021-12:48:39] [V] [TRT] Tactic: 256 time 0.210319 [04/19/2021-12:48:39] [V] [TRT] Tactic: 512 time 0.212253 [04/19/2021-12:48:39] [V] [TRT] Tactic: -32 time 0.228132 [04/19/2021-12:48:39] [V] [TRT] Tactic: -64 time 0.228457 [04/19/2021-12:48:39] [V] [TRT] Tactic: -128 time 0.220312 [04/19/2021-12:48:39] [V] [TRT] Fastest Tactic: 128 Time: 0.209616 [04/19/2021-12:48:39] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4c_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4c_expand_activation/mul) (PointWiseV2) [04/19/2021-12:48:39] [V] [TRT] Tactic: 0 time 0.100605 [04/19/2021-12:48:39] [V] [TRT] Tactic: 1 time 0.0756446 [04/19/2021-12:48:39] [V] [TRT] Tactic: 2 time 0.0694009 [04/19/2021-12:48:39] [V] [TRT] Tactic: 3 time 0.0646355 [04/19/2021-12:48:39] [V] [TRT] Tactic: 4 time 0.0510939 [04/19/2021-12:48:39] [V] [TRT] Tactic: 5 time 0.0529689 [04/19/2021-12:48:39] [V] [TRT] Tactic: 6 time 0.0614391 [04/19/2021-12:48:39] [V] [TRT] Tactic: 7 time 0.0477867 [04/19/2021-12:48:39] [V] [TRT] Tactic: 8 time 0.044108 [04/19/2021-12:48:39] [V] [TRT] Tactic: 9 time 0.045358 [04/19/2021-12:48:39] [V] [TRT] Tactic: 28 time 0.0977734 [04/19/2021-12:48:39] [V] [TRT] Fastest Tactic: 8 Time: 0.044108 [04/19/2021-12:48:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [04/19/2021-12:48:39] [V] [TRT] [04/19/2021-12:48:39] [V] [TRT] *************** Autotuning format combination: Float(1,14,196:32,2940) -> Float(1,14,196:32,2940) *************** [04/19/2021-12:48:39] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4c_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4c_expand_activation/mul) (PointWise) [04/19/2021-12:48:39] [V] [TRT] Tactic: 128 time 0.209714 [04/19/2021-12:48:39] [V] [TRT] Tactic: 256 time 0.210026 [04/19/2021-12:48:39] [V] [TRT] Tactic: 512 time 0.212031 [04/19/2021-12:48:39] [V] [TRT] Tactic: -32 time 0.227448 [04/19/2021-12:48:39] [V] [TRT] Tactic: -64 time 0.228223 [04/19/2021-12:48:39] [V] [TRT] Tactic: -128 time 0.220052 [04/19/2021-12:48:39] [V] [TRT] Fastest Tactic: 128 Time: 0.209714 [04/19/2021-12:48:39] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4c_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4c_expand_activation/mul) (PointWiseV2) [04/19/2021-12:48:39] [V] [TRT] Tactic: 24 time 0.0734375 [04/19/2021-12:48:39] [V] [TRT] Tactic: 25 time 0.0666864 [04/19/2021-12:48:39] [V] [TRT] Tactic: 26 time 0.0661848 [04/19/2021-12:48:39] [V] [TRT] Tactic: 27 time 0.0690433 [04/19/2021-12:48:39] [V] [TRT] Tactic: 31 time 0.0736914 [04/19/2021-12:48:39] [V] [TRT] Fastest Tactic: 26 Time: 0.0661848 [04/19/2021-12:48:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [04/19/2021-12:48:39] [V] [TRT] [04/19/2021-12:48:39] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,94080) -> Float(1,14,196,94080) *************** [04/19/2021-12:48:39] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,94080) -> Float(1,14,196,94080) *************** [04/19/2021-12:48:39] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4c_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4c_activation/mul) (PointWise) [04/19/2021-12:48:39] [V] [TRT] Tactic: 128 time 0.209414 [04/19/2021-12:48:39] [V] [TRT] Tactic: 256 time 0.210241 [04/19/2021-12:48:39] [V] [TRT] Tactic: 512 time 0.211992 [04/19/2021-12:48:39] [V] [TRT] Tactic: -32 time 0.22737 [04/19/2021-12:48:39] [V] [TRT] Tactic: -64 time 0.227747 [04/19/2021-12:48:39] [V] [TRT] Tactic: -128 time 0.220254 [04/19/2021-12:48:39] [V] [TRT] Fastest Tactic: 128 Time: 0.209414 [04/19/2021-12:48:39] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4c_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4c_activation/mul) (PointWiseV2) [04/19/2021-12:48:39] [V] [TRT] Tactic: 0 time 0.100514 [04/19/2021-12:48:39] [V] [TRT] Tactic: 1 time 0.0755728 [04/19/2021-12:48:39] [V] [TRT] Tactic: 2 time 0.0690821 [04/19/2021-12:48:39] [V] [TRT] Tactic: 3 time 0.0641016 [04/19/2021-12:48:40] [V] [TRT] Tactic: 4 time 0.051452 [04/19/2021-12:48:40] [V] [TRT] Tactic: 5 time 0.0527083 [04/19/2021-12:48:40] [V] [TRT] Tactic: 6 time 0.0612566 [04/19/2021-12:48:40] [V] [TRT] Tactic: 7 time 0.0485222 [04/19/2021-12:48:40] [V] [TRT] Tactic: 8 time 0.0439584 [04/19/2021-12:48:40] [V] [TRT] Tactic: 9 time 0.0455144 [04/19/2021-12:48:40] [V] [TRT] Tactic: 28 time 0.0977929 [04/19/2021-12:48:40] [V] [TRT] Fastest Tactic: 8 Time: 0.0439584 [04/19/2021-12:48:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [04/19/2021-12:48:40] [V] [TRT] [04/19/2021-12:48:40] [V] [TRT] *************** Autotuning format combination: Float(1,14,196:32,2940) -> Float(1,14,196:32,2940) *************** [04/19/2021-12:48:40] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4c_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4c_activation/mul) (PointWise) [04/19/2021-12:48:40] [V] [TRT] Tactic: 128 time 0.209147 [04/19/2021-12:48:40] [V] [TRT] Tactic: 256 time 0.209902 [04/19/2021-12:48:40] [V] [TRT] Tactic: 512 time 0.211843 [04/19/2021-12:48:40] [V] [TRT] Tactic: -32 time 0.228268 [04/19/2021-12:48:40] [V] [TRT] Tactic: -64 time 0.228021 [04/19/2021-12:48:40] [V] [TRT] Tactic: -128 time 0.220091 [04/19/2021-12:48:40] [V] [TRT] Fastest Tactic: 128 Time: 0.209147 [04/19/2021-12:48:40] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4c_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4c_activation/mul) (PointWiseV2) [04/19/2021-12:48:40] [V] [TRT] Tactic: 24 time 0.0727149 [04/19/2021-12:48:40] [V] [TRT] Tactic: 25 time 0.0670118 [04/19/2021-12:48:40] [V] [TRT] Tactic: 26 time 0.0659636 [04/19/2021-12:48:40] [V] [TRT] Tactic: 27 time 0.068893 [04/19/2021-12:48:40] [V] [TRT] Tactic: 31 time 0.0730666 [04/19/2021-12:48:40] [V] [TRT] Fastest Tactic: 26 Time: 0.0659636 [04/19/2021-12:48:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [04/19/2021-12:48:40] [V] [TRT] [04/19/2021-12:48:40] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,94080) -> Float(1,480) *************** [04/19/2021-12:48:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block4c_se_squeeze/Mean (Reduce) [04/19/2021-12:48:40] [V] [TRT] Tactic: 1 time 0.3939 [04/19/2021-12:48:40] [V] [TRT] Tactic: 3 time 0.138737 [04/19/2021-12:48:40] [V] [TRT] Tactic: 6 time 0.607363 [04/19/2021-12:48:40] [V] [TRT] Fastest Tactic: 3 Time: 0.138737 [04/19/2021-12:48:40] [V] [TRT] *************** Autotuning format combination: Float(1,480) -> Float(1,1,1,480) *************** [04/19/2021-12:48:40] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block4c_se_reshape/Reshape + StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/BiasAdd__175 (Shuffle) [04/19/2021-12:48:40] [V] [TRT] Tactic: 0 time 0.00331362 [04/19/2021-12:48:40] [V] [TRT] Tactic: 1 time 0.0111654 [04/19/2021-12:48:40] [V] [TRT] Fastest Tactic: 0 Time: 0.00331362 [04/19/2021-12:48:40] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,480) -> Float(1,1,1,20) *************** [04/19/2021-12:48:40] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,20) -> Float(1,1,1,20) *************** [04/19/2021-12:48:40] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/mul) (PointWise) [04/19/2021-12:48:40] [V] [TRT] Tactic: 128 time 0.0057355 [04/19/2021-12:48:40] [V] [TRT] Tactic: 256 time 0.00574237 [04/19/2021-12:48:40] [V] [TRT] Tactic: 512 time 0.00574863 [04/19/2021-12:48:40] [V] [TRT] Fastest Tactic: 128 Time: 0.0057355 [04/19/2021-12:48:40] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/mul) (PointWiseV2) [04/19/2021-12:48:40] [V] [TRT] Tactic: 0 time 0.00365238 [04/19/2021-12:48:41] [V] [TRT] Tactic: 1 time 0.00451163 [04/19/2021-12:48:41] [V] [TRT] Tactic: 2 time 0.00453787 [04/19/2021-12:48:41] [V] [TRT] Tactic: 3 time 0.00545587 [04/19/2021-12:48:41] [V] [TRT] Tactic: 4 time 0.0050975 [04/19/2021-12:48:41] [V] [TRT] Tactic: 5 time 0.00404963 [04/19/2021-12:48:41] [V] [TRT] Tactic: 6 time 0.005638 [04/19/2021-12:48:41] [V] [TRT] Tactic: 7 time 0.00563788 [04/19/2021-12:48:41] [V] [TRT] Tactic: 8 time 0.00557287 [04/19/2021-12:48:41] [V] [TRT] Tactic: 9 time 0.00450537 [04/19/2021-12:48:41] [V] [TRT] Tactic: 28 time 0.00369138 [04/19/2021-12:48:41] [V] [TRT] Fastest Tactic: 0 Time: 0.00365238 [04/19/2021-12:48:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [04/19/2021-12:48:41] [V] [TRT] [04/19/2021-12:48:41] [V] [TRT] *************** Autotuning format combination: Float(1,1,1:32,1) -> Float(1,1,1:32,1) *************** [04/19/2021-12:48:41] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/mul) (PointWise) [04/19/2021-12:48:41] [V] [TRT] Tactic: 128 time 0.00578125 [04/19/2021-12:48:41] [V] [TRT] Tactic: 256 time 0.00572925 [04/19/2021-12:48:41] [V] [TRT] Tactic: 512 time 0.00573575 [04/19/2021-12:48:41] [V] [TRT] Tactic: -32 time 0.005742 [04/19/2021-12:48:41] [V] [TRT] Tactic: -64 time 0.00575525 [04/19/2021-12:48:41] [V] [TRT] Tactic: -128 time 0.00567038 [04/19/2021-12:48:41] [V] [TRT] Fastest Tactic: -128 Time: 0.00567038 [04/19/2021-12:48:41] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/mul) (PointWiseV2) [04/19/2021-12:48:41] [V] [TRT] Tactic: 24 time 0.00563138 [04/19/2021-12:48:41] [V] [TRT] Tactic: 25 time 0.00559888 [04/19/2021-12:48:41] [V] [TRT] Tactic: 26 time 0.005625 [04/19/2021-12:48:41] [V] [TRT] Tactic: 27 time 0.00798187 [04/19/2021-12:48:41] [V] [TRT] Tactic: 31 time 0.00562525 [04/19/2021-12:48:41] [V] [TRT] Fastest Tactic: 25 Time: 0.00559888 [04/19/2021-12:48:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [04/19/2021-12:48:41] [V] [TRT] [04/19/2021-12:48:41] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,20) -> Float(1,1,1,480) *************** [04/19/2021-12:48:41] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,480), Float(1,14,196,94080) -> Float(1,14,196,94080) *************** [04/19/2021-12:48:41] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4c_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4c_se_excite/mul) (PointWise) [04/19/2021-12:48:41] [V] [TRT] Tactic: 128 time 0.259818 [04/19/2021-12:48:41] [V] [TRT] Tactic: 256 time 0.259889 [04/19/2021-12:48:41] [V] [TRT] Tactic: 512 time 0.261367 [04/19/2021-12:48:41] [V] [TRT] Tactic: -32 time 0.264694 [04/19/2021-12:48:41] [V] [TRT] Tactic: -64 time 0.302767 [04/19/2021-12:48:41] [V] [TRT] Tactic: -128 time 0.298711 [04/19/2021-12:48:41] [V] [TRT] Fastest Tactic: 128 Time: 0.259818 [04/19/2021-12:48:41] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4c_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4c_se_excite/mul) (PointWiseV2) [04/19/2021-12:48:41] [V] [TRT] Tactic: 0 time 0.376237 [04/19/2021-12:48:41] [V] [TRT] Tactic: 1 time 0.450521 [04/19/2021-12:48:41] [V] [TRT] Tactic: 2 time 0.411979 [04/19/2021-12:48:41] [V] [TRT] Tactic: 3 time 0.529961 [04/19/2021-12:48:41] [V] [TRT] Tactic: 4 time 0.545325 [04/19/2021-12:48:42] [V] [TRT] Tactic: 5 time 0.467279 [04/19/2021-12:48:42] [V] [TRT] Tactic: 6 time 0.713437 [04/19/2021-12:48:42] [V] [TRT] Tactic: 7 time 0.66862 [04/19/2021-12:48:42] [V] [TRT] Tactic: 8 time 0.680378 [04/19/2021-12:48:42] [V] [TRT] Tactic: 9 time 0.592975 [04/19/2021-12:48:42] [V] [TRT] Tactic: 28 time 0.165677 [04/19/2021-12:48:42] [V] [TRT] Fastest Tactic: 28 Time: 0.165677 [04/19/2021-12:48:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [04/19/2021-12:48:42] [V] [TRT] [04/19/2021-12:48:42] [V] [TRT] *************** Autotuning format combination: Float(1,1,1:32,15), Float(1,14,196:32,2940) -> Float(1,14,196:32,2940) *************** [04/19/2021-12:48:42] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4c_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4c_se_excite/mul) (PointWise) [04/19/2021-12:48:42] [V] [TRT] Tactic: 128 time 0.295619 [04/19/2021-12:48:42] [V] [TRT] Tactic: 256 time 0.296901 [04/19/2021-12:48:42] [V] [TRT] Tactic: 512 time 0.298288 [04/19/2021-12:48:42] [V] [TRT] Tactic: -32 time 0.348073 [04/19/2021-12:48:42] [V] [TRT] Tactic: -64 time 0.351029 [04/19/2021-12:48:42] [V] [TRT] Tactic: -128 time 0.351426 [04/19/2021-12:48:42] [V] [TRT] Fastest Tactic: 128 Time: 0.295619 [04/19/2021-12:48:42] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block4c_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4c_se_excite/mul) (PointWiseV2) [04/19/2021-12:48:42] [V] [TRT] Tactic: 24 time 0.0932617 [04/19/2021-12:48:42] [V] [TRT] Tactic: 25 time 0.0864452 [04/19/2021-12:48:42] [V] [TRT] Tactic: 26 time 0.087031 [04/19/2021-12:48:42] [V] [TRT] Tactic: 27 time 0.0956901 [04/19/2021-12:48:42] [V] [TRT] Tactic: 31 time 0.0849349 [04/19/2021-12:48:42] [V] [TRT] Fastest Tactic: 31 Time: 0.0849349 [04/19/2021-12:48:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [04/19/2021-12:48:42] [V] [TRT] [04/19/2021-12:48:42] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,94080), Float(1,14,196,15680) -> Float(1,14,196,15680) *************** [04/19/2021-12:48:42] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,15680) -> Float(1,14,196,94080) *************** [04/19/2021-12:48:42] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,94080) -> Float(1,14,196,94080) *************** [04/19/2021-12:48:42] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5a_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5a_expand_activation/mul) (PointWise) [04/19/2021-12:48:42] [V] [TRT] Tactic: 128 time 0.209219 [04/19/2021-12:48:42] [V] [TRT] Tactic: 256 time 0.209421 [04/19/2021-12:48:42] [V] [TRT] Tactic: 512 time 0.21237 [04/19/2021-12:48:42] [V] [TRT] Tactic: -32 time 0.227949 [04/19/2021-12:48:42] [V] [TRT] Tactic: -64 time 0.227311 [04/19/2021-12:48:42] [V] [TRT] Tactic: -128 time 0.219831 [04/19/2021-12:48:42] [V] [TRT] Fastest Tactic: 128 Time: 0.209219 [04/19/2021-12:48:42] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5a_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5a_expand_activation/mul) (PointWiseV2) [04/19/2021-12:48:42] [V] [TRT] Tactic: 0 time 0.10082 [04/19/2021-12:48:42] [V] [TRT] Tactic: 1 time 0.0755469 [04/19/2021-12:48:42] [V] [TRT] Tactic: 2 time 0.0689259 [04/19/2021-12:48:42] [V] [TRT] Tactic: 3 time 0.0641147 [04/19/2021-12:48:42] [V] [TRT] Tactic: 4 time 0.0511654 [04/19/2021-12:48:42] [V] [TRT] Tactic: 5 time 0.0532095 [04/19/2021-12:48:42] [V] [TRT] Tactic: 6 time 0.0607812 [04/19/2021-12:48:42] [V] [TRT] Tactic: 7 time 0.0482228 [04/19/2021-12:48:42] [V] [TRT] Tactic: 8 time 0.0438606 [04/19/2021-12:48:42] [V] [TRT] Tactic: 9 time 0.045449 [04/19/2021-12:48:42] [V] [TRT] Tactic: 28 time 0.0982031 [04/19/2021-12:48:42] [V] [TRT] Fastest Tactic: 8 Time: 0.0438606 [04/19/2021-12:48:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [04/19/2021-12:48:42] [V] [TRT] [04/19/2021-12:48:43] [V] [TRT] *************** Autotuning format combination: Float(1,14,196:32,2940) -> Float(1,14,196:32,2940) *************** [04/19/2021-12:48:43] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5a_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5a_expand_activation/mul) (PointWise) [04/19/2021-12:48:43] [V] [TRT] Tactic: 128 time 0.209407 [04/19/2021-12:48:43] [V] [TRT] Tactic: 256 time 0.209596 [04/19/2021-12:48:43] [V] [TRT] Tactic: 512 time 0.212318 [04/19/2021-12:48:43] [V] [TRT] Tactic: -32 time 0.228288 [04/19/2021-12:48:43] [V] [TRT] Tactic: -64 time 0.226908 [04/19/2021-12:48:43] [V] [TRT] Tactic: -128 time 0.220423 [04/19/2021-12:48:43] [V] [TRT] Fastest Tactic: 128 Time: 0.209407 [04/19/2021-12:48:43] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5a_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5a_expand_activation/mul) (PointWiseV2) [04/19/2021-12:48:43] [V] [TRT] Tactic: 24 time 0.0724739 [04/19/2021-12:48:43] [V] [TRT] Tactic: 25 time 0.0660548 [04/19/2021-12:48:43] [V] [TRT] Tactic: 26 time 0.06528 [04/19/2021-12:48:43] [V] [TRT] Tactic: 27 time 0.0685612 [04/19/2021-12:48:43] [V] [TRT] Tactic: 31 time 0.0721744 [04/19/2021-12:48:43] [V] [TRT] Fastest Tactic: 26 Time: 0.06528 [04/19/2021-12:48:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [04/19/2021-12:48:43] [V] [TRT] [04/19/2021-12:48:43] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,94080) -> Float(1,14,196,94080) *************** [04/19/2021-12:48:43] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:43] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [04/19/2021-12:48:43] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:43] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:43] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:43] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [04/19/2021-12:48:43] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [04/19/2021-12:48:43] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:43] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block5a_dwconv/depthwise (FusedConvActConvolution) [04/19/2021-12:48:43] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/19/2021-12:48:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block5a_dwconv/depthwise (CaskConvolution) [04/19/2021-12:48:43] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:43] [V] [TRT] Tactic: 1062367460111450758 time 13.6533 [04/19/2021-12:48:43] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [04/19/2021-12:48:44] [V] [TRT] Tactic: 4337000649858996379 time 13.7467 [04/19/2021-12:48:44] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:44] [V] [TRT] Tactic: 4501471010995462441 time 12.1652 [04/19/2021-12:48:44] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:44] [V] [TRT] Tactic: 5137655947464784826 time 12.8227 [04/19/2021-12:48:44] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:45] [V] [TRT] Tactic: 6645123197870846056 time 13.789 [04/19/2021-12:48:45] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [04/19/2021-12:48:45] [V] [TRT] Tactic: -9137461792520977713 time 14.6895 [04/19/2021-12:48:45] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [04/19/2021-12:48:45] [V] [TRT] Tactic: -6092040395344634144 time 14.1941 [04/19/2021-12:48:45] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:46] [V] [TRT] Tactic: -3456450830548107839 time 14.5869 [04/19/2021-12:48:46] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:46] [V] [TRT] Tactic: -410470605513481746 time 13.2584 [04/19/2021-12:48:46] [V] [TRT] Fastest Tactic: 4501471010995462441 Time: 12.1652 [04/19/2021-12:48:46] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block5a_dwconv/depthwise (CudaConvolution) [04/19/2021-12:48:46] [V] [TRT] Tactic: 0 time 0.710905 [04/19/2021-12:48:46] [V] [TRT] Tactic: 2 time 0.711803 [04/19/2021-12:48:49] [V] [TRT] Tactic: 5 time 151.228 [04/19/2021-12:48:49] [V] [TRT] Tactic: 57 time 0.711133 [04/19/2021-12:48:49] [V] [TRT] Fastest Tactic: 0 Time: 0.710905 [04/19/2021-12:48:49] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block5a_dwconv/depthwise (CudaDepthwiseConvolution) [04/19/2021-12:48:49] [V] [TRT] Tactic: -1 time 0.73834 [04/19/2021-12:48:49] [V] [TRT] Fastest Tactic: -1 Time: 0.73834 [04/19/2021-12:48:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 0 [04/19/2021-12:48:49] [V] [TRT] [04/19/2021-12:48:49] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,94080) -> Float(1,14,196,94080) *************** [04/19/2021-12:48:49] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5a_activation/mul) (PointWise) [04/19/2021-12:48:49] [V] [TRT] Tactic: 128 time 0.209427 [04/19/2021-12:48:49] [V] [TRT] Tactic: 256 time 0.209746 [04/19/2021-12:48:49] [V] [TRT] Tactic: 512 time 0.212233 [04/19/2021-12:48:49] [V] [TRT] Tactic: -32 time 0.228392 [04/19/2021-12:48:49] [V] [TRT] Tactic: -64 time 0.227252 [04/19/2021-12:48:49] [V] [TRT] Tactic: -128 time 0.220241 [04/19/2021-12:48:49] [V] [TRT] Fastest Tactic: 128 Time: 0.209427 [04/19/2021-12:48:49] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5a_activation/mul) (PointWiseV2) [04/19/2021-12:48:49] [V] [TRT] Tactic: 0 time 0.100677 [04/19/2021-12:48:49] [V] [TRT] Tactic: 1 time 0.0754881 [04/19/2021-12:48:49] [V] [TRT] Tactic: 2 time 0.0691536 [04/19/2021-12:48:49] [V] [TRT] Tactic: 3 time 0.0646418 [04/19/2021-12:48:49] [V] [TRT] Tactic: 4 time 0.0513609 [04/19/2021-12:48:49] [V] [TRT] Tactic: 5 time 0.0532356 [04/19/2021-12:48:49] [V] [TRT] Tactic: 6 time 0.0609895 [04/19/2021-12:48:49] [V] [TRT] Tactic: 7 time 0.048431 [04/19/2021-12:48:49] [V] [TRT] Tactic: 8 time 0.0438736 [04/19/2021-12:48:49] [V] [TRT] Tactic: 9 time 0.045853 [04/19/2021-12:48:49] [V] [TRT] Tactic: 28 time 0.0977086 [04/19/2021-12:48:49] [V] [TRT] Fastest Tactic: 8 Time: 0.0438736 [04/19/2021-12:48:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [04/19/2021-12:48:49] [V] [TRT] [04/19/2021-12:48:49] [V] [TRT] *************** Autotuning format combination: Float(1,14,196:32,2940) -> Float(1,14,196:32,2940) *************** [04/19/2021-12:48:49] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5a_activation/mul) (PointWise) [04/19/2021-12:48:49] [V] [TRT] Tactic: 128 time 0.209212 [04/19/2021-12:48:49] [V] [TRT] Tactic: 256 time 0.210091 [04/19/2021-12:48:49] [V] [TRT] Tactic: 512 time 0.211745 [04/19/2021-12:48:49] [V] [TRT] Tactic: -32 time 0.228555 [04/19/2021-12:48:49] [V] [TRT] Tactic: -64 time 0.227142 [04/19/2021-12:48:49] [V] [TRT] Tactic: -128 time 0.220788 [04/19/2021-12:48:49] [V] [TRT] Fastest Tactic: 128 Time: 0.209212 [04/19/2021-12:48:49] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5a_activation/mul) (PointWiseV2) [04/19/2021-12:48:49] [V] [TRT] Tactic: 24 time 0.0729491 [04/19/2021-12:48:49] [V] [TRT] Tactic: 25 time 0.0672852 [04/19/2021-12:48:49] [V] [TRT] Tactic: 26 time 0.0661002 [04/19/2021-12:48:49] [V] [TRT] Tactic: 27 time 0.0695052 [04/19/2021-12:48:49] [V] [TRT] Tactic: 31 time 0.072702 [04/19/2021-12:48:49] [V] [TRT] Fastest Tactic: 26 Time: 0.0661002 [04/19/2021-12:48:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [04/19/2021-12:48:49] [V] [TRT] [04/19/2021-12:48:49] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,94080) -> Float(1,480) *************** [04/19/2021-12:48:49] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block5a_se_squeeze/Mean (Reduce) [04/19/2021-12:48:49] [V] [TRT] Tactic: 1 time 0.39127 [04/19/2021-12:48:49] [V] [TRT] Tactic: 3 time 0.138926 [04/19/2021-12:48:49] [V] [TRT] Tactic: 6 time 0.608353 [04/19/2021-12:48:49] [V] [TRT] Fastest Tactic: 3 Time: 0.138926 [04/19/2021-12:48:49] [V] [TRT] *************** Autotuning format combination: Float(1,480) -> Float(1,1,1,480) *************** [04/19/2021-12:48:49] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block5a_se_reshape/Reshape + StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/BiasAdd__195 (Shuffle) [04/19/2021-12:48:50] [V] [TRT] Tactic: 0 time 0.00327488 [04/19/2021-12:48:50] [V] [TRT] Tactic: 1 time 0.011478 [04/19/2021-12:48:50] [V] [TRT] Fastest Tactic: 0 Time: 0.00327488 [04/19/2021-12:48:50] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,480) -> Float(1,1,1,20) *************** [04/19/2021-12:48:50] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,20) -> Float(1,1,1,20) *************** [04/19/2021-12:48:50] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/mul) (PointWise) [04/19/2021-12:48:50] [V] [TRT] Tactic: 128 time 0.005755 [04/19/2021-12:48:50] [V] [TRT] Tactic: 256 time 0.00578125 [04/19/2021-12:48:50] [V] [TRT] Tactic: 512 time 0.005664 [04/19/2021-12:48:50] [V] [TRT] Fastest Tactic: 512 Time: 0.005664 [04/19/2021-12:48:50] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/mul) (PointWiseV2) [04/19/2021-12:48:50] [V] [TRT] Tactic: 0 time 0.00397787 [04/19/2021-12:48:50] [V] [TRT] Tactic: 1 time 0.00401063 [04/19/2021-12:48:50] [V] [TRT] Tactic: 2 time 0.00427737 [04/19/2021-12:48:50] [V] [TRT] Tactic: 3 time 0.00557937 [04/19/2021-12:48:50] [V] [TRT] Tactic: 4 time 0.00464863 [04/19/2021-12:48:50] [V] [TRT] Tactic: 5 time 0.004974 [04/19/2021-12:48:50] [V] [TRT] Tactic: 6 time 0.00566388 [04/19/2021-12:48:50] [V] [TRT] Tactic: 7 time 0.005586 [04/19/2021-12:48:50] [V] [TRT] Tactic: 8 time 0.0051365 [04/19/2021-12:48:50] [V] [TRT] Tactic: 9 time 0.00451187 [04/19/2021-12:48:50] [V] [TRT] Tactic: 28 time 0.00395175 [04/19/2021-12:48:50] [V] [TRT] Fastest Tactic: 28 Time: 0.00395175 [04/19/2021-12:48:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [04/19/2021-12:48:50] [V] [TRT] [04/19/2021-12:48:50] [V] [TRT] *************** Autotuning format combination: Float(1,1,1:32,1) -> Float(1,1,1:32,1) *************** [04/19/2021-12:48:50] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/mul) (PointWise) [04/19/2021-12:48:50] [V] [TRT] Tactic: 128 time 0.00579425 [04/19/2021-12:48:50] [V] [TRT] Tactic: 256 time 0.00573563 [04/19/2021-12:48:50] [V] [TRT] Tactic: 512 time 0.005742 [04/19/2021-12:48:50] [V] [TRT] Tactic: -32 time 0.00569 [04/19/2021-12:48:50] [V] [TRT] Tactic: -64 time 0.005625 [04/19/2021-12:48:50] [V] [TRT] Tactic: -128 time 0.00574875 [04/19/2021-12:48:50] [V] [TRT] Fastest Tactic: -64 Time: 0.005625 [04/19/2021-12:48:50] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/mul) (PointWiseV2) [04/19/2021-12:48:50] [V] [TRT] Tactic: 24 time 0.00568975 [04/19/2021-12:48:50] [V] [TRT] Tactic: 25 time 0.00560525 [04/19/2021-12:48:50] [V] [TRT] Tactic: 26 time 0.0056315 [04/19/2021-12:48:50] [V] [TRT] Tactic: 27 time 0.0079555 [04/19/2021-12:48:50] [V] [TRT] Tactic: 31 time 0.0055925 [04/19/2021-12:48:50] [V] [TRT] Fastest Tactic: 31 Time: 0.0055925 [04/19/2021-12:48:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [04/19/2021-12:48:50] [V] [TRT] [04/19/2021-12:48:50] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,20) -> Float(1,1,1,480) *************** [04/19/2021-12:48:51] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,480), Float(1,14,196,94080) -> Float(1,14,196,94080) *************** [04/19/2021-12:48:51] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5a_se_excite/mul) (PointWise) [04/19/2021-12:48:51] [V] [TRT] Tactic: 128 time 0.259967 [04/19/2021-12:48:51] [V] [TRT] Tactic: 256 time 0.260468 [04/19/2021-12:48:51] [V] [TRT] Tactic: 512 time 0.261882 [04/19/2021-12:48:51] [V] [TRT] Tactic: -32 time 0.264831 [04/19/2021-12:48:51] [V] [TRT] Tactic: -64 time 0.303496 [04/19/2021-12:48:51] [V] [TRT] Tactic: -128 time 0.298652 [04/19/2021-12:48:51] [V] [TRT] Fastest Tactic: 128 Time: 0.259967 [04/19/2021-12:48:51] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5a_se_excite/mul) (PointWiseV2) [04/19/2021-12:48:51] [V] [TRT] Tactic: 0 time 0.375625 [04/19/2021-12:48:51] [V] [TRT] Tactic: 1 time 0.450254 [04/19/2021-12:48:51] [V] [TRT] Tactic: 2 time 0.411751 [04/19/2021-12:48:51] [V] [TRT] Tactic: 3 time 0.530176 [04/19/2021-12:48:51] [V] [TRT] Tactic: 4 time 0.545293 [04/19/2021-12:48:51] [V] [TRT] Tactic: 5 time 0.467617 [04/19/2021-12:48:51] [V] [TRT] Tactic: 6 time 0.712988 [04/19/2021-12:48:51] [V] [TRT] Tactic: 7 time 0.668939 [04/19/2021-12:48:51] [V] [TRT] Tactic: 8 time 0.680677 [04/19/2021-12:48:51] [V] [TRT] Tactic: 9 time 0.593125 [04/19/2021-12:48:51] [V] [TRT] Tactic: 28 time 0.165937 [04/19/2021-12:48:51] [V] [TRT] Fastest Tactic: 28 Time: 0.165937 [04/19/2021-12:48:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [04/19/2021-12:48:51] [V] [TRT] [04/19/2021-12:48:51] [V] [TRT] *************** Autotuning format combination: Float(1,1,1:32,15), Float(1,14,196:32,2940) -> Float(1,14,196:32,2940) *************** [04/19/2021-12:48:51] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5a_se_excite/mul) (PointWise) [04/19/2021-12:48:51] [V] [TRT] Tactic: 128 time 0.295866 [04/19/2021-12:48:51] [V] [TRT] Tactic: 256 time 0.296256 [04/19/2021-12:48:51] [V] [TRT] Tactic: 512 time 0.298874 [04/19/2021-12:48:51] [V] [TRT] Tactic: -32 time 0.348359 [04/19/2021-12:48:51] [V] [TRT] Tactic: -64 time 0.351934 [04/19/2021-12:48:51] [V] [TRT] Tactic: -128 time 0.35222 [04/19/2021-12:48:51] [V] [TRT] Fastest Tactic: 128 Time: 0.295866 [04/19/2021-12:48:51] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5a_se_excite/mul) (PointWiseV2) [04/19/2021-12:48:51] [V] [TRT] Tactic: 24 time 0.0942967 [04/19/2021-12:48:51] [V] [TRT] Tactic: 25 time 0.0867251 [04/19/2021-12:48:51] [V] [TRT] Tactic: 26 time 0.088509 [04/19/2021-12:48:51] [V] [TRT] Tactic: 27 time 0.0964714 [04/19/2021-12:48:51] [V] [TRT] Tactic: 31 time 0.0855663 [04/19/2021-12:48:51] [V] [TRT] Fastest Tactic: 31 Time: 0.0855663 [04/19/2021-12:48:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [04/19/2021-12:48:51] [V] [TRT] [04/19/2021-12:48:51] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,94080) -> Float(1,14,196,21952) *************** [04/19/2021-12:48:51] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:51] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:51] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:51] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:51] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:51] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:48:51] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:51] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:51] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:48:51] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D (FusedConvActConvolution) [04/19/2021-12:48:51] [V] [TRT] Tactic: 589823 time 0.395247 [04/19/2021-12:48:51] [V] [TRT] Tactic: 655359 time 0.398086 [04/19/2021-12:48:51] [V] [TRT] Tactic: 786431 time 0.382441 [04/19/2021-12:48:51] [V] [TRT] Tactic: 851967 time 0.362838 [04/19/2021-12:48:52] [V] [TRT] Tactic: 1179647 time 0.384388 [04/19/2021-12:48:52] [V] [TRT] Tactic: 1310719 time 0.954264 [04/19/2021-12:48:52] [V] [TRT] Tactic: 1376255 time 0.277422 [04/19/2021-12:48:52] [V] [TRT] Tactic: 1441791 time 0.48429 [04/19/2021-12:48:52] [V] [TRT] Tactic: 1507327 time 0.425873 [04/19/2021-12:48:52] [V] [TRT] Tactic: 1638399 time 0.556361 [04/19/2021-12:48:52] [V] [TRT] Tactic: 1835007 time 0.392708 [04/19/2021-12:48:52] [V] [TRT] Tactic: 1900543 time 0.420573 [04/19/2021-12:48:52] [V] [TRT] Tactic: 2097151 time 0.43748 [04/19/2021-12:48:52] [V] [TRT] Tactic: 2162687 time 0.27502 [04/19/2021-12:48:52] [V] [TRT] Tactic: 2293759 time 0.284824 [04/19/2021-12:48:52] [V] [TRT] Tactic: 2359295 time 0.400508 [04/19/2021-12:48:52] [V] [TRT] Tactic: 2686975 time 0.421973 [04/19/2021-12:48:52] [V] [TRT] Tactic: 3080191 time 0.326087 [04/19/2021-12:48:52] [V] [TRT] Tactic: 3342335 time 0.349968 [04/19/2021-12:48:52] [V] [TRT] Tactic: 3407871 time 0.294941 [04/19/2021-12:48:52] [V] [TRT] Tactic: 3538943 time 0.30735 [04/19/2021-12:48:52] [V] [TRT] Tactic: 3670015 time 0.403255 [04/19/2021-12:48:52] [V] [TRT] Tactic: 3932159 time 0.382018 [04/19/2021-12:48:52] [V] [TRT] Tactic: 3997695 time 0.396315 [04/19/2021-12:48:52] [V] [TRT] Tactic: 4063231 time 0.312265 [04/19/2021-12:48:52] [V] [TRT] Tactic: 4194303 time 0.387988 [04/19/2021-12:48:52] [V] [TRT] Tactic: 4259839 time 0.451452 [04/19/2021-12:48:52] [V] [TRT] Tactic: 4325375 time 0.468138 [04/19/2021-12:48:52] [V] [TRT] Tactic: 4521983 time 0.50013 [04/19/2021-12:48:52] [V] [TRT] Tactic: 4587519 time 0.423945 [04/19/2021-12:48:52] [V] [TRT] Tactic: 4653055 time 0.401029 [04/19/2021-12:48:52] [V] [TRT] Tactic: 4915199 time 0.3625 [04/19/2021-12:48:52] [V] [TRT] Tactic: 4980735 time 0.487949 [04/19/2021-12:48:52] [V] [TRT] Tactic: 5177343 time 0.456009 [04/19/2021-12:48:52] [V] [TRT] Tactic: 5242879 time 0.262812 [04/19/2021-12:48:52] [V] [TRT] Tactic: 5373951 time 0.438346 [04/19/2021-12:48:52] [V] [TRT] Tactic: 5439487 time 0.398398 [04/19/2021-12:48:52] [V] [TRT] Tactic: 5570559 time 0.336862 [04/19/2021-12:48:53] [V] [TRT] Tactic: 5636095 time 0.312246 [04/19/2021-12:48:53] [V] [TRT] Tactic: 5701631 time 0.401074 [04/19/2021-12:48:53] [V] [TRT] Tactic: 5767167 time 0.536276 [04/19/2021-12:48:53] [V] [TRT] Tactic: 5832703 time 0.29013 [04/19/2021-12:48:53] [V] [TRT] Tactic: 5898239 time 0.300358 [04/19/2021-12:48:53] [V] [TRT] Tactic: 6029311 time 0.265215 [04/19/2021-12:48:53] [V] [TRT] Tactic: 6225919 time 0.273659 [04/19/2021-12:48:53] [V] [TRT] Tactic: 6291455 time 0.386133 [04/19/2021-12:48:53] [V] [TRT] Tactic: 6422527 time 0.304785 [04/19/2021-12:48:53] [V] [TRT] Tactic: 6750207 time 0.359824 [04/19/2021-12:48:53] [V] [TRT] Tactic: 6815743 time 0.272936 [04/19/2021-12:48:53] [V] [TRT] Tactic: 6946815 time 0.501908 [04/19/2021-12:48:53] [V] [TRT] Tactic: 7012351 time 0.438288 [04/19/2021-12:48:53] [V] [TRT] Tactic: 7077887 time 0.301888 [04/19/2021-12:48:53] [V] [TRT] Tactic: 7143423 time 0.571191 [04/19/2021-12:48:53] [V] [TRT] Tactic: 7208959 time 0.359746 [04/19/2021-12:48:53] [V] [TRT] Tactic: 7340031 time 0.319544 [04/19/2021-12:48:53] [V] [TRT] Tactic: 7405567 time 0.351549 [04/19/2021-12:48:53] [V] [TRT] Tactic: 7536639 time 0.37696 [04/19/2021-12:48:53] [V] [TRT] Tactic: 7602175 time 0.474225 [04/19/2021-12:48:53] [V] [TRT] Tactic: 7733247 time 0.301029 [04/19/2021-12:48:53] [V] [TRT] Tactic: 7798783 time 0.38237 [04/19/2021-12:48:53] [V] [TRT] Tactic: 8191999 time 0.564297 [04/19/2021-12:48:53] [V] [TRT] Tactic: 8257535 time 0.374805 [04/19/2021-12:48:53] [V] [TRT] Tactic: 8323071 time 0.3778 [04/19/2021-12:48:53] [V] [TRT] Tactic: 8650751 time 0.567513 [04/19/2021-12:48:53] [V] [TRT] Tactic: 8716287 time 0.297051 [04/19/2021-12:48:53] [V] [TRT] Tactic: 9109503 time 0.469707 [04/19/2021-12:48:53] [V] [TRT] Tactic: 9568255 time 0.3636 [04/19/2021-12:48:53] [V] [TRT] Tactic: 9895935 time 0.387539 [04/19/2021-12:48:53] [V] [TRT] Tactic: 10223615 time 0.422448 [04/19/2021-12:48:53] [V] [TRT] Tactic: 10354687 time 0.442129 [04/19/2021-12:48:53] [V] [TRT] Tactic: 10551295 time 0.322233 [04/19/2021-12:48:53] [V] [TRT] Tactic: 10747903 time 0.280046 [04/19/2021-12:48:53] [V] [TRT] Tactic: 10944511 time 0.488138 [04/19/2021-12:48:53] [V] [TRT] Fastest Tactic: 5242879 Time: 0.262812 [04/19/2021-12:48:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D (CaskConvolution) [04/19/2021-12:48:53] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:53] [V] [TRT] Tactic: 1062367460111450758 time 0.262396 [04/19/2021-12:48:53] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:53] [V] [TRT] Tactic: 4501471010995462441 time 0.177415 [04/19/2021-12:48:53] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:53] [V] [TRT] Tactic: 5137655947464784826 time 0.189056 [04/19/2021-12:48:53] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:54] [V] [TRT] Tactic: 5326823351883942011 time 0.170365 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:54] [V] [TRT] Tactic: 6645123197870846056 time 0.193099 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:48:54] [V] [TRT] Tactic: -6576203419454146580 time 0.217493 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:54] [V] [TRT] Tactic: -3456450830548107839 time 0.237096 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:54] [V] [TRT] Tactic: -410470605513481746 time 0.173763 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:48:54] [V] [TRT] Tactic: -37215280111360163 time 0.183203 [04/19/2021-12:48:54] [V] [TRT] Fastest Tactic: 5326823351883942011 Time: 0.170365 [04/19/2021-12:48:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D (CudaConvolution) [04/19/2021-12:48:54] [V] [TRT] Tactic: 0 time 0.38045 [04/19/2021-12:48:54] [V] [TRT] Tactic: 2 time 0.481725 [04/19/2021-12:48:54] [V] [TRT] Tactic: 5 time 4.26286 [04/19/2021-12:48:54] [V] [TRT] Tactic: 57 time 0.308789 [04/19/2021-12:48:54] [V] [TRT] Fastest Tactic: 57 Time: 0.308789 [04/19/2021-12:48:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D (CudaDepthwiseConvolution) [04/19/2021-12:48:54] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/19/2021-12:48:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5326823351883942011 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:54] [V] [TRT] [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:54] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,21952) -> Float(1,14,196,131712) *************** [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:48:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D (FusedConvActConvolution) [04/19/2021-12:48:54] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/19/2021-12:48:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D (CaskConvolution) [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:54] [V] [TRT] Tactic: 1062367460111450758 time 0.328483 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:54] [V] [TRT] Tactic: 4501471010995462441 time 0.293216 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:54] [V] [TRT] Tactic: 5137655947464784826 time 0.267507 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:54] [V] [TRT] Tactic: 5326823351883942011 time 0.280449 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:54] [V] [TRT] Tactic: 6645123197870846056 time 0.272246 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:48:54] [V] [TRT] Tactic: -6576203419454146580 time 0.291836 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:54] [V] [TRT] Tactic: -3456450830548107839 time 0.307682 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:54] [V] [TRT] Tactic: -410470605513481746 time 0.288555 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:48:54] [V] [TRT] Tactic: -37215280111360163 time 0.260553 [04/19/2021-12:48:54] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.260553 [04/19/2021-12:48:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D (CudaConvolution) [04/19/2021-12:48:54] [V] [TRT] Tactic: 0 time 0.586836 [04/19/2021-12:48:54] [V] [TRT] Tactic: 2 time 0.595013 [04/19/2021-12:48:54] [V] [TRT] Tactic: 5 time 6.52407 [04/19/2021-12:48:54] [V] [TRT] Tactic: 57 time 0.502761 [04/19/2021-12:48:54] [V] [TRT] Fastest Tactic: 57 Time: 0.502761 [04/19/2021-12:48:54] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D (CudaDepthwiseConvolution) [04/19/2021-12:48:54] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/19/2021-12:48:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:48:54] [V] [TRT] [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:48:54] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:48:54] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:48:54] [V] [TRT] Tactic: 1002 time 0.322539 [04/19/2021-12:48:54] [V] [TRT] Tactic: 0 time 0.301979 [04/19/2021-12:48:54] [V] [TRT] Fastest Tactic: 0 Time: 0.301979 [04/19/2021-12:48:54] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:48:54] [V] [TRT] Tactic: 1002 time 0.321933 [04/19/2021-12:48:54] [V] [TRT] Tactic: 0 time 0.301764 [04/19/2021-12:48:54] [V] [TRT] Fastest Tactic: 0 Time: 0.301764 [04/19/2021-12:48:54] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:48:54] [V] [TRT] Tactic: 1002 time 0.443711 [04/19/2021-12:48:54] [V] [TRT] Tactic: 0 time 0.227468 [04/19/2021-12:48:54] [V] [TRT] Fastest Tactic: 0 Time: 0.227468 [04/19/2021-12:48:54] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,131712) -> Float(1,14,196,131712) *************** [04/19/2021-12:48:54] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5b_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5b_expand_activation/mul) (PointWise) [04/19/2021-12:48:54] [V] [TRT] Tactic: 128 time 0.289785 [04/19/2021-12:48:54] [V] [TRT] Tactic: 256 time 0.290553 [04/19/2021-12:48:54] [V] [TRT] Tactic: 512 time 0.293815 [04/19/2021-12:48:54] [V] [TRT] Tactic: -32 time 0.310436 [04/19/2021-12:48:54] [V] [TRT] Tactic: -64 time 0.300892 [04/19/2021-12:48:54] [V] [TRT] Tactic: -128 time 0.299427 [04/19/2021-12:48:54] [V] [TRT] Fastest Tactic: 128 Time: 0.289785 [04/19/2021-12:48:54] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5b_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5b_expand_activation/mul) (PointWiseV2) [04/19/2021-12:48:54] [V] [TRT] Tactic: 0 time 0.138106 [04/19/2021-12:48:54] [V] [TRT] Tactic: 1 time 0.103008 [04/19/2021-12:48:54] [V] [TRT] Tactic: 2 time 0.0945509 [04/19/2021-12:48:54] [V] [TRT] Tactic: 3 time 0.0876369 [04/19/2021-12:48:54] [V] [TRT] Tactic: 4 time 0.069258 [04/19/2021-12:48:54] [V] [TRT] Tactic: 5 time 0.0723505 [04/19/2021-12:48:54] [V] [TRT] Tactic: 6 time 0.0846355 [04/19/2021-12:48:54] [V] [TRT] Tactic: 7 time 0.0648501 [04/19/2021-12:48:54] [V] [TRT] Tactic: 8 time 0.0590949 [04/19/2021-12:48:54] [V] [TRT] Tactic: 9 time 0.0608397 [04/19/2021-12:48:54] [V] [TRT] Tactic: 28 time 0.134258 [04/19/2021-12:48:54] [V] [TRT] Fastest Tactic: 8 Time: 0.0590949 [04/19/2021-12:48:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [04/19/2021-12:48:54] [V] [TRT] [04/19/2021-12:48:55] [V] [TRT] *************** Autotuning format combination: Float(1,14,196:32,4116) -> Float(1,14,196:32,4116) *************** [04/19/2021-12:48:55] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5b_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5b_expand_activation/mul) (PointWise) [04/19/2021-12:48:55] [V] [TRT] Tactic: 128 time 0.28972 [04/19/2021-12:48:55] [V] [TRT] Tactic: 256 time 0.290567 [04/19/2021-12:48:55] [V] [TRT] Tactic: 512 time 0.293548 [04/19/2021-12:48:55] [V] [TRT] Tactic: -32 time 0.310859 [04/19/2021-12:48:55] [V] [TRT] Tactic: -64 time 0.301341 [04/19/2021-12:48:55] [V] [TRT] Tactic: -128 time 0.29987 [04/19/2021-12:48:55] [V] [TRT] Fastest Tactic: 128 Time: 0.28972 [04/19/2021-12:48:55] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5b_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5b_expand_activation/mul) (PointWiseV2) [04/19/2021-12:48:55] [V] [TRT] Tactic: 24 time 0.100716 [04/19/2021-12:48:55] [V] [TRT] Tactic: 25 time 0.0915692 [04/19/2021-12:48:55] [V] [TRT] Tactic: 26 time 0.0920119 [04/19/2021-12:48:55] [V] [TRT] Tactic: 27 time 0.0918164 [04/19/2021-12:48:55] [V] [TRT] Tactic: 31 time 0.100312 [04/19/2021-12:48:55] [V] [TRT] Fastest Tactic: 25 Time: 0.0915692 [04/19/2021-12:48:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [04/19/2021-12:48:55] [V] [TRT] [04/19/2021-12:48:55] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,131712) -> Float(1,14,196,131712) *************** [04/19/2021-12:48:55] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:55] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [04/19/2021-12:48:55] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:55] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:55] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:55] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [04/19/2021-12:48:55] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [04/19/2021-12:48:55] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:55] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:48:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block5b_dwconv/depthwise (FusedConvActConvolution) [04/19/2021-12:48:55] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/19/2021-12:48:55] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block5b_dwconv/depthwise (CaskConvolution) [04/19/2021-12:48:55] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:48:56] [V] [TRT] Tactic: 1062367460111450758 time 27.1235 [04/19/2021-12:48:56] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [04/19/2021-12:48:56] [V] [TRT] Tactic: 4337000649858996379 time 19.7449 [04/19/2021-12:48:56] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:48:57] [V] [TRT] Tactic: 4501471010995462441 time 18.9607 [04/19/2021-12:48:57] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:48:57] [V] [TRT] Tactic: 5137655947464784826 time 18.6967 [04/19/2021-12:48:57] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:48:58] [V] [TRT] Tactic: 6645123197870846056 time 20.0659 [04/19/2021-12:48:58] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [04/19/2021-12:48:58] [V] [TRT] Tactic: -9137461792520977713 time 20.2357 [04/19/2021-12:48:58] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [04/19/2021-12:48:59] [V] [TRT] Tactic: -6092040395344634144 time 19.8495 [04/19/2021-12:48:59] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:48:59] [V] [TRT] Tactic: -3456450830548107839 time 20.482 [04/19/2021-12:48:59] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:49:00] [V] [TRT] Tactic: -410470605513481746 time 18.6625 [04/19/2021-12:49:00] [V] [TRT] Fastest Tactic: -410470605513481746 Time: 18.6625 [04/19/2021-12:49:00] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block5b_dwconv/depthwise (CudaConvolution) [04/19/2021-12:49:00] [V] [TRT] Tactic: 0 time 0.991048 [04/19/2021-12:49:00] [V] [TRT] Tactic: 2 time 0.990208 [04/19/2021-12:49:03] [V] [TRT] Tactic: 5 time 211.72 [04/19/2021-12:49:03] [V] [TRT] Tactic: 57 time 0.991875 [04/19/2021-12:49:03] [V] [TRT] Fastest Tactic: 2 Time: 0.990208 [04/19/2021-12:49:03] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block5b_dwconv/depthwise (CudaDepthwiseConvolution) [04/19/2021-12:49:03] [V] [TRT] Tactic: -1 time 1.03029 [04/19/2021-12:49:03] [V] [TRT] Fastest Tactic: -1 Time: 1.03029 [04/19/2021-12:49:03] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 2 [04/19/2021-12:49:03] [V] [TRT] [04/19/2021-12:49:03] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,131712) -> Float(1,14,196,131712) *************** [04/19/2021-12:49:04] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5b_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5b_activation/mul) (PointWise) [04/19/2021-12:49:04] [V] [TRT] Tactic: 128 time 0.289928 [04/19/2021-12:49:04] [V] [TRT] Tactic: 256 time 0.290612 [04/19/2021-12:49:04] [V] [TRT] Tactic: 512 time 0.293926 [04/19/2021-12:49:04] [V] [TRT] Tactic: -32 time 0.311081 [04/19/2021-12:49:04] [V] [TRT] Tactic: -64 time 0.301777 [04/19/2021-12:49:04] [V] [TRT] Tactic: -128 time 0.299954 [04/19/2021-12:49:04] [V] [TRT] Fastest Tactic: 128 Time: 0.289928 [04/19/2021-12:49:04] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5b_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5b_activation/mul) (PointWiseV2) [04/19/2021-12:49:04] [V] [TRT] Tactic: 0 time 0.13832 [04/19/2021-12:49:04] [V] [TRT] Tactic: 1 time 0.10332 [04/19/2021-12:49:04] [V] [TRT] Tactic: 2 time 0.0938544 [04/19/2021-12:49:04] [V] [TRT] Tactic: 3 time 0.0873892 [04/19/2021-12:49:04] [V] [TRT] Tactic: 4 time 0.0694599 [04/19/2021-12:49:04] [V] [TRT] Tactic: 5 time 0.0723566 [04/19/2021-12:49:04] [V] [TRT] Tactic: 6 time 0.084017 [04/19/2021-12:49:04] [V] [TRT] Tactic: 7 time 0.0648504 [04/19/2021-12:49:04] [V] [TRT] Tactic: 8 time 0.0584506 [04/19/2021-12:49:04] [V] [TRT] Tactic: 9 time 0.0611264 [04/19/2021-12:49:04] [V] [TRT] Tactic: 28 time 0.134564 [04/19/2021-12:49:04] [V] [TRT] Fastest Tactic: 8 Time: 0.0584506 [04/19/2021-12:49:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [04/19/2021-12:49:04] [V] [TRT] [04/19/2021-12:49:04] [V] [TRT] *************** Autotuning format combination: Float(1,14,196:32,4116) -> Float(1,14,196:32,4116) *************** [04/19/2021-12:49:04] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5b_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5b_activation/mul) (PointWise) [04/19/2021-12:49:04] [V] [TRT] Tactic: 128 time 0.289792 [04/19/2021-12:49:04] [V] [TRT] Tactic: 256 time 0.290508 [04/19/2021-12:49:04] [V] [TRT] Tactic: 512 time 0.293958 [04/19/2021-12:49:04] [V] [TRT] Tactic: -32 time 0.310944 [04/19/2021-12:49:04] [V] [TRT] Tactic: -64 time 0.301296 [04/19/2021-12:49:04] [V] [TRT] Tactic: -128 time 0.299603 [04/19/2021-12:49:04] [V] [TRT] Fastest Tactic: 128 Time: 0.289792 [04/19/2021-12:49:04] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5b_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5b_activation/mul) (PointWiseV2) [04/19/2021-12:49:04] [V] [TRT] Tactic: 24 time 0.100306 [04/19/2021-12:49:04] [V] [TRT] Tactic: 25 time 0.0907616 [04/19/2021-12:49:04] [V] [TRT] Tactic: 26 time 0.0916991 [04/19/2021-12:49:04] [V] [TRT] Tactic: 27 time 0.0923306 [04/19/2021-12:49:04] [V] [TRT] Tactic: 31 time 0.100026 [04/19/2021-12:49:04] [V] [TRT] Fastest Tactic: 25 Time: 0.0907616 [04/19/2021-12:49:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [04/19/2021-12:49:04] [V] [TRT] [04/19/2021-12:49:04] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:49:04] [V] [TRT] Tactic: 1002 time 0.443848 [04/19/2021-12:49:04] [V] [TRT] Tactic: 0 time 0.228105 [04/19/2021-12:49:04] [V] [TRT] Fastest Tactic: 0 Time: 0.228105 [04/19/2021-12:49:04] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,131712) -> Float(1,672) *************** [04/19/2021-12:49:04] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block5b_se_squeeze/Mean (Reduce) [04/19/2021-12:49:04] [V] [TRT] Tactic: 1 time 0.545495 [04/19/2021-12:49:04] [V] [TRT] Tactic: 3 time 0.191471 [04/19/2021-12:49:04] [V] [TRT] Tactic: 6 time 0.79679 [04/19/2021-12:49:04] [V] [TRT] Fastest Tactic: 3 Time: 0.191471 [04/19/2021-12:49:04] [V] [TRT] *************** Autotuning format combination: Float(1,672) -> Float(1,1,1,672) *************** [04/19/2021-12:49:04] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block5b_se_reshape/Reshape + StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd__215 (Shuffle) [04/19/2021-12:49:04] [V] [TRT] Tactic: 0 time 0.0033205 [04/19/2021-12:49:04] [V] [TRT] Tactic: 1 time 0.0114584 [04/19/2021-12:49:04] [V] [TRT] Fastest Tactic: 0 Time: 0.0033205 [04/19/2021-12:49:04] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,672) -> Float(1,1,1,28) *************** [04/19/2021-12:49:04] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:49:04] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:49:04] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:49:04] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:49:04] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:49:04] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:49:04] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:49:04] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:49:04] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:49:04] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd (FusedConvActConvolution) [04/19/2021-12:49:04] [V] [TRT] Tactic: 589823 time 0.198769 [04/19/2021-12:49:04] [V] [TRT] Tactic: 655359 time 0.139024 [04/19/2021-12:49:04] [V] [TRT] Tactic: 786431 time 0.0605141 [04/19/2021-12:49:04] [V] [TRT] Tactic: 851967 time 0.045065 [04/19/2021-12:49:04] [V] [TRT] Tactic: 1179647 time 0.0280924 [04/19/2021-12:49:04] [V] [TRT] Tactic: 1310719 time 0.258633 [04/19/2021-12:49:05] [V] [TRT] Tactic: 1376255 time 0.144818 [04/19/2021-12:49:05] [V] [TRT] Tactic: 1441791 time 0.0343226 [04/19/2021-12:49:05] [V] [TRT] Tactic: 1507327 time 0.0816081 [04/19/2021-12:49:05] [V] [TRT] Tactic: 1638399 time 0.0406185 [04/19/2021-12:49:05] [V] [TRT] Tactic: 1835007 time 0.0566599 [04/19/2021-12:49:05] [V] [TRT] Tactic: 1900543 time 0.152858 [04/19/2021-12:49:05] [V] [TRT] Tactic: 2097151 time 0.0237826 [04/19/2021-12:49:05] [V] [TRT] Tactic: 2162687 time 0.147064 [04/19/2021-12:49:05] [V] [TRT] Tactic: 2293759 time 0.135013 [04/19/2021-12:49:05] [V] [TRT] Tactic: 2359295 time 0.0980014 [04/19/2021-12:49:05] [V] [TRT] Tactic: 2686975 time 0.135508 [04/19/2021-12:49:05] [V] [TRT] Tactic: 3080191 time 0.073099 [04/19/2021-12:49:05] [V] [TRT] Tactic: 3342335 time 0.0820311 [04/19/2021-12:49:05] [V] [TRT] Tactic: 3407871 time 0.0776434 [04/19/2021-12:49:05] [V] [TRT] Tactic: 3538943 time 0.0407683 [04/19/2021-12:49:05] [V] [TRT] Tactic: 3670015 time 0.278698 [04/19/2021-12:49:05] [V] [TRT] Tactic: 3932159 time 0.117005 [04/19/2021-12:49:05] [V] [TRT] Tactic: 3997695 time 0.0324415 [04/19/2021-12:49:05] [V] [TRT] Tactic: 4063231 time 0.0414323 [04/19/2021-12:49:05] [V] [TRT] Tactic: 4194303 time 0.059095 [04/19/2021-12:49:05] [V] [TRT] Tactic: 4259839 time 0.0224806 [04/19/2021-12:49:05] [V] [TRT] Tactic: 4325375 time 0.0452345 [04/19/2021-12:49:05] [V] [TRT] Tactic: 4521983 time 0.140508 [04/19/2021-12:49:05] [V] [TRT] Tactic: 4587519 time 0.0294404 [04/19/2021-12:49:05] [V] [TRT] Tactic: 4653055 time 0.031543 [04/19/2021-12:49:05] [V] [TRT] Tactic: 4915199 time 0.0314454 [04/19/2021-12:49:05] [V] [TRT] Tactic: 4980735 time 0.0861784 [04/19/2021-12:49:05] [V] [TRT] Tactic: 5177343 time 0.0279359 [04/19/2021-12:49:05] [V] [TRT] Tactic: 5242879 time 0.072194 [04/19/2021-12:49:05] [V] [TRT] Tactic: 5373951 time 0.0277281 [04/19/2021-12:49:05] [V] [TRT] Tactic: 5439487 time 0.0571549 [04/19/2021-12:49:05] [V] [TRT] Tactic: 5570559 time 0.0779559 [04/19/2021-12:49:05] [V] [TRT] Tactic: 5636095 time 0.0417252 [04/19/2021-12:49:05] [V] [TRT] Tactic: 5701631 time 0.126556 [04/19/2021-12:49:05] [V] [TRT] Tactic: 5767167 time 0.0634444 [04/19/2021-12:49:05] [V] [TRT] Tactic: 5832703 time 0.0733008 [04/19/2021-12:49:05] [V] [TRT] Tactic: 5898239 time 0.0384311 [04/19/2021-12:49:05] [V] [TRT] Tactic: 6029311 time 0.122786 [04/19/2021-12:49:05] [V] [TRT] Tactic: 6225919 time 0.0384635 [04/19/2021-12:49:05] [V] [TRT] Tactic: 6291455 time 0.0274545 [04/19/2021-12:49:05] [V] [TRT] Tactic: 6422527 time 0.0659764 [04/19/2021-12:49:05] [V] [TRT] Tactic: 6750207 time 0.0329556 [04/19/2021-12:49:05] [V] [TRT] Tactic: 6815743 time 0.071914 [04/19/2021-12:49:05] [V] [TRT] Tactic: 6946815 time 0.078867 [04/19/2021-12:49:05] [V] [TRT] Tactic: 7012351 time 0.0236329 [04/19/2021-12:49:05] [V] [TRT] Tactic: 7077887 time 0.0388346 [04/19/2021-12:49:05] [V] [TRT] Tactic: 7143423 time 0.0637826 [04/19/2021-12:49:05] [V] [TRT] Tactic: 7208959 time 0.0734829 [04/19/2021-12:49:05] [V] [TRT] Tactic: 7340031 time 0.0365494 [04/19/2021-12:49:05] [V] [TRT] Tactic: 7405567 time 0.0391731 [04/19/2021-12:49:05] [V] [TRT] Tactic: 7536639 time 0.102513 [04/19/2021-12:49:05] [V] [TRT] Tactic: 7602175 time 0.0784051 [04/19/2021-12:49:05] [V] [TRT] Tactic: 7733247 time 0.0456966 [04/19/2021-12:49:05] [V] [TRT] Tactic: 7798783 time 0.0604426 [04/19/2021-12:49:05] [V] [TRT] Tactic: 8191999 time 0.047669 [04/19/2021-12:49:05] [V] [TRT] Tactic: 8257535 time 0.03125 [04/19/2021-12:49:05] [V] [TRT] Tactic: 8323071 time 0.0580274 [04/19/2021-12:49:05] [V] [TRT] Tactic: 8650751 time 0.0782749 [04/19/2021-12:49:05] [V] [TRT] Tactic: 8716287 time 0.0383334 [04/19/2021-12:49:05] [V] [TRT] Tactic: 9109503 time 0.0230337 [04/19/2021-12:49:05] [V] [TRT] Tactic: 9568255 time 0.0314842 [04/19/2021-12:49:05] [V] [TRT] Tactic: 9895935 time 0.0591469 [04/19/2021-12:49:05] [V] [TRT] Tactic: 10223615 time 0.135495 [04/19/2021-12:49:05] [V] [TRT] Tactic: 10354687 time 0.0281901 [04/19/2021-12:49:05] [V] [TRT] Tactic: 10551295 time 0.0791669 [04/19/2021-12:49:05] [V] [TRT] Tactic: 10747903 time 0.0458919 [04/19/2021-12:49:05] [V] [TRT] Tactic: 10944511 time 0.0855859 [04/19/2021-12:49:05] [V] [TRT] Fastest Tactic: 4259839 Time: 0.0224806 [04/19/2021-12:49:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd (CaskConvolution) [04/19/2021-12:49:05] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:49:05] [V] [TRT] Tactic: 1062367460111450758 time 0.118307 [04/19/2021-12:49:05] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:49:05] [V] [TRT] Tactic: 4501471010995462441 time 0.136016 [04/19/2021-12:49:05] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:49:05] [V] [TRT] Tactic: 5137655947464784826 time 0.0886654 [04/19/2021-12:49:05] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:49:05] [V] [TRT] Tactic: 5326823351883942011 time 0.129577 [04/19/2021-12:49:05] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:49:05] [V] [TRT] Tactic: 6645123197870846056 time 0.0956184 [04/19/2021-12:49:05] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:49:05] [V] [TRT] Tactic: -6576203419454146580 time 0.091582 [04/19/2021-12:49:05] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:49:05] [V] [TRT] Tactic: -3456450830548107839 time 0.0985286 [04/19/2021-12:49:05] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:49:05] [V] [TRT] Tactic: -410470605513481746 time 0.131113 [04/19/2021-12:49:05] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:49:05] [V] [TRT] Tactic: -37215280111360163 time 0.0864258 [04/19/2021-12:49:05] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.0864258 [04/19/2021-12:49:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd (CudaConvolution) [04/19/2021-12:49:05] [V] [TRT] Tactic: 0 time 0.0997262 [04/19/2021-12:49:05] [V] [TRT] Tactic: 2 time 0.181439 [04/19/2021-12:49:05] [V] [TRT] Tactic: 5 time 0.818158 [04/19/2021-12:49:05] [V] [TRT] Tactic: 57 time 0.0878779 [04/19/2021-12:49:05] [V] [TRT] Fastest Tactic: 57 Time: 0.0878779 [04/19/2021-12:49:05] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd (CudaDepthwiseConvolution) [04/19/2021-12:49:05] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/19/2021-12:49:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 4259839 [04/19/2021-12:49:05] [V] [TRT] [04/19/2021-12:49:06] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:49:06] [V] [TRT] Tactic: 1002 time 0.00895837 [04/19/2021-12:49:06] [V] [TRT] Tactic: 0 time 0.00571613 [04/19/2021-12:49:06] [V] [TRT] Fastest Tactic: 0 Time: 0.00571613 [04/19/2021-12:49:06] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:49:06] [V] [TRT] Tactic: 1002 time 0.0090105 [04/19/2021-12:49:06] [V] [TRT] Tactic: 0 time 0.005423 [04/19/2021-12:49:06] [V] [TRT] Fastest Tactic: 0 Time: 0.005423 [04/19/2021-12:49:06] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:49:06] [V] [TRT] Tactic: 1002 time 0.00906875 [04/19/2021-12:49:06] [V] [TRT] Tactic: 0 time 0.00520838 [04/19/2021-12:49:06] [V] [TRT] Fastest Tactic: 0 Time: 0.00520838 [04/19/2021-12:49:06] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,28) -> Float(1,1,1,28) *************** [04/19/2021-12:49:06] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/mul) (PointWise) [04/19/2021-12:49:06] [V] [TRT] Tactic: 128 time 0.005703 [04/19/2021-12:49:06] [V] [TRT] Tactic: 256 time 0.00572275 [04/19/2021-12:49:06] [V] [TRT] Tactic: 512 time 0.00572938 [04/19/2021-12:49:06] [V] [TRT] Fastest Tactic: 128 Time: 0.005703 [04/19/2021-12:49:06] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/mul) (PointWiseV2) [04/19/2021-12:49:06] [V] [TRT] Tactic: 0 time 0.00402988 [04/19/2021-12:49:06] [V] [TRT] Tactic: 1 time 0.00432288 [04/19/2021-12:49:06] [V] [TRT] Tactic: 2 time 0.00473937 [04/19/2021-12:49:06] [V] [TRT] Tactic: 3 time 0.00531263 [04/19/2021-12:49:06] [V] [TRT] Tactic: 4 time 0.00461562 [04/19/2021-12:49:06] [V] [TRT] Tactic: 5 time 0.004062 [04/19/2021-12:49:06] [V] [TRT] Tactic: 6 time 0.00572275 [04/19/2021-12:49:06] [V] [TRT] Tactic: 7 time 0.005638 [04/19/2021-12:49:06] [V] [TRT] Tactic: 8 time 0.0052605 [04/19/2021-12:49:06] [V] [TRT] Tactic: 9 time 0.00481775 [04/19/2021-12:49:06] [V] [TRT] Tactic: 28 time 0.00345063 [04/19/2021-12:49:06] [V] [TRT] Fastest Tactic: 28 Time: 0.00345063 [04/19/2021-12:49:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [04/19/2021-12:49:06] [V] [TRT] [04/19/2021-12:49:06] [V] [TRT] *************** Autotuning format combination: Float(1,1,1:32,1) -> Float(1,1,1:32,1) *************** [04/19/2021-12:49:06] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/mul) (PointWise) [04/19/2021-12:49:06] [V] [TRT] Tactic: 128 time 0.00569 [04/19/2021-12:49:06] [V] [TRT] Tactic: 256 time 0.00574212 [04/19/2021-12:49:06] [V] [TRT] Tactic: 512 time 0.0056575 [04/19/2021-12:49:06] [V] [TRT] Tactic: -32 time 0.0057095 [04/19/2021-12:49:06] [V] [TRT] Tactic: -64 time 0.0057095 [04/19/2021-12:49:06] [V] [TRT] Tactic: -128 time 0.0057225 [04/19/2021-12:49:06] [V] [TRT] Fastest Tactic: 512 Time: 0.0056575 [04/19/2021-12:49:06] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/mul) (PointWiseV2) [04/19/2021-12:49:06] [V] [TRT] Tactic: 24 time 0.00563812 [04/19/2021-12:49:06] [V] [TRT] Tactic: 25 time 0.00556637 [04/19/2021-12:49:06] [V] [TRT] Tactic: 26 time 0.00567687 [04/19/2021-12:49:06] [V] [TRT] Tactic: 27 time 0.00797513 [04/19/2021-12:49:06] [V] [TRT] Tactic: 31 time 0.00569662 [04/19/2021-12:49:06] [V] [TRT] Fastest Tactic: 25 Time: 0.00556637 [04/19/2021-12:49:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [04/19/2021-12:49:06] [V] [TRT] [04/19/2021-12:49:06] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,28) -> Float(1,1,1,672) *************** [04/19/2021-12:49:06] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:49:06] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:49:06] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:49:06] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:49:06] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:49:06] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:49:06] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:49:06] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:49:06] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:49:06] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd (FusedConvActConvolution) [04/19/2021-12:49:06] [V] [TRT] Tactic: 589823 time 0.0224091 [04/19/2021-12:49:06] [V] [TRT] Tactic: 655359 time 0.0186266 [04/19/2021-12:49:06] [V] [TRT] Tactic: 1310719 time 0.0505468 [04/19/2021-12:49:06] [V] [TRT] Tactic: 1376255 time 0.017565 [04/19/2021-12:49:06] [V] [TRT] Tactic: 1507327 time 0.0248699 [04/19/2021-12:49:06] [V] [TRT] Tactic: 1900543 time 0.0214454 [04/19/2021-12:49:06] [V] [TRT] Tactic: 2162687 time 0.0182616 [04/19/2021-12:49:06] [V] [TRT] Tactic: 2293759 time 0.0153453 [04/19/2021-12:49:06] [V] [TRT] Tactic: 2359295 time 0.0291929 [04/19/2021-12:49:06] [V] [TRT] Tactic: 2686975 time 0.0155146 [04/19/2021-12:49:06] [V] [TRT] Tactic: 3080191 time 0.0190299 [04/19/2021-12:49:06] [V] [TRT] Tactic: 3342335 time 0.0247072 [04/19/2021-12:49:06] [V] [TRT] Tactic: 3407871 time 0.01541 [04/19/2021-12:49:07] [V] [TRT] Tactic: 3670015 time 0.022409 [04/19/2021-12:49:07] [V] [TRT] Tactic: 3932159 time 0.0128385 [04/19/2021-12:49:07] [V] [TRT] Tactic: 4521983 time 0.0255599 [04/19/2021-12:49:07] [V] [TRT] Tactic: 4980735 time 0.032806 [04/19/2021-12:49:07] [V] [TRT] Tactic: 5242879 time 0.0132031 [04/19/2021-12:49:07] [V] [TRT] Tactic: 5570559 time 0.0224219 [04/19/2021-12:49:07] [V] [TRT] Tactic: 5701631 time 0.0148504 [04/19/2021-12:49:07] [V] [TRT] Tactic: 5767167 time 0.0106119 [04/19/2021-12:49:07] [V] [TRT] Tactic: 5832703 time 0.0152929 [04/19/2021-12:49:07] [V] [TRT] Tactic: 6029311 time 0.0142775 [04/19/2021-12:49:07] [V] [TRT] Tactic: 6422527 time 0.0129688 [04/19/2021-12:49:07] [V] [TRT] Tactic: 6815743 time 0.0131186 [04/19/2021-12:49:07] [V] [TRT] Tactic: 7143423 time 0.0107877 [04/19/2021-12:49:07] [V] [TRT] Tactic: 7208959 time 0.0152408 [04/19/2021-12:49:07] [V] [TRT] Tactic: 7536639 time 0.0106903 [04/19/2021-12:49:07] [V] [TRT] Tactic: 10223615 time 0.0154815 [04/19/2021-12:49:07] [V] [TRT] Tactic: 10551295 time 0.0150065 [04/19/2021-12:49:07] [V] [TRT] Tactic: 10944511 time 0.0328123 [04/19/2021-12:49:07] [V] [TRT] Fastest Tactic: 5767167 Time: 0.0106119 [04/19/2021-12:49:07] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd (CaskConvolution) [04/19/2021-12:49:07] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:49:07] [V] [TRT] Tactic: 1062367460111450758 time 0.0821744 [04/19/2021-12:49:07] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:49:07] [V] [TRT] Tactic: 4501471010995462441 time 0.0714322 [04/19/2021-12:49:07] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:49:07] [V] [TRT] Tactic: 5137655947464784826 time 0.067044 [04/19/2021-12:49:07] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:49:07] [V] [TRT] Tactic: 5326823351883942011 time 0.066986 [04/19/2021-12:49:07] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:49:07] [V] [TRT] Tactic: 6645123197870846056 time 0.0677605 [04/19/2021-12:49:07] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:49:07] [V] [TRT] Tactic: -6576203419454146580 time 0.0759769 [04/19/2021-12:49:07] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:49:07] [V] [TRT] Tactic: -3456450830548107839 time 0.0776171 [04/19/2021-12:49:07] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:49:07] [V] [TRT] Tactic: -410470605513481746 time 0.0694207 [04/19/2021-12:49:07] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:49:07] [V] [TRT] Tactic: -37215280111360163 time 0.0651824 [04/19/2021-12:49:07] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.0651824 [04/19/2021-12:49:07] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd (CudaConvolution) [04/19/2021-12:49:07] [V] [TRT] Tactic: 0 time 0.0315365 [04/19/2021-12:49:07] [V] [TRT] Tactic: 2 time 0.0852801 [04/19/2021-12:49:07] [V] [TRT] Tactic: 5 time 1.32243 [04/19/2021-12:49:07] [V] [TRT] Tactic: 57 time 0.0795639 [04/19/2021-12:49:07] [V] [TRT] Fastest Tactic: 0 Time: 0.0315365 [04/19/2021-12:49:07] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd (CudaDepthwiseConvolution) [04/19/2021-12:49:07] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/19/2021-12:49:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 5767167 [04/19/2021-12:49:07] [V] [TRT] [04/19/2021-12:49:07] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:49:07] [V] [TRT] Tactic: 1002 time 0.0104557 [04/19/2021-12:49:07] [V] [TRT] Tactic: 0 time 0.00569675 [04/19/2021-12:49:07] [V] [TRT] Fastest Tactic: 0 Time: 0.00569675 [04/19/2021-12:49:07] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:49:07] [V] [TRT] Tactic: 1002 time 0.0103389 [04/19/2021-12:49:07] [V] [TRT] Tactic: 0 time 0.00565075 [04/19/2021-12:49:07] [V] [TRT] Fastest Tactic: 0 Time: 0.00565075 [04/19/2021-12:49:07] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:49:07] [V] [TRT] Tactic: 1002 time 0.0103908 [04/19/2021-12:49:07] [V] [TRT] Tactic: 0 time 0.00569675 [04/19/2021-12:49:07] [V] [TRT] Fastest Tactic: 0 Time: 0.00569675 [04/19/2021-12:49:07] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,672), Float(1,14,196,131712) -> Float(1,14,196,131712) *************** [04/19/2021-12:49:07] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5b_se_excite/mul) (PointWise) [04/19/2021-12:49:07] [V] [TRT] Tactic: 128 time 0.360299 [04/19/2021-12:49:07] [V] [TRT] Tactic: 256 time 0.361146 [04/19/2021-12:49:07] [V] [TRT] Tactic: 512 time 0.36306 [04/19/2021-12:49:07] [V] [TRT] Tactic: -32 time 0.366478 [04/19/2021-12:49:07] [V] [TRT] Tactic: -64 time 0.42028 [04/19/2021-12:49:07] [V] [TRT] Tactic: -128 time 0.414766 [04/19/2021-12:49:07] [V] [TRT] Fastest Tactic: 128 Time: 0.360299 [04/19/2021-12:49:07] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5b_se_excite/mul) (PointWiseV2) [04/19/2021-12:49:07] [V] [TRT] Tactic: 0 time 0.52291 [04/19/2021-12:49:07] [V] [TRT] Tactic: 1 time 0.627591 [04/19/2021-12:49:07] [V] [TRT] Tactic: 2 time 0.573118 [04/19/2021-12:49:07] [V] [TRT] Tactic: 3 time 0.740006 [04/19/2021-12:49:07] [V] [TRT] Tactic: 4 time 0.759811 [04/19/2021-12:49:07] [V] [TRT] Tactic: 5 time 0.651205 [04/19/2021-12:49:07] [V] [TRT] Tactic: 6 time 0.99668 [04/19/2021-12:49:07] [V] [TRT] Tactic: 7 time 0.9328 [04/19/2021-12:49:07] [V] [TRT] Tactic: 8 time 0.949701 [04/19/2021-12:49:08] [V] [TRT] Tactic: 9 time 0.82724 [04/19/2021-12:49:08] [V] [TRT] Tactic: 28 time 0.229291 [04/19/2021-12:49:08] [V] [TRT] Fastest Tactic: 28 Time: 0.229291 [04/19/2021-12:49:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [04/19/2021-12:49:08] [V] [TRT] [04/19/2021-12:49:08] [V] [TRT] *************** Autotuning format combination: Float(1,1,1:32,21), Float(1,14,196:32,4116) -> Float(1,14,196:32,4116) *************** [04/19/2021-12:49:08] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5b_se_excite/mul) (PointWise) [04/19/2021-12:49:08] [V] [TRT] Tactic: 128 time 0.41095 [04/19/2021-12:49:08] [V] [TRT] Tactic: 256 time 0.411856 [04/19/2021-12:49:08] [V] [TRT] Tactic: 512 time 0.414551 [04/19/2021-12:49:08] [V] [TRT] Tactic: -32 time 0.483157 [04/19/2021-12:49:08] [V] [TRT] Tactic: -64 time 0.489316 [04/19/2021-12:49:08] [V] [TRT] Tactic: -128 time 0.489199 [04/19/2021-12:49:08] [V] [TRT] Fastest Tactic: 128 Time: 0.41095 [04/19/2021-12:49:08] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5b_se_excite/mul) (PointWiseV2) [04/19/2021-12:49:08] [V] [TRT] Tactic: 24 time 0.128001 [04/19/2021-12:49:08] [V] [TRT] Tactic: 25 time 0.119088 [04/19/2021-12:49:08] [V] [TRT] Tactic: 26 time 0.11806 [04/19/2021-12:49:08] [V] [TRT] Tactic: 27 time 0.128965 [04/19/2021-12:49:08] [V] [TRT] Tactic: 31 time 0.11903 [04/19/2021-12:49:08] [V] [TRT] Fastest Tactic: 26 Time: 0.11806 [04/19/2021-12:49:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [04/19/2021-12:49:08] [V] [TRT] [04/19/2021-12:49:08] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,131712), Float(1,14,196,21952) -> Float(1,14,196,21952) *************** [04/19/2021-12:49:08] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block5b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:49:08] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block5b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:49:08] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block5b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:49:08] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block5b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:49:08] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block5b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:49:08] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block5b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:49:08] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block5b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:49:08] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block5b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:49:08] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block5b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:49:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block5b_add/add (CaskConvolution) [04/19/2021-12:49:08] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block5b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:49:08] [V] [TRT] Tactic: 1062367460111450758 time 0.36237 [04/19/2021-12:49:08] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block5b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:49:08] [V] [TRT] Tactic: 4501471010995462441 time 0.244421 [04/19/2021-12:49:08] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block5b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:49:08] [V] [TRT] Tactic: 5137655947464784826 time 0.253724 [04/19/2021-12:49:08] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block5b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:49:08] [V] [TRT] Tactic: 5326823351883942011 time 0.234004 [04/19/2021-12:49:08] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block5b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:49:08] [V] [TRT] Tactic: 6645123197870846056 time 0.258438 [04/19/2021-12:49:08] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block5b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:49:08] [V] [TRT] Tactic: -6576203419454146580 time 0.313321 [04/19/2021-12:49:08] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block5b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:49:08] [V] [TRT] Tactic: -3456450830548107839 time 0.327012 [04/19/2021-12:49:08] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block5b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:49:08] [V] [TRT] Tactic: -410470605513481746 time 0.238711 [04/19/2021-12:49:08] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block5b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:49:08] [V] [TRT] Tactic: -37215280111360163 time 0.248008 [04/19/2021-12:49:08] [V] [TRT] Fastest Tactic: 5326823351883942011 Time: 0.234004 [04/19/2021-12:49:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block5b_add/add (CudaConvolution) [04/19/2021-12:49:08] [V] [TRT] Tactic: 0 time 0.550462 [04/19/2021-12:49:08] [V] [TRT] Tactic: 2 time 0.619382 [04/19/2021-12:49:08] [V] [TRT] Tactic: 5 time 5.86097 [04/19/2021-12:49:08] [V] [TRT] Tactic: 57 time 0.439733 [04/19/2021-12:49:08] [V] [TRT] Fastest Tactic: 57 Time: 0.439733 [04/19/2021-12:49:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5326823351883942011 [04/19/2021-12:49:08] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block5b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:49:08] [V] [TRT] [04/19/2021-12:49:08] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block5b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:49:08] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block5b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:49:08] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block5b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:49:08] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block5b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:49:08] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block5b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:49:08] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block5b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:49:08] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block5b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:49:08] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block5b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:49:08] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block5b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:49:08] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block5b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:49:08] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,21952) -> Float(1,14,196,131712) *************** [04/19/2021-12:49:08] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,131712) -> Float(1,14,196,131712) *************** [04/19/2021-12:49:09] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5c_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5c_expand_activation/mul) (PointWise) [04/19/2021-12:49:09] [V] [TRT] Tactic: 128 time 0.290365 [04/19/2021-12:49:09] [V] [TRT] Tactic: 256 time 0.290391 [04/19/2021-12:49:09] [V] [TRT] Tactic: 512 time 0.2936 [04/19/2021-12:49:09] [V] [TRT] Tactic: -32 time 0.310911 [04/19/2021-12:49:09] [V] [TRT] Tactic: -64 time 0.301504 [04/19/2021-12:49:09] [V] [TRT] Tactic: -128 time 0.299752 [04/19/2021-12:49:09] [V] [TRT] Fastest Tactic: 128 Time: 0.290365 [04/19/2021-12:49:09] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5c_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5c_expand_activation/mul) (PointWiseV2) [04/19/2021-12:49:09] [V] [TRT] Tactic: 0 time 0.138301 [04/19/2021-12:49:09] [V] [TRT] Tactic: 1 time 0.102357 [04/19/2021-12:49:09] [V] [TRT] Tactic: 2 time 0.0938474 [04/19/2021-12:49:09] [V] [TRT] Tactic: 3 time 0.0865103 [04/19/2021-12:49:09] [V] [TRT] Tactic: 4 time 0.069245 [04/19/2021-12:49:09] [V] [TRT] Tactic: 5 time 0.0725846 [04/19/2021-12:49:09] [V] [TRT] Tactic: 6 time 0.0829753 [04/19/2021-12:49:09] [V] [TRT] Tactic: 7 time 0.0640042 [04/19/2021-12:49:09] [V] [TRT] Tactic: 8 time 0.0584896 [04/19/2021-12:49:09] [V] [TRT] Tactic: 9 time 0.0621812 [04/19/2021-12:49:09] [V] [TRT] Tactic: 28 time 0.134141 [04/19/2021-12:49:09] [V] [TRT] Fastest Tactic: 8 Time: 0.0584896 [04/19/2021-12:49:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [04/19/2021-12:49:09] [V] [TRT] [04/19/2021-12:49:09] [V] [TRT] *************** Autotuning format combination: Float(1,14,196:32,4116) -> Float(1,14,196:32,4116) *************** [04/19/2021-12:49:09] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5c_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5c_expand_activation/mul) (PointWise) [04/19/2021-12:49:09] [V] [TRT] Tactic: 128 time 0.290482 [04/19/2021-12:49:09] [V] [TRT] Tactic: 256 time 0.290912 [04/19/2021-12:49:09] [V] [TRT] Tactic: 512 time 0.29347 [04/19/2021-12:49:09] [V] [TRT] Tactic: -32 time 0.310729 [04/19/2021-12:49:09] [V] [TRT] Tactic: -64 time 0.301315 [04/19/2021-12:49:09] [V] [TRT] Tactic: -128 time 0.299863 [04/19/2021-12:49:09] [V] [TRT] Fastest Tactic: 128 Time: 0.290482 [04/19/2021-12:49:09] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5c_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5c_expand_activation/mul) (PointWiseV2) [04/19/2021-12:49:09] [V] [TRT] Tactic: 24 time 0.101211 [04/19/2021-12:49:09] [V] [TRT] Tactic: 25 time 0.0909701 [04/19/2021-12:49:09] [V] [TRT] Tactic: 26 time 0.0911591 [04/19/2021-12:49:09] [V] [TRT] Tactic: 27 time 0.0928908 [04/19/2021-12:49:09] [V] [TRT] Tactic: 31 time 0.101243 [04/19/2021-12:49:09] [V] [TRT] Fastest Tactic: 25 Time: 0.0909701 [04/19/2021-12:49:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [04/19/2021-12:49:09] [V] [TRT] [04/19/2021-12:49:09] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,131712) -> Float(1,14,196,131712) *************** [04/19/2021-12:49:09] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,131712) -> Float(1,14,196,131712) *************** [04/19/2021-12:49:09] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5c_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5c_activation/mul) (PointWise) [04/19/2021-12:49:09] [V] [TRT] Tactic: 128 time 0.289642 [04/19/2021-12:49:09] [V] [TRT] Tactic: 256 time 0.291334 [04/19/2021-12:49:09] [V] [TRT] Tactic: 512 time 0.293724 [04/19/2021-12:49:09] [V] [TRT] Tactic: -32 time 0.311256 [04/19/2021-12:49:09] [V] [TRT] Tactic: -64 time 0.301647 [04/19/2021-12:49:09] [V] [TRT] Tactic: -128 time 0.299616 [04/19/2021-12:49:09] [V] [TRT] Fastest Tactic: 128 Time: 0.289642 [04/19/2021-12:49:09] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5c_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5c_activation/mul) (PointWiseV2) [04/19/2021-12:49:09] [V] [TRT] Tactic: 0 time 0.138489 [04/19/2021-12:49:09] [V] [TRT] Tactic: 1 time 0.102793 [04/19/2021-12:49:09] [V] [TRT] Tactic: 2 time 0.0943293 [04/19/2021-12:49:09] [V] [TRT] Tactic: 3 time 0.0863801 [04/19/2021-12:49:09] [V] [TRT] Tactic: 4 time 0.0694859 [04/19/2021-12:49:09] [V] [TRT] Tactic: 5 time 0.0720898 [04/19/2021-12:49:09] [V] [TRT] Tactic: 6 time 0.0827734 [04/19/2021-12:49:09] [V] [TRT] Tactic: 7 time 0.0647004 [04/19/2021-12:49:09] [V] [TRT] Tactic: 8 time 0.0585676 [04/19/2021-12:49:09] [V] [TRT] Tactic: 9 time 0.0612435 [04/19/2021-12:49:09] [V] [TRT] Tactic: 28 time 0.134492 [04/19/2021-12:49:09] [V] [TRT] Fastest Tactic: 8 Time: 0.0585676 [04/19/2021-12:49:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [04/19/2021-12:49:09] [V] [TRT] [04/19/2021-12:49:10] [V] [TRT] *************** Autotuning format combination: Float(1,14,196:32,4116) -> Float(1,14,196:32,4116) *************** [04/19/2021-12:49:10] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5c_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5c_activation/mul) (PointWise) [04/19/2021-12:49:10] [V] [TRT] Tactic: 128 time 0.289785 [04/19/2021-12:49:10] [V] [TRT] Tactic: 256 time 0.290937 [04/19/2021-12:49:10] [V] [TRT] Tactic: 512 time 0.293919 [04/19/2021-12:49:10] [V] [TRT] Tactic: -32 time 0.310859 [04/19/2021-12:49:10] [V] [TRT] Tactic: -64 time 0.301126 [04/19/2021-12:49:10] [V] [TRT] Tactic: -128 time 0.299622 [04/19/2021-12:49:10] [V] [TRT] Fastest Tactic: 128 Time: 0.289785 [04/19/2021-12:49:10] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5c_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5c_activation/mul) (PointWiseV2) [04/19/2021-12:49:10] [V] [TRT] Tactic: 24 time 0.0994856 [04/19/2021-12:49:10] [V] [TRT] Tactic: 25 time 0.0903709 [04/19/2021-12:49:10] [V] [TRT] Tactic: 26 time 0.0905206 [04/19/2021-12:49:10] [V] [TRT] Tactic: 27 time 0.0919335 [04/19/2021-12:49:10] [V] [TRT] Tactic: 31 time 0.0987891 [04/19/2021-12:49:10] [V] [TRT] Fastest Tactic: 25 Time: 0.0903709 [04/19/2021-12:49:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [04/19/2021-12:49:10] [V] [TRT] [04/19/2021-12:49:10] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,131712) -> Float(1,672) *************** [04/19/2021-12:49:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block5c_se_squeeze/Mean (Reduce) [04/19/2021-12:49:10] [V] [TRT] Tactic: 1 time 0.540677 [04/19/2021-12:49:10] [V] [TRT] Tactic: 3 time 0.19028 [04/19/2021-12:49:10] [V] [TRT] Tactic: 6 time 0.796198 [04/19/2021-12:49:10] [V] [TRT] Fastest Tactic: 3 Time: 0.19028 [04/19/2021-12:49:10] [V] [TRT] *************** Autotuning format combination: Float(1,672) -> Float(1,1,1,672) *************** [04/19/2021-12:49:10] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block5c_se_reshape/Reshape + StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/BiasAdd__235 (Shuffle) [04/19/2021-12:49:10] [V] [TRT] Tactic: 0 time 0.00338525 [04/19/2021-12:49:10] [V] [TRT] Tactic: 1 time 0.0117188 [04/19/2021-12:49:10] [V] [TRT] Fastest Tactic: 0 Time: 0.00338525 [04/19/2021-12:49:10] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,672) -> Float(1,1,1,28) *************** [04/19/2021-12:49:10] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,28) -> Float(1,1,1,28) *************** [04/19/2021-12:49:10] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/mul) (PointWise) [04/19/2021-12:49:10] [V] [TRT] Tactic: 128 time 0.00585938 [04/19/2021-12:49:10] [V] [TRT] Tactic: 256 time 0.00586587 [04/19/2021-12:49:10] [V] [TRT] Tactic: 512 time 0.005736 [04/19/2021-12:49:10] [V] [TRT] Fastest Tactic: 512 Time: 0.005736 [04/19/2021-12:49:10] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/mul) (PointWiseV2) [04/19/2021-12:49:10] [V] [TRT] Tactic: 0 time 0.00378887 [04/19/2021-12:49:10] [V] [TRT] Tactic: 1 time 0.00427087 [04/19/2021-12:49:10] [V] [TRT] Tactic: 2 time 0.00449875 [04/19/2021-12:49:10] [V] [TRT] Tactic: 3 time 0.0056575 [04/19/2021-12:49:10] [V] [TRT] Tactic: 4 time 0.00464175 [04/19/2021-12:49:10] [V] [TRT] Tactic: 5 time 0.00427725 [04/19/2021-12:49:11] [V] [TRT] Tactic: 6 time 0.0056575 [04/19/2021-12:49:11] [V] [TRT] Tactic: 7 time 0.00563787 [04/19/2021-12:49:11] [V] [TRT] Tactic: 8 time 0.00539725 [04/19/2021-12:49:11] [V] [TRT] Tactic: 9 time 0.00453787 [04/19/2021-12:49:11] [V] [TRT] Tactic: 28 time 0.00368488 [04/19/2021-12:49:11] [V] [TRT] Fastest Tactic: 28 Time: 0.00368488 [04/19/2021-12:49:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [04/19/2021-12:49:11] [V] [TRT] [04/19/2021-12:49:11] [V] [TRT] *************** Autotuning format combination: Float(1,1,1:32,1) -> Float(1,1,1:32,1) *************** [04/19/2021-12:49:11] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/mul) (PointWise) [04/19/2021-12:49:11] [V] [TRT] Tactic: 128 time 0.00576162 [04/19/2021-12:49:11] [V] [TRT] Tactic: 256 time 0.00569663 [04/19/2021-12:49:11] [V] [TRT] Tactic: 512 time 0.0056835 [04/19/2021-12:49:11] [V] [TRT] Tactic: -32 time 0.00572263 [04/19/2021-12:49:11] [V] [TRT] Tactic: -64 time 0.00570975 [04/19/2021-12:49:11] [V] [TRT] Tactic: -128 time 0.00575513 [04/19/2021-12:49:11] [V] [TRT] Fastest Tactic: 512 Time: 0.0056835 [04/19/2021-12:49:11] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/mul) (PointWiseV2) [04/19/2021-12:49:11] [V] [TRT] Tactic: 24 time 0.005664 [04/19/2021-12:49:11] [V] [TRT] Tactic: 25 time 0.00563163 [04/19/2021-12:49:11] [V] [TRT] Tactic: 26 time 0.00555338 [04/19/2021-12:49:11] [V] [TRT] Tactic: 27 time 0.00796187 [04/19/2021-12:49:11] [V] [TRT] Tactic: 31 time 0.00569662 [04/19/2021-12:49:11] [V] [TRT] Fastest Tactic: 26 Time: 0.00555338 [04/19/2021-12:49:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [04/19/2021-12:49:11] [V] [TRT] [04/19/2021-12:49:11] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,28) -> Float(1,1,1,672) *************** [04/19/2021-12:49:11] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,672), Float(1,14,196,131712) -> Float(1,14,196,131712) *************** [04/19/2021-12:49:11] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5c_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5c_se_excite/mul) (PointWise) [04/19/2021-12:49:11] [V] [TRT] Tactic: 128 time 0.360189 [04/19/2021-12:49:11] [V] [TRT] Tactic: 256 time 0.361075 [04/19/2021-12:49:11] [V] [TRT] Tactic: 512 time 0.363164 [04/19/2021-12:49:11] [V] [TRT] Tactic: -32 time 0.365827 [04/19/2021-12:49:11] [V] [TRT] Tactic: -64 time 0.419688 [04/19/2021-12:49:11] [V] [TRT] Tactic: -128 time 0.414681 [04/19/2021-12:49:11] [V] [TRT] Fastest Tactic: 128 Time: 0.360189 [04/19/2021-12:49:11] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5c_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5c_se_excite/mul) (PointWiseV2) [04/19/2021-12:49:11] [V] [TRT] Tactic: 0 time 0.523112 [04/19/2021-12:49:11] [V] [TRT] Tactic: 1 time 0.626517 [04/19/2021-12:49:11] [V] [TRT] Tactic: 2 time 0.572845 [04/19/2021-12:49:11] [V] [TRT] Tactic: 3 time 0.738561 [04/19/2021-12:49:11] [V] [TRT] Tactic: 4 time 0.760137 [04/19/2021-12:49:11] [V] [TRT] Tactic: 5 time 0.651165 [04/19/2021-12:49:11] [V] [TRT] Tactic: 6 time 0.995378 [04/19/2021-12:49:12] [V] [TRT] Tactic: 7 time 0.933262 [04/19/2021-12:49:12] [V] [TRT] Tactic: 8 time 0.950456 [04/19/2021-12:49:12] [V] [TRT] Tactic: 9 time 0.827591 [04/19/2021-12:49:12] [V] [TRT] Tactic: 28 time 0.229251 [04/19/2021-12:49:12] [V] [TRT] Fastest Tactic: 28 Time: 0.229251 [04/19/2021-12:49:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [04/19/2021-12:49:12] [V] [TRT] [04/19/2021-12:49:12] [V] [TRT] *************** Autotuning format combination: Float(1,1,1:32,21), Float(1,14,196:32,4116) -> Float(1,14,196:32,4116) *************** [04/19/2021-12:49:12] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5c_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5c_se_excite/mul) (PointWise) [04/19/2021-12:49:12] [V] [TRT] Tactic: 128 time 0.411628 [04/19/2021-12:49:12] [V] [TRT] Tactic: 256 time 0.412539 [04/19/2021-12:49:12] [V] [TRT] Tactic: 512 time 0.414629 [04/19/2021-12:49:12] [V] [TRT] Tactic: -32 time 0.482539 [04/19/2021-12:49:12] [V] [TRT] Tactic: -64 time 0.489818 [04/19/2021-12:49:12] [V] [TRT] Tactic: -128 time 0.488971 [04/19/2021-12:49:12] [V] [TRT] Fastest Tactic: 128 Time: 0.411628 [04/19/2021-12:49:12] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block5c_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5c_se_excite/mul) (PointWiseV2) [04/19/2021-12:49:12] [V] [TRT] Tactic: 24 time 0.127722 [04/19/2021-12:49:12] [V] [TRT] Tactic: 25 time 0.117552 [04/19/2021-12:49:12] [V] [TRT] Tactic: 26 time 0.115859 [04/19/2021-12:49:12] [V] [TRT] Tactic: 27 time 0.127637 [04/19/2021-12:49:12] [V] [TRT] Tactic: 31 time 0.116588 [04/19/2021-12:49:12] [V] [TRT] Fastest Tactic: 26 Time: 0.115859 [04/19/2021-12:49:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [04/19/2021-12:49:12] [V] [TRT] [04/19/2021-12:49:12] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,131712), Float(1,14,196,21952) -> Float(1,14,196,21952) *************** [04/19/2021-12:49:12] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,21952) -> Float(1,14,196,131712) *************** [04/19/2021-12:49:12] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,131712) -> Float(1,14,196,131712) *************** [04/19/2021-12:49:12] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6a_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6a_expand_activation/mul) (PointWise) [04/19/2021-12:49:12] [V] [TRT] Tactic: 128 time 0.289948 [04/19/2021-12:49:12] [V] [TRT] Tactic: 256 time 0.290892 [04/19/2021-12:49:12] [V] [TRT] Tactic: 512 time 0.293978 [04/19/2021-12:49:12] [V] [TRT] Tactic: -32 time 0.310625 [04/19/2021-12:49:12] [V] [TRT] Tactic: -64 time 0.300436 [04/19/2021-12:49:12] [V] [TRT] Tactic: -128 time 0.299544 [04/19/2021-12:49:12] [V] [TRT] Fastest Tactic: 128 Time: 0.289948 [04/19/2021-12:49:12] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6a_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6a_expand_activation/mul) (PointWiseV2) [04/19/2021-12:49:12] [V] [TRT] Tactic: 0 time 0.138646 [04/19/2021-12:49:12] [V] [TRT] Tactic: 1 time 0.102676 [04/19/2021-12:49:12] [V] [TRT] Tactic: 2 time 0.0942774 [04/19/2021-12:49:12] [V] [TRT] Tactic: 3 time 0.0876238 [04/19/2021-12:49:12] [V] [TRT] Tactic: 4 time 0.0698112 [04/19/2021-12:49:12] [V] [TRT] Tactic: 5 time 0.0723699 [04/19/2021-12:49:12] [V] [TRT] Tactic: 6 time 0.0837109 [04/19/2021-12:49:12] [V] [TRT] Tactic: 7 time 0.0650976 [04/19/2021-12:49:12] [V] [TRT] Tactic: 8 time 0.0589519 [04/19/2021-12:49:12] [V] [TRT] Tactic: 9 time 0.0609637 [04/19/2021-12:49:12] [V] [TRT] Tactic: 28 time 0.134694 [04/19/2021-12:49:12] [V] [TRT] Fastest Tactic: 8 Time: 0.0589519 [04/19/2021-12:49:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [04/19/2021-12:49:12] [V] [TRT] [04/19/2021-12:49:13] [V] [TRT] *************** Autotuning format combination: Float(1,14,196:32,4116) -> Float(1,14,196:32,4116) *************** [04/19/2021-12:49:13] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6a_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6a_expand_activation/mul) (PointWise) [04/19/2021-12:49:13] [V] [TRT] Tactic: 128 time 0.289981 [04/19/2021-12:49:13] [V] [TRT] Tactic: 256 time 0.290814 [04/19/2021-12:49:13] [V] [TRT] Tactic: 512 time 0.293737 [04/19/2021-12:49:13] [V] [TRT] Tactic: -32 time 0.310983 [04/19/2021-12:49:13] [V] [TRT] Tactic: -64 time 0.301484 [04/19/2021-12:49:13] [V] [TRT] Tactic: -128 time 0.300052 [04/19/2021-12:49:13] [V] [TRT] Fastest Tactic: 128 Time: 0.289981 [04/19/2021-12:49:13] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6a_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6a_expand_activation/mul) (PointWiseV2) [04/19/2021-12:49:13] [V] [TRT] Tactic: 24 time 0.1 [04/19/2021-12:49:13] [V] [TRT] Tactic: 25 time 0.0926171 [04/19/2021-12:49:13] [V] [TRT] Tactic: 26 time 0.0923696 [04/19/2021-12:49:13] [V] [TRT] Tactic: 27 time 0.0918686 [04/19/2021-12:49:13] [V] [TRT] Tactic: 31 time 0.100794 [04/19/2021-12:49:13] [V] [TRT] Fastest Tactic: 27 Time: 0.0918686 [04/19/2021-12:49:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [04/19/2021-12:49:13] [V] [TRT] [04/19/2021-12:49:13] [V] [TRT] *************** Autotuning format combination: Float(1,14,196,131712) -> Float(1,7,49,32928) *************** [04/19/2021-12:49:13] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:49:13] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [04/19/2021-12:49:13] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:49:13] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:49:13] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:49:13] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [04/19/2021-12:49:13] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [04/19/2021-12:49:13] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:49:13] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:49:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block6a_dwconv/depthwise (FusedConvActConvolution) [04/19/2021-12:49:13] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/19/2021-12:49:13] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block6a_dwconv/depthwise (CaskConvolution) [04/19/2021-12:49:13] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:49:14] [V] [TRT] Tactic: 1062367460111450758 time 36.5459 [04/19/2021-12:49:14] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [04/19/2021-12:49:14] [V] [TRT] Tactic: 4337000649858996379 time 19.9139 [04/19/2021-12:49:14] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:49:15] [V] [TRT] Tactic: 4501471010995462441 time 19.2207 [04/19/2021-12:49:15] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:49:15] [V] [TRT] Tactic: 5137655947464784826 time 18.7033 [04/19/2021-12:49:15] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:49:16] [V] [TRT] Tactic: 6645123197870846056 time 34.2414 [04/19/2021-12:49:16] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [04/19/2021-12:49:17] [V] [TRT] Tactic: -9137461792520977713 time 20.2027 [04/19/2021-12:49:17] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [04/19/2021-12:49:17] [V] [TRT] Tactic: -6092040395344634144 time 19.6959 [04/19/2021-12:49:17] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:49:18] [V] [TRT] Tactic: -3456450830548107839 time 20.3531 [04/19/2021-12:49:18] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:49:18] [V] [TRT] Tactic: -410470605513481746 time 18.5693 [04/19/2021-12:49:18] [V] [TRT] Fastest Tactic: -410470605513481746 Time: 18.5693 [04/19/2021-12:49:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block6a_dwconv/depthwise (CudaConvolution) [04/19/2021-12:49:18] [V] [TRT] Tactic: 0 time 0.618887 [04/19/2021-12:49:18] [V] [TRT] Tactic: 2 time 0.616751 [04/19/2021-12:49:21] [V] [TRT] Tactic: 5 time 208.976 [04/19/2021-12:49:22] [V] [TRT] Tactic: 57 time 0.615364 [04/19/2021-12:49:22] [V] [TRT] Fastest Tactic: 57 Time: 0.615364 [04/19/2021-12:49:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block6a_dwconv/depthwise (CudaDepthwiseConvolution) [04/19/2021-12:49:22] [V] [TRT] Tactic: -1 time 0.412676 [04/19/2021-12:49:22] [V] [TRT] Fastest Tactic: -1 Time: 0.412676 [04/19/2021-12:49:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [04/19/2021-12:49:22] [V] [TRT] [04/19/2021-12:49:22] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:49:22] [V] [TRT] Tactic: 1002 time 0.106192 [04/19/2021-12:49:22] [V] [TRT] Tactic: 0 time 0.0818233 [04/19/2021-12:49:22] [V] [TRT] Fastest Tactic: 0 Time: 0.0818233 [04/19/2021-12:49:22] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:49:22] [V] [TRT] Tactic: 1002 time 0.105501 [04/19/2021-12:49:22] [V] [TRT] Tactic: 0 time 0.081875 [04/19/2021-12:49:22] [V] [TRT] Fastest Tactic: 0 Time: 0.081875 [04/19/2021-12:49:22] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:49:22] [V] [TRT] Tactic: 1002 time 0.306947 [04/19/2021-12:49:22] [V] [TRT] Tactic: 0 time 0.0618295 [04/19/2021-12:49:22] [V] [TRT] Fastest Tactic: 0 Time: 0.0618295 [04/19/2021-12:49:22] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,32928) -> Float(1,7,49,32928) *************** [04/19/2021-12:49:22] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6a_activation/mul) (PointWise) [04/19/2021-12:49:22] [V] [TRT] Tactic: 128 time 0.0774675 [04/19/2021-12:49:22] [V] [TRT] Tactic: 256 time 0.0775328 [04/19/2021-12:49:22] [V] [TRT] Tactic: 512 time 0.0790821 [04/19/2021-12:49:22] [V] [TRT] Tactic: -32 time 0.102109 [04/19/2021-12:49:22] [V] [TRT] Tactic: -64 time 0.088815 [04/19/2021-12:49:22] [V] [TRT] Tactic: -128 time 0.0844791 [04/19/2021-12:49:22] [V] [TRT] Fastest Tactic: 128 Time: 0.0774675 [04/19/2021-12:49:22] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6a_activation/mul) (PointWiseV2) [04/19/2021-12:49:22] [V] [TRT] Tactic: 0 time 0.03847 [04/19/2021-12:49:22] [V] [TRT] Tactic: 1 time 0.0292707 [04/19/2021-12:49:22] [V] [TRT] Tactic: 2 time 0.0266927 [04/19/2021-12:49:22] [V] [TRT] Tactic: 3 time 0.0244465 [04/19/2021-12:49:22] [V] [TRT] Tactic: 4 time 0.0200195 [04/19/2021-12:49:22] [V] [TRT] Tactic: 5 time 0.0204754 [04/19/2021-12:49:22] [V] [TRT] Tactic: 6 time 0.0224413 [04/19/2021-12:49:22] [V] [TRT] Tactic: 7 time 0.0177474 [04/19/2021-12:49:22] [V] [TRT] Tactic: 8 time 0.0171356 [04/19/2021-12:49:22] [V] [TRT] Tactic: 9 time 0.0178385 [04/19/2021-12:49:22] [V] [TRT] Tactic: 28 time 0.036836 [04/19/2021-12:49:22] [V] [TRT] Fastest Tactic: 8 Time: 0.0171356 [04/19/2021-12:49:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [04/19/2021-12:49:22] [V] [TRT] [04/19/2021-12:49:22] [V] [TRT] *************** Autotuning format combination: Float(1,7,49:32,1029) -> Float(1,7,49:32,1029) *************** [04/19/2021-12:49:22] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6a_activation/mul) (PointWise) [04/19/2021-12:49:22] [V] [TRT] Tactic: 128 time 0.0769464 [04/19/2021-12:49:22] [V] [TRT] Tactic: 256 time 0.0776173 [04/19/2021-12:49:22] [V] [TRT] Tactic: 512 time 0.0786199 [04/19/2021-12:49:22] [V] [TRT] Tactic: -32 time 0.101725 [04/19/2021-12:49:22] [V] [TRT] Tactic: -64 time 0.0885025 [04/19/2021-12:49:22] [V] [TRT] Tactic: -128 time 0.0845833 [04/19/2021-12:49:22] [V] [TRT] Fastest Tactic: 128 Time: 0.0769464 [04/19/2021-12:49:22] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6a_activation/mul) (PointWiseV2) [04/19/2021-12:49:22] [V] [TRT] Tactic: 24 time 0.0279881 [04/19/2021-12:49:22] [V] [TRT] Tactic: 25 time 0.0265753 [04/19/2021-12:49:22] [V] [TRT] Tactic: 26 time 0.0269857 [04/19/2021-12:49:22] [V] [TRT] Tactic: 27 time 0.0284377 [04/19/2021-12:49:22] [V] [TRT] Tactic: 31 time 0.0279494 [04/19/2021-12:49:22] [V] [TRT] Fastest Tactic: 25 Time: 0.0265753 [04/19/2021-12:49:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [04/19/2021-12:49:22] [V] [TRT] [04/19/2021-12:49:22] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:49:22] [V] [TRT] Tactic: 1002 time 0.306973 [04/19/2021-12:49:22] [V] [TRT] Tactic: 0 time 0.0618753 [04/19/2021-12:49:22] [V] [TRT] Fastest Tactic: 0 Time: 0.0618753 [04/19/2021-12:49:22] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,32928) -> Float(1,672) *************** [04/19/2021-12:49:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block6a_se_squeeze/Mean (Reduce) [04/19/2021-12:49:23] [V] [TRT] Tactic: 1 time 0.526543 [04/19/2021-12:49:23] [V] [TRT] Tactic: 3 time 0.0627996 [04/19/2021-12:49:23] [V] [TRT] Tactic: 6 time 0.210859 [04/19/2021-12:49:23] [V] [TRT] Fastest Tactic: 3 Time: 0.0627996 [04/19/2021-12:49:23] [V] [TRT] *************** Autotuning format combination: Float(1,672) -> Float(1,1,1,672) *************** [04/19/2021-12:49:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block6a_se_reshape/Reshape + StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/BiasAdd__255 (Shuffle) [04/19/2021-12:49:23] [V] [TRT] Tactic: 0 time 0.0032815 [04/19/2021-12:49:23] [V] [TRT] Tactic: 1 time 0.0118099 [04/19/2021-12:49:23] [V] [TRT] Fastest Tactic: 0 Time: 0.0032815 [04/19/2021-12:49:23] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,672) -> Float(1,1,1,28) *************** [04/19/2021-12:49:23] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,28) -> Float(1,1,1,28) *************** [04/19/2021-12:49:23] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/mul) (PointWise) [04/19/2021-12:49:23] [V] [TRT] Tactic: 128 time 0.00570337 [04/19/2021-12:49:23] [V] [TRT] Tactic: 256 time 0.005762 [04/19/2021-12:49:23] [V] [TRT] Tactic: 512 time 0.00575538 [04/19/2021-12:49:23] [V] [TRT] Fastest Tactic: 128 Time: 0.00570337 [04/19/2021-12:49:23] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/mul) (PointWiseV2) [04/19/2021-12:49:23] [V] [TRT] Tactic: 0 time 0.00427062 [04/19/2021-12:49:23] [V] [TRT] Tactic: 1 time 0.0045705 [04/19/2021-12:49:23] [V] [TRT] Tactic: 2 time 0.00480475 [04/19/2021-12:49:23] [V] [TRT] Tactic: 3 time 0.00564438 [04/19/2021-12:49:23] [V] [TRT] Tactic: 4 time 0.00490237 [04/19/2021-12:49:23] [V] [TRT] Tactic: 5 time 0.00425775 [04/19/2021-12:49:23] [V] [TRT] Tactic: 6 time 0.005638 [04/19/2021-12:49:23] [V] [TRT] Tactic: 7 time 0.00559238 [04/19/2021-12:49:23] [V] [TRT] Tactic: 8 time 0.00513025 [04/19/2021-12:49:23] [V] [TRT] Tactic: 9 time 0.00488287 [04/19/2021-12:49:23] [V] [TRT] Tactic: 28 time 0.00400363 [04/19/2021-12:49:23] [V] [TRT] Fastest Tactic: 28 Time: 0.00400363 [04/19/2021-12:49:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [04/19/2021-12:49:23] [V] [TRT] [04/19/2021-12:49:23] [V] [TRT] *************** Autotuning format combination: Float(1,1,1:32,1) -> Float(1,1,1:32,1) *************** [04/19/2021-12:49:23] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/mul) (PointWise) [04/19/2021-12:49:23] [V] [TRT] Tactic: 128 time 0.00572275 [04/19/2021-12:49:23] [V] [TRT] Tactic: 256 time 0.00569675 [04/19/2021-12:49:23] [V] [TRT] Tactic: 512 time 0.00576825 [04/19/2021-12:49:23] [V] [TRT] Tactic: -32 time 0.00569662 [04/19/2021-12:49:23] [V] [TRT] Tactic: -64 time 0.00571613 [04/19/2021-12:49:23] [V] [TRT] Tactic: -128 time 0.00571613 [04/19/2021-12:49:23] [V] [TRT] Fastest Tactic: -32 Time: 0.00569662 [04/19/2021-12:49:23] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/mul) (PointWiseV2) [04/19/2021-12:49:23] [V] [TRT] Tactic: 24 time 0.0056575 [04/19/2021-12:49:23] [V] [TRT] Tactic: 25 time 0.00562488 [04/19/2021-12:49:23] [V] [TRT] Tactic: 26 time 0.00568363 [04/19/2021-12:49:23] [V] [TRT] Tactic: 27 time 0.00794275 [04/19/2021-12:49:23] [V] [TRT] Tactic: 31 time 0.0056315 [04/19/2021-12:49:23] [V] [TRT] Fastest Tactic: 25 Time: 0.00562488 [04/19/2021-12:49:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [04/19/2021-12:49:23] [V] [TRT] [04/19/2021-12:49:23] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,28) -> Float(1,1,1,672) *************** [04/19/2021-12:49:24] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,672), Float(1,7,49,32928) -> Float(1,7,49,32928) *************** [04/19/2021-12:49:24] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6a_se_excite/mul) (PointWise) [04/19/2021-12:49:24] [V] [TRT] Tactic: 128 time 0.0956121 [04/19/2021-12:49:24] [V] [TRT] Tactic: 256 time 0.0958007 [04/19/2021-12:49:24] [V] [TRT] Tactic: 512 time 0.0970183 [04/19/2021-12:49:24] [V] [TRT] Tactic: -32 time 0.125072 [04/19/2021-12:49:24] [V] [TRT] Tactic: -64 time 0.141641 [04/19/2021-12:49:24] [V] [TRT] Tactic: -128 time 0.141472 [04/19/2021-12:49:24] [V] [TRT] Fastest Tactic: 128 Time: 0.0956121 [04/19/2021-12:49:24] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6a_se_excite/mul) (PointWiseV2) [04/19/2021-12:49:24] [V] [TRT] Tactic: 0 time 0.265911 [04/19/2021-12:49:24] [V] [TRT] Tactic: 1 time 0.317982 [04/19/2021-12:49:24] [V] [TRT] Tactic: 2 time 0.290586 [04/19/2021-12:49:24] [V] [TRT] Tactic: 3 time 0.371152 [04/19/2021-12:49:24] [V] [TRT] Tactic: 4 time 0.384544 [04/19/2021-12:49:24] [V] [TRT] Tactic: 5 time 0.329765 [04/19/2021-12:49:24] [V] [TRT] Tactic: 6 time 0.488581 [04/19/2021-12:49:24] [V] [TRT] Tactic: 7 time 0.46959 [04/19/2021-12:49:24] [V] [TRT] Tactic: 8 time 0.479063 [04/19/2021-12:49:24] [V] [TRT] Tactic: 9 time 0.417949 [04/19/2021-12:49:24] [V] [TRT] Tactic: 28 time 0.0619725 [04/19/2021-12:49:24] [V] [TRT] Fastest Tactic: 28 Time: 0.0619725 [04/19/2021-12:49:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [04/19/2021-12:49:24] [V] [TRT] [04/19/2021-12:49:24] [V] [TRT] *************** Autotuning format combination: Float(1,1,1:32,21), Float(1,7,49:32,1029) -> Float(1,7,49:32,1029) *************** [04/19/2021-12:49:24] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6a_se_excite/mul) (PointWise) [04/19/2021-12:49:24] [V] [TRT] Tactic: 128 time 0.108984 [04/19/2021-12:49:24] [V] [TRT] Tactic: 256 time 0.109544 [04/19/2021-12:49:24] [V] [TRT] Tactic: 512 time 0.110085 [04/19/2021-12:49:24] [V] [TRT] Tactic: -32 time 0.126198 [04/19/2021-12:49:24] [V] [TRT] Tactic: -64 time 0.126934 [04/19/2021-12:49:24] [V] [TRT] Tactic: -128 time 0.12694 [04/19/2021-12:49:24] [V] [TRT] Fastest Tactic: 128 Time: 0.108984 [04/19/2021-12:49:24] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6a_se_excite/mul) (PointWiseV2) [04/19/2021-12:49:24] [V] [TRT] Tactic: 24 time 0.0361849 [04/19/2021-12:49:24] [V] [TRT] Tactic: 25 time 0.0361002 [04/19/2021-12:49:24] [V] [TRT] Tactic: 26 time 0.0397784 [04/19/2021-12:49:24] [V] [TRT] Tactic: 27 time 0.045534 [04/19/2021-12:49:24] [V] [TRT] Tactic: 31 time 0.0344857 [04/19/2021-12:49:24] [V] [TRT] Fastest Tactic: 31 Time: 0.0344857 [04/19/2021-12:49:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [04/19/2021-12:49:24] [V] [TRT] [04/19/2021-12:49:24] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,32928) -> Float(1,7,49,9408) *************** [04/19/2021-12:49:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:49:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:49:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:49:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:49:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:49:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:49:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:49:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:49:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:49:24] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block6a_project_conv/Conv2D (FusedConvActConvolution) [04/19/2021-12:49:24] [V] [TRT] Tactic: 589823 time 0.44513 [04/19/2021-12:49:24] [V] [TRT] Tactic: 655359 time 0.279603 [04/19/2021-12:49:24] [V] [TRT] Tactic: 786431 time 0.352877 [04/19/2021-12:49:24] [V] [TRT] Tactic: 851967 time 0.320814 [04/19/2021-12:49:24] [V] [TRT] Tactic: 1179647 time 0.225312 [04/19/2021-12:49:24] [V] [TRT] Tactic: 1310719 time 0.525332 [04/19/2021-12:49:25] [V] [TRT] Tactic: 1376255 time 0.284831 [04/19/2021-12:49:25] [V] [TRT] Tactic: 1441791 time 0.309206 [04/19/2021-12:49:25] [V] [TRT] Tactic: 1507327 time 0.294238 [04/19/2021-12:49:25] [V] [TRT] Tactic: 1638399 time 0.353945 [04/19/2021-12:49:25] [V] [TRT] Tactic: 1835007 time 0.25776 [04/19/2021-12:49:25] [V] [TRT] Tactic: 1900543 time 0.534811 [04/19/2021-12:49:25] [V] [TRT] Tactic: 2097151 time 0.216094 [04/19/2021-12:49:25] [V] [TRT] Tactic: 2162687 time 0.2936 [04/19/2021-12:49:25] [V] [TRT] Tactic: 2293759 time 0.268887 [04/19/2021-12:49:25] [V] [TRT] Tactic: 2359295 time 0.33041 [04/19/2021-12:49:25] [V] [TRT] Tactic: 2686975 time 0.271959 [04/19/2021-12:49:25] [V] [TRT] Tactic: 3080191 time 0.278555 [04/19/2021-12:49:25] [V] [TRT] Tactic: 3342335 time 0.431458 [04/19/2021-12:49:25] [V] [TRT] Tactic: 3407871 time 0.178509 [04/19/2021-12:49:25] [V] [TRT] Tactic: 3538943 time 0.186641 [04/19/2021-12:49:25] [V] [TRT] Tactic: 3670015 time 0.523248 [04/19/2021-12:49:25] [V] [TRT] Tactic: 3932159 time 0.25194 [04/19/2021-12:49:25] [V] [TRT] Tactic: 3997695 time 0.331784 [04/19/2021-12:49:25] [V] [TRT] Tactic: 4063231 time 0.250488 [04/19/2021-12:49:25] [V] [TRT] Tactic: 4194303 time 0.234616 [04/19/2021-12:49:25] [V] [TRT] Tactic: 4259839 time 0.228887 [04/19/2021-12:49:25] [V] [TRT] Tactic: 4325375 time 0.332903 [04/19/2021-12:49:25] [V] [TRT] Tactic: 4521983 time 0.302891 [04/19/2021-12:49:25] [V] [TRT] Tactic: 4587519 time 0.266211 [04/19/2021-12:49:25] [V] [TRT] Tactic: 4653055 time 0.254414 [04/19/2021-12:49:25] [V] [TRT] Tactic: 4915199 time 0.198548 [04/19/2021-12:49:25] [V] [TRT] Tactic: 4980735 time 0.381621 [04/19/2021-12:49:25] [V] [TRT] Tactic: 5177343 time 0.226849 [04/19/2021-12:49:25] [V] [TRT] Tactic: 5242879 time 0.166081 [04/19/2021-12:49:25] [V] [TRT] Tactic: 5373951 time 0.23569 [04/19/2021-12:49:25] [V] [TRT] Tactic: 5439487 time 0.237318 [04/19/2021-12:49:25] [V] [TRT] Tactic: 5570559 time 0.285645 [04/19/2021-12:49:25] [V] [TRT] Tactic: 5636095 time 0.251972 [04/19/2021-12:49:25] [V] [TRT] Tactic: 5701631 time 0.263301 [04/19/2021-12:49:25] [V] [TRT] Tactic: 5767167 time 0.329466 [04/19/2021-12:49:25] [V] [TRT] Tactic: 5832703 time 0.177481 [04/19/2021-12:49:25] [V] [TRT] Tactic: 5898239 time 0.154824 [04/19/2021-12:49:25] [V] [TRT] Tactic: 6029311 time 0.25929 [04/19/2021-12:49:25] [V] [TRT] Tactic: 6225919 time 0.173691 [04/19/2021-12:49:25] [V] [TRT] Tactic: 6291455 time 0.227943 [04/19/2021-12:49:25] [V] [TRT] Tactic: 6422527 time 0.261986 [04/19/2021-12:49:26] [V] [TRT] Tactic: 6750207 time 0.213659 [04/19/2021-12:49:26] [V] [TRT] Tactic: 6815743 time 0.165332 [04/19/2021-12:49:26] [V] [TRT] Tactic: 6946815 time 0.270944 [04/19/2021-12:49:26] [V] [TRT] Tactic: 7012351 time 0.216569 [04/19/2021-12:49:26] [V] [TRT] Tactic: 7077887 time 0.18278 [04/19/2021-12:49:26] [V] [TRT] Tactic: 7143423 time 0.352747 [04/19/2021-12:49:26] [V] [TRT] Tactic: 7208959 time 0.177044 [04/19/2021-12:49:26] [V] [TRT] Tactic: 7340031 time 0.153717 [04/19/2021-12:49:26] [V] [TRT] Tactic: 7405567 time 0.248555 [04/19/2021-12:49:26] [V] [TRT] Tactic: 7536639 time 0.243047 [04/19/2021-12:49:26] [V] [TRT] Tactic: 7602175 time 0.270156 [04/19/2021-12:49:26] [V] [TRT] Tactic: 7733247 time 0.174577 [04/19/2021-12:49:26] [V] [TRT] Tactic: 7798783 time 0.352083 [04/19/2021-12:49:26] [V] [TRT] Tactic: 8191999 time 0.339909 [04/19/2021-12:49:26] [V] [TRT] Tactic: 8257535 time 0.199902 [04/19/2021-12:49:26] [V] [TRT] Tactic: 8323071 time 0.237409 [04/19/2021-12:49:26] [V] [TRT] Tactic: 8650751 time 0.270247 [04/19/2021-12:49:26] [V] [TRT] Tactic: 8716287 time 0.178125 [04/19/2021-12:49:26] [V] [TRT] Tactic: 9109503 time 0.217298 [04/19/2021-12:49:26] [V] [TRT] Tactic: 9568255 time 0.198262 [04/19/2021-12:49:26] [V] [TRT] Tactic: 9895935 time 0.233457 [04/19/2021-12:49:26] [V] [TRT] Tactic: 10223615 time 0.275735 [04/19/2021-12:49:26] [V] [TRT] Tactic: 10354687 time 0.222389 [04/19/2021-12:49:26] [V] [TRT] Tactic: 10551295 time 0.196276 [04/19/2021-12:49:26] [V] [TRT] Tactic: 10747903 time 0.174596 [04/19/2021-12:49:26] [V] [TRT] Tactic: 10944511 time 0.382422 [04/19/2021-12:49:26] [V] [TRT] Fastest Tactic: 7340031 Time: 0.153717 [04/19/2021-12:49:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block6a_project_conv/Conv2D (CaskConvolution) [04/19/2021-12:49:26] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:49:26] [V] [TRT] Tactic: 1062367460111450758 time 0.225085 [04/19/2021-12:49:26] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:49:26] [V] [TRT] Tactic: 4501471010995462441 time 0.240547 [04/19/2021-12:49:26] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:49:26] [V] [TRT] Tactic: 5137655947464784826 time 0.195052 [04/19/2021-12:49:26] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:49:26] [V] [TRT] Tactic: 5326823351883942011 time 0.232304 [04/19/2021-12:49:26] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:49:26] [V] [TRT] Tactic: 6645123197870846056 time 0.20127 [04/19/2021-12:49:26] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:49:26] [V] [TRT] Tactic: -6576203419454146580 time 0.205788 [04/19/2021-12:49:26] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:49:26] [V] [TRT] Tactic: -3456450830548107839 time 0.214766 [04/19/2021-12:49:26] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:49:26] [V] [TRT] Tactic: -410470605513481746 time 0.236185 [04/19/2021-12:49:26] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:49:26] [V] [TRT] Tactic: -37215280111360163 time 0.191536 [04/19/2021-12:49:26] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.191536 [04/19/2021-12:49:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block6a_project_conv/Conv2D (CudaConvolution) [04/19/2021-12:49:26] [V] [TRT] Tactic: 0 time 0.258639 [04/19/2021-12:49:26] [V] [TRT] Tactic: 2 time 0.393477 [04/19/2021-12:49:26] [V] [TRT] Tactic: 5 time 8.79432 [04/19/2021-12:49:26] [V] [TRT] Tactic: 57 time 0.224877 [04/19/2021-12:49:26] [V] [TRT] Fastest Tactic: 57 Time: 0.224877 [04/19/2021-12:49:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block6a_project_conv/Conv2D (CudaDepthwiseConvolution) [04/19/2021-12:49:26] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/19/2021-12:49:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 7340031 [04/19/2021-12:49:26] [V] [TRT] [04/19/2021-12:49:26] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,9408) -> Float(1,7,49,56448) *************** [04/19/2021-12:49:26] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:49:26] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:49:26] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:49:26] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:49:26] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:49:26] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:49:26] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:49:26] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:49:26] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:49:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D (FusedConvActConvolution) [04/19/2021-12:49:26] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/19/2021-12:49:26] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D (CaskConvolution) [04/19/2021-12:49:26] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:49:26] [V] [TRT] Tactic: 1062367460111450758 time 0.432168 [04/19/2021-12:49:26] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:49:26] [V] [TRT] Tactic: 4501471010995462441 time 0.340983 [04/19/2021-12:49:26] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:49:27] [V] [TRT] Tactic: 5137655947464784826 time 0.338157 [04/19/2021-12:49:27] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:49:27] [V] [TRT] Tactic: 5326823351883942011 time 0.327233 [04/19/2021-12:49:27] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:49:27] [V] [TRT] Tactic: 6645123197870846056 time 0.346862 [04/19/2021-12:49:27] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:49:27] [V] [TRT] Tactic: -6576203419454146580 time 0.393698 [04/19/2021-12:49:27] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:49:27] [V] [TRT] Tactic: -3456450830548107839 time 0.407871 [04/19/2021-12:49:27] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:49:27] [V] [TRT] Tactic: -410470605513481746 time 0.339192 [04/19/2021-12:49:27] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:49:27] [V] [TRT] Tactic: -37215280111360163 time 0.331666 [04/19/2021-12:49:27] [V] [TRT] Fastest Tactic: 5326823351883942011 Time: 0.327233 [04/19/2021-12:49:27] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D (CudaConvolution) [04/19/2021-12:49:27] [V] [TRT] Tactic: 0 time 0.562415 [04/19/2021-12:49:27] [V] [TRT] Tactic: 2 time 0.613158 [04/19/2021-12:49:27] [V] [TRT] Tactic: 5 time 18.3454 [04/19/2021-12:49:27] [V] [TRT] Tactic: 57 time 0.489798 [04/19/2021-12:49:27] [V] [TRT] Fastest Tactic: 57 Time: 0.489798 [04/19/2021-12:49:27] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D (CudaDepthwiseConvolution) [04/19/2021-12:49:27] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/19/2021-12:49:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5326823351883942011 [04/19/2021-12:49:27] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:49:27] [V] [TRT] [04/19/2021-12:49:27] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:49:27] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:49:27] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:49:27] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:49:27] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:49:27] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:49:27] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:49:27] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:49:27] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:49:27] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:49:27] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:49:27] [V] [TRT] Tactic: 1002 time 0.181276 [04/19/2021-12:49:27] [V] [TRT] Tactic: 0 time 0.134733 [04/19/2021-12:49:27] [V] [TRT] Fastest Tactic: 0 Time: 0.134733 [04/19/2021-12:49:27] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:49:27] [V] [TRT] Tactic: 1002 time 0.18097 [04/19/2021-12:49:27] [V] [TRT] Tactic: 0 time 0.134362 [04/19/2021-12:49:27] [V] [TRT] Fastest Tactic: 0 Time: 0.134362 [04/19/2021-12:49:27] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:49:27] [V] [TRT] Tactic: 1002 time 0.49791 [04/19/2021-12:49:27] [V] [TRT] Tactic: 0 time 0.101888 [04/19/2021-12:49:27] [V] [TRT] Fastest Tactic: 0 Time: 0.101888 [04/19/2021-12:49:27] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,56448) -> Float(1,7,49,56448) *************** [04/19/2021-12:49:27] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6b_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6b_expand_activation/mul) (PointWise) [04/19/2021-12:49:27] [V] [TRT] Tactic: 128 time 0.128529 [04/19/2021-12:49:27] [V] [TRT] Tactic: 256 time 0.129004 [04/19/2021-12:49:27] [V] [TRT] Tactic: 512 time 0.130508 [04/19/2021-12:49:27] [V] [TRT] Tactic: -32 time 0.145899 [04/19/2021-12:49:27] [V] [TRT] Tactic: -64 time 0.139395 [04/19/2021-12:49:27] [V] [TRT] Tactic: -128 time 0.137142 [04/19/2021-12:49:27] [V] [TRT] Fastest Tactic: 128 Time: 0.128529 [04/19/2021-12:49:27] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6b_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6b_expand_activation/mul) (PointWiseV2) [04/19/2021-12:49:27] [V] [TRT] Tactic: 0 time 0.0627929 [04/19/2021-12:49:27] [V] [TRT] Tactic: 1 time 0.0476822 [04/19/2021-12:49:27] [V] [TRT] Tactic: 2 time 0.0430339 [04/19/2021-12:49:27] [V] [TRT] Tactic: 3 time 0.0402346 [04/19/2021-12:49:27] [V] [TRT] Tactic: 4 time 0.0327344 [04/19/2021-12:49:27] [V] [TRT] Tactic: 5 time 0.0335741 [04/19/2021-12:49:27] [V] [TRT] Tactic: 6 time 0.0394337 [04/19/2021-12:49:27] [V] [TRT] Tactic: 7 time 0.0310938 [04/19/2021-12:49:27] [V] [TRT] Tactic: 8 time 0.0290495 [04/19/2021-12:49:27] [V] [TRT] Tactic: 9 time 0.0292512 [04/19/2021-12:49:27] [V] [TRT] Tactic: 28 time 0.0611978 [04/19/2021-12:49:27] [V] [TRT] Fastest Tactic: 8 Time: 0.0290495 [04/19/2021-12:49:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [04/19/2021-12:49:27] [V] [TRT] [04/19/2021-12:49:27] [V] [TRT] *************** Autotuning format combination: Float(1,7,49:32,1764) -> Float(1,7,49:32,1764) *************** [04/19/2021-12:49:28] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6b_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6b_expand_activation/mul) (PointWise) [04/19/2021-12:49:28] [V] [TRT] Tactic: 128 time 0.128691 [04/19/2021-12:49:28] [V] [TRT] Tactic: 256 time 0.129167 [04/19/2021-12:49:28] [V] [TRT] Tactic: 512 time 0.130833 [04/19/2021-12:49:28] [V] [TRT] Tactic: -32 time 0.145775 [04/19/2021-12:49:28] [V] [TRT] Tactic: -64 time 0.139225 [04/19/2021-12:49:28] [V] [TRT] Tactic: -128 time 0.137526 [04/19/2021-12:49:28] [V] [TRT] Fastest Tactic: 128 Time: 0.128691 [04/19/2021-12:49:28] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6b_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6b_expand_activation/mul) (PointWiseV2) [04/19/2021-12:49:28] [V] [TRT] Tactic: 24 time 0.0454756 [04/19/2021-12:49:28] [V] [TRT] Tactic: 25 time 0.0418751 [04/19/2021-12:49:28] [V] [TRT] Tactic: 26 time 0.041569 [04/19/2021-12:49:28] [V] [TRT] Tactic: 27 time 0.042754 [04/19/2021-12:49:28] [V] [TRT] Tactic: 31 time 0.0460091 [04/19/2021-12:49:28] [V] [TRT] Fastest Tactic: 26 Time: 0.041569 [04/19/2021-12:49:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [04/19/2021-12:49:28] [V] [TRT] [04/19/2021-12:49:28] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,56448) -> Float(1,7,49,56448) *************** [04/19/2021-12:49:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:49:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [04/19/2021-12:49:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:49:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:49:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:49:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [04/19/2021-12:49:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [04/19/2021-12:49:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:49:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:49:28] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block6b_dwconv/depthwise (FusedConvActConvolution) [04/19/2021-12:49:28] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/19/2021-12:49:28] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block6b_dwconv/depthwise (CaskConvolution) [04/19/2021-12:49:28] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:49:29] [V] [TRT] Tactic: 1062367460111450758 time 31.9215 [04/19/2021-12:49:29] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [04/19/2021-12:49:30] [V] [TRT] Tactic: 4337000649858996379 time 33.1129 [04/19/2021-12:49:30] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:49:31] [V] [TRT] Tactic: 4501471010995462441 time 32.5921 [04/19/2021-12:49:31] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:49:32] [V] [TRT] Tactic: 5137655947464784826 time 31.794 [04/19/2021-12:49:32] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:49:32] [V] [TRT] Tactic: 6645123197870846056 time 34.1034 [04/19/2021-12:49:32] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [04/19/2021-12:49:33] [V] [TRT] Tactic: -9137461792520977713 time 33.8597 [04/19/2021-12:49:33] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [04/19/2021-12:49:34] [V] [TRT] Tactic: -6092040395344634144 time 33.0375 [04/19/2021-12:49:34] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:49:35] [V] [TRT] Tactic: -3456450830548107839 time 34.6872 [04/19/2021-12:49:35] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:49:36] [V] [TRT] Tactic: -410470605513481746 time 32.2539 [04/19/2021-12:49:36] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 31.794 [04/19/2021-12:49:36] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block6b_dwconv/depthwise (CudaConvolution) [04/19/2021-12:49:36] [V] [TRT] Tactic: 0 time 0.577565 [04/19/2021-12:49:36] [V] [TRT] Tactic: 2 time 0.577389 [04/19/2021-12:49:42] [V] [TRT] Tactic: 5 time 358.848 [04/19/2021-12:49:42] [V] [TRT] Tactic: 57 time 0.57293 [04/19/2021-12:49:42] [V] [TRT] Fastest Tactic: 57 Time: 0.57293 [04/19/2021-12:49:42] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block6b_dwconv/depthwise (CudaDepthwiseConvolution) [04/19/2021-12:49:42] [V] [TRT] Tactic: -1 time 0.674987 [04/19/2021-12:49:42] [V] [TRT] Fastest Tactic: -1 Time: 0.674987 [04/19/2021-12:49:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 57 [04/19/2021-12:49:42] [V] [TRT] [04/19/2021-12:49:42] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,56448) -> Float(1,7,49,56448) *************** [04/19/2021-12:49:42] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6b_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6b_activation/mul) (PointWise) [04/19/2021-12:49:42] [V] [TRT] Tactic: 128 time 0.128652 [04/19/2021-12:49:42] [V] [TRT] Tactic: 256 time 0.12905 [04/19/2021-12:49:42] [V] [TRT] Tactic: 512 time 0.130612 [04/19/2021-12:49:42] [V] [TRT] Tactic: -32 time 0.14569 [04/19/2021-12:49:42] [V] [TRT] Tactic: -64 time 0.139434 [04/19/2021-12:49:42] [V] [TRT] Tactic: -128 time 0.137493 [04/19/2021-12:49:42] [V] [TRT] Fastest Tactic: 128 Time: 0.128652 [04/19/2021-12:49:42] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6b_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6b_activation/mul) (PointWiseV2) [04/19/2021-12:49:42] [V] [TRT] Tactic: 0 time 0.0627994 [04/19/2021-12:49:42] [V] [TRT] Tactic: 1 time 0.0478191 [04/19/2021-12:49:42] [V] [TRT] Tactic: 2 time 0.043151 [04/19/2021-12:49:42] [V] [TRT] Tactic: 3 time 0.040983 [04/19/2021-12:49:42] [V] [TRT] Tactic: 4 time 0.0329429 [04/19/2021-12:49:42] [V] [TRT] Tactic: 5 time 0.0340363 [04/19/2021-12:49:42] [V] [TRT] Tactic: 6 time 0.040039 [04/19/2021-12:49:42] [V] [TRT] Tactic: 7 time 0.031979 [04/19/2021-12:49:42] [V] [TRT] Tactic: 8 time 0.0283921 [04/19/2021-12:49:42] [V] [TRT] Tactic: 9 time 0.0291796 [04/19/2021-12:49:42] [V] [TRT] Tactic: 28 time 0.0609961 [04/19/2021-12:49:42] [V] [TRT] Fastest Tactic: 8 Time: 0.0283921 [04/19/2021-12:49:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [04/19/2021-12:49:42] [V] [TRT] [04/19/2021-12:49:42] [V] [TRT] *************** Autotuning format combination: Float(1,7,49:32,1764) -> Float(1,7,49:32,1764) *************** [04/19/2021-12:49:42] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6b_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6b_activation/mul) (PointWise) [04/19/2021-12:49:42] [V] [TRT] Tactic: 128 time 0.128789 [04/19/2021-12:49:42] [V] [TRT] Tactic: 256 time 0.129225 [04/19/2021-12:49:42] [V] [TRT] Tactic: 512 time 0.130657 [04/19/2021-12:49:42] [V] [TRT] Tactic: -32 time 0.144883 [04/19/2021-12:49:42] [V] [TRT] Tactic: -64 time 0.138867 [04/19/2021-12:49:42] [V] [TRT] Tactic: -128 time 0.137148 [04/19/2021-12:49:42] [V] [TRT] Fastest Tactic: 128 Time: 0.128789 [04/19/2021-12:49:42] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6b_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6b_activation/mul) (PointWiseV2) [04/19/2021-12:49:42] [V] [TRT] Tactic: 24 time 0.0463216 [04/19/2021-12:49:42] [V] [TRT] Tactic: 25 time 0.0419596 [04/19/2021-12:49:42] [V] [TRT] Tactic: 26 time 0.0420507 [04/19/2021-12:49:42] [V] [TRT] Tactic: 27 time 0.0424023 [04/19/2021-12:49:42] [V] [TRT] Tactic: 31 time 0.0461068 [04/19/2021-12:49:42] [V] [TRT] Fastest Tactic: 25 Time: 0.0419596 [04/19/2021-12:49:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [04/19/2021-12:49:42] [V] [TRT] [04/19/2021-12:49:42] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:49:42] [V] [TRT] Tactic: 1002 time 0.498991 [04/19/2021-12:49:43] [V] [TRT] Tactic: 0 time 0.101797 [04/19/2021-12:49:43] [V] [TRT] Fastest Tactic: 0 Time: 0.101797 [04/19/2021-12:49:43] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,56448) -> Float(1,1152) *************** [04/19/2021-12:49:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block6b_se_squeeze/Mean (Reduce) [04/19/2021-12:49:43] [V] [TRT] Tactic: 1 time 0.89291 [04/19/2021-12:49:43] [V] [TRT] Tactic: 3 time 0.106295 [04/19/2021-12:49:43] [V] [TRT] Tactic: 6 time 0.455846 [04/19/2021-12:49:43] [V] [TRT] Fastest Tactic: 3 Time: 0.106295 [04/19/2021-12:49:43] [V] [TRT] *************** Autotuning format combination: Float(1,1152) -> Float(1,1,1,1152) *************** [04/19/2021-12:49:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block6b_se_reshape/Reshape + StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd__275 (Shuffle) [04/19/2021-12:49:43] [V] [TRT] Tactic: 0 time 0.00330075 [04/19/2021-12:49:43] [V] [TRT] Tactic: 1 time 0.0117315 [04/19/2021-12:49:43] [V] [TRT] Fastest Tactic: 0 Time: 0.00330075 [04/19/2021-12:49:43] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,1152) -> Float(1,1,1,48) *************** [04/19/2021-12:49:43] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:49:43] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:49:43] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:49:43] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:49:43] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:49:43] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:49:43] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:49:43] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:49:43] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:49:43] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd (FusedConvActConvolution) [04/19/2021-12:49:43] [V] [TRT] Tactic: 589823 time 0.339479 [04/19/2021-12:49:43] [V] [TRT] Tactic: 655359 time 0.229837 [04/19/2021-12:49:43] [V] [TRT] Tactic: 786431 time 0.0991341 [04/19/2021-12:49:43] [V] [TRT] Tactic: 851967 time 0.075215 [04/19/2021-12:49:43] [V] [TRT] Tactic: 1179647 time 0.0478257 [04/19/2021-12:49:43] [V] [TRT] Tactic: 1310719 time 0.464629 [04/19/2021-12:49:43] [V] [TRT] Tactic: 1376255 time 0.249323 [04/19/2021-12:49:43] [V] [TRT] Tactic: 1441791 time 0.0625391 [04/19/2021-12:49:43] [V] [TRT] Tactic: 1507327 time 0.138496 [04/19/2021-12:49:43] [V] [TRT] Tactic: 1638399 time 0.0697006 [04/19/2021-12:49:43] [V] [TRT] Tactic: 1835007 time 0.09459 [04/19/2021-12:49:43] [V] [TRT] Tactic: 1900543 time 0.252148 [04/19/2021-12:49:43] [V] [TRT] Tactic: 2097151 time 0.0537891 [04/19/2021-12:49:43] [V] [TRT] Tactic: 2162687 time 0.252168 [04/19/2021-12:49:43] [V] [TRT] Tactic: 2293759 time 0.232832 [04/19/2021-12:49:43] [V] [TRT] Tactic: 2359295 time 0.147122 [04/19/2021-12:49:43] [V] [TRT] Tactic: 2686975 time 0.234076 [04/19/2021-12:49:43] [V] [TRT] Tactic: 3080191 time 0.125313 [04/19/2021-12:49:43] [V] [TRT] Tactic: 3342335 time 0.138424 [04/19/2021-12:49:43] [V] [TRT] Tactic: 3407871 time 0.121621 [04/19/2021-12:49:43] [V] [TRT] Tactic: 3538943 time 0.07028 [04/19/2021-12:49:43] [V] [TRT] Tactic: 3670015 time 0.482949 [04/19/2021-12:49:43] [V] [TRT] Tactic: 3932159 time 0.194609 [04/19/2021-12:49:43] [V] [TRT] Tactic: 3997695 time 0.0609114 [04/19/2021-12:49:43] [V] [TRT] Tactic: 4063231 time 0.0742252 [04/19/2021-12:49:43] [V] [TRT] Tactic: 4194303 time 0.0964844 [04/19/2021-12:49:43] [V] [TRT] Tactic: 4259839 time 0.0626041 [04/19/2021-12:49:43] [V] [TRT] Tactic: 4325375 time 0.10334 [04/19/2021-12:49:43] [V] [TRT] Tactic: 4521983 time 0.237265 [04/19/2021-12:49:43] [V] [TRT] Tactic: 4587519 time 0.0580274 [04/19/2021-12:49:43] [V] [TRT] Tactic: 4653055 time 0.0515301 [04/19/2021-12:49:43] [V] [TRT] Tactic: 4915199 time 0.0629297 [04/19/2021-12:49:43] [V] [TRT] Tactic: 4980735 time 0.145612 [04/19/2021-12:49:43] [V] [TRT] Tactic: 5177343 time 0.0473827 [04/19/2021-12:49:43] [V] [TRT] Tactic: 5242879 time 0.113613 [04/19/2021-12:49:43] [V] [TRT] Tactic: 5373951 time 0.0474609 [04/19/2021-12:49:43] [V] [TRT] Tactic: 5439487 time 0.0964712 [04/19/2021-12:49:43] [V] [TRT] Tactic: 5570559 time 0.13403 [04/19/2021-12:49:43] [V] [TRT] Tactic: 5636095 time 0.075586 [04/19/2021-12:49:43] [V] [TRT] Tactic: 5701631 time 0.220182 [04/19/2021-12:49:43] [V] [TRT] Tactic: 5767167 time 0.111068 [04/19/2021-12:49:43] [V] [TRT] Tactic: 5832703 time 0.115482 [04/19/2021-12:49:44] [V] [TRT] Tactic: 5898239 time 0.0644534 [04/19/2021-12:49:44] [V] [TRT] Tactic: 6029311 time 0.213574 [04/19/2021-12:49:44] [V] [TRT] Tactic: 6225919 time 0.0660939 [04/19/2021-12:49:44] [V] [TRT] Tactic: 6291455 time 0.0470638 [04/19/2021-12:49:44] [V] [TRT] Tactic: 6422527 time 0.114902 [04/19/2021-12:49:44] [V] [TRT] Tactic: 6750207 time 0.0582941 [04/19/2021-12:49:44] [V] [TRT] Tactic: 6815743 time 0.112956 [04/19/2021-12:49:44] [V] [TRT] Tactic: 6946815 time 0.131498 [04/19/2021-12:49:44] [V] [TRT] Tactic: 7012351 time 0.0534374 [04/19/2021-12:49:44] [V] [TRT] Tactic: 7077887 time 0.0666406 [04/19/2021-12:49:44] [V] [TRT] Tactic: 7143423 time 0.111725 [04/19/2021-12:49:44] [V] [TRT] Tactic: 7208959 time 0.115911 [04/19/2021-12:49:44] [V] [TRT] Tactic: 7340031 time 0.0619984 [04/19/2021-12:49:44] [V] [TRT] Tactic: 7405567 time 0.0679491 [04/19/2021-12:49:44] [V] [TRT] Tactic: 7536639 time 0.18013 [04/19/2021-12:49:44] [V] [TRT] Tactic: 7602175 time 0.131152 [04/19/2021-12:49:44] [V] [TRT] Tactic: 7733247 time 0.0756641 [04/19/2021-12:49:44] [V] [TRT] Tactic: 7798783 time 0.0987436 [04/19/2021-12:49:44] [V] [TRT] Tactic: 8191999 time 0.0804363 [04/19/2021-12:49:44] [V] [TRT] Tactic: 8257535 time 0.0627865 [04/19/2021-12:49:44] [V] [TRT] Tactic: 8323071 time 0.0970704 [04/19/2021-12:49:44] [V] [TRT] Tactic: 8650751 time 0.131432 [04/19/2021-12:49:44] [V] [TRT] Tactic: 8716287 time 0.0655466 [04/19/2021-12:49:44] [V] [TRT] Tactic: 9109503 time 0.0533853 [04/19/2021-12:49:44] [V] [TRT] Tactic: 9568255 time 0.0635612 [04/19/2021-12:49:44] [V] [TRT] Tactic: 9895935 time 0.0964192 [04/19/2021-12:49:44] [V] [TRT] Tactic: 10223615 time 0.233867 [04/19/2021-12:49:44] [V] [TRT] Tactic: 10354687 time 0.0620897 [04/19/2021-12:49:44] [V] [TRT] Tactic: 10551295 time 0.135039 [04/19/2021-12:49:44] [V] [TRT] Tactic: 10747903 time 0.0757944 [04/19/2021-12:49:44] [V] [TRT] Tactic: 10944511 time 0.14528 [04/19/2021-12:49:44] [V] [TRT] Fastest Tactic: 6291455 Time: 0.0470638 [04/19/2021-12:49:44] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd (CaskConvolution) [04/19/2021-12:49:44] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:49:44] [V] [TRT] Tactic: 1062367460111450758 time 0.205078 [04/19/2021-12:49:44] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:49:44] [V] [TRT] Tactic: 4501471010995462441 time 0.221816 [04/19/2021-12:49:44] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:49:44] [V] [TRT] Tactic: 5137655947464784826 time 0.148321 [04/19/2021-12:49:44] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:49:44] [V] [TRT] Tactic: 5326823351883942011 time 0.211081 [04/19/2021-12:49:44] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:49:44] [V] [TRT] Tactic: 6645123197870846056 time 0.160593 [04/19/2021-12:49:44] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:49:44] [V] [TRT] Tactic: -6576203419454146580 time 0.161361 [04/19/2021-12:49:44] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:49:44] [V] [TRT] Tactic: -3456450830548107839 time 0.170508 [04/19/2021-12:49:44] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:49:44] [V] [TRT] Tactic: -410470605513481746 time 0.214349 [04/19/2021-12:49:44] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:49:44] [V] [TRT] Tactic: -37215280111360163 time 0.146113 [04/19/2021-12:49:44] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.146113 [04/19/2021-12:49:44] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd (CudaConvolution) [04/19/2021-12:49:44] [V] [TRT] Tactic: 0 time 0.175651 [04/19/2021-12:49:44] [V] [TRT] Tactic: 2 time 0.341341 [04/19/2021-12:49:44] [V] [TRT] Tactic: 5 time 2.07688 [04/19/2021-12:49:44] [V] [TRT] Tactic: 57 time 0.139759 [04/19/2021-12:49:44] [V] [TRT] Fastest Tactic: 57 Time: 0.139759 [04/19/2021-12:49:44] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd (CudaDepthwiseConvolution) [04/19/2021-12:49:44] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/19/2021-12:49:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 6291455 [04/19/2021-12:49:44] [V] [TRT] [04/19/2021-12:49:44] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:49:44] [V] [TRT] Tactic: 1002 time 0.00801438 [04/19/2021-12:49:44] [V] [TRT] Tactic: 0 time 0.00570325 [04/19/2021-12:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.00570325 [04/19/2021-12:49:44] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:49:44] [V] [TRT] Tactic: 1002 time 0.00806638 [04/19/2021-12:49:44] [V] [TRT] Tactic: 0 time 0.005456 [04/19/2021-12:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.005456 [04/19/2021-12:49:44] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:49:44] [V] [TRT] Tactic: 1002 time 0.00803375 [04/19/2021-12:49:44] [V] [TRT] Tactic: 0 time 0.00521488 [04/19/2021-12:49:44] [V] [TRT] Fastest Tactic: 0 Time: 0.00521488 [04/19/2021-12:49:44] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,48) -> Float(1,1,1,48) *************** [04/19/2021-12:49:44] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/mul) (PointWise) [04/19/2021-12:49:44] [V] [TRT] Tactic: 128 time 0.0057555 [04/19/2021-12:49:44] [V] [TRT] Tactic: 256 time 0.00574213 [04/19/2021-12:49:44] [V] [TRT] Tactic: 512 time 0.00569012 [04/19/2021-12:49:44] [V] [TRT] Tactic: -32 time 0.00759112 [04/19/2021-12:49:44] [V] [TRT] Tactic: -64 time 0.0057095 [04/19/2021-12:49:44] [V] [TRT] Tactic: -128 time 0.00570975 [04/19/2021-12:49:44] [V] [TRT] Fastest Tactic: 512 Time: 0.00569012 [04/19/2021-12:49:44] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/mul) (PointWiseV2) [04/19/2021-12:49:44] [V] [TRT] Tactic: 0 time 0.00397787 [04/19/2021-12:49:44] [V] [TRT] Tactic: 1 time 0.00565775 [04/19/2021-12:49:44] [V] [TRT] Tactic: 2 time 0.00488913 [04/19/2021-12:49:45] [V] [TRT] Tactic: 3 time 0.00559862 [04/19/2021-12:49:45] [V] [TRT] Tactic: 4 time 0.005599 [04/19/2021-12:49:45] [V] [TRT] Tactic: 5 time 0.005371 [04/19/2021-12:49:45] [V] [TRT] Tactic: 6 time 0.00568988 [04/19/2021-12:49:45] [V] [TRT] Tactic: 7 time 0.00564463 [04/19/2021-12:49:45] [V] [TRT] Tactic: 8 time 0.00549475 [04/19/2021-12:49:45] [V] [TRT] Tactic: 9 time 0.00513025 [04/19/2021-12:49:45] [V] [TRT] Tactic: 28 time 0.00410837 [04/19/2021-12:49:45] [V] [TRT] Fastest Tactic: 0 Time: 0.00397787 [04/19/2021-12:49:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [04/19/2021-12:49:45] [V] [TRT] [04/19/2021-12:49:45] [V] [TRT] *************** Autotuning format combination: Float(1,1,1:32,2) -> Float(1,1,1:32,2) *************** [04/19/2021-12:49:45] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/mul) (PointWise) [04/19/2021-12:49:45] [V] [TRT] Tactic: 128 time 0.00567712 [04/19/2021-12:49:45] [V] [TRT] Tactic: 256 time 0.00574225 [04/19/2021-12:49:45] [V] [TRT] Tactic: 512 time 0.00572263 [04/19/2021-12:49:45] [V] [TRT] Tactic: -32 time 0.00576162 [04/19/2021-12:49:45] [V] [TRT] Tactic: -64 time 0.00570288 [04/19/2021-12:49:45] [V] [TRT] Tactic: -128 time 0.00572263 [04/19/2021-12:49:45] [V] [TRT] Fastest Tactic: 128 Time: 0.00567712 [04/19/2021-12:49:45] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/mul) (PointWiseV2) [04/19/2021-12:49:45] [V] [TRT] Tactic: 24 time 0.0056315 [04/19/2021-12:49:45] [V] [TRT] Tactic: 25 time 0.0056445 [04/19/2021-12:49:45] [V] [TRT] Tactic: 26 time 0.00582037 [04/19/2021-12:49:45] [V] [TRT] Tactic: 27 time 0.00794925 [04/19/2021-12:49:45] [V] [TRT] Tactic: 31 time 0.0056185 [04/19/2021-12:49:45] [V] [TRT] Fastest Tactic: 31 Time: 0.0056185 [04/19/2021-12:49:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [04/19/2021-12:49:45] [V] [TRT] [04/19/2021-12:49:45] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,48) -> Float(1,1,1,1152) *************** [04/19/2021-12:49:45] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:49:45] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:49:45] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:49:45] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:49:45] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:49:45] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:49:45] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:49:45] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:49:45] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:49:45] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd (FusedConvActConvolution) [04/19/2021-12:49:45] [V] [TRT] Tactic: 589823 time 0.0617448 [04/19/2021-12:49:45] [V] [TRT] Tactic: 655359 time 0.0411914 [04/19/2021-12:49:45] [V] [TRT] Tactic: 786431 time 0.0611134 [04/19/2021-12:49:45] [V] [TRT] Tactic: 851967 time 0.0396095 [04/19/2021-12:49:45] [V] [TRT] Tactic: 1179647 time 0.0358398 [04/19/2021-12:49:45] [V] [TRT] Tactic: 1310719 time 0.129401 [04/19/2021-12:49:45] [V] [TRT] Tactic: 1376255 time 0.0339451 [04/19/2021-12:49:45] [V] [TRT] Tactic: 1441791 time 0.0717771 [04/19/2021-12:49:45] [V] [TRT] Tactic: 1507327 time 0.0463281 [04/19/2021-12:49:45] [V] [TRT] Tactic: 1638399 time 0.075241 [04/19/2021-12:49:45] [V] [TRT] Tactic: 1835007 time 0.044499 [04/19/2021-12:49:45] [V] [TRT] Tactic: 1900543 time 0.0480011 [04/19/2021-12:49:45] [V] [TRT] Tactic: 2162687 time 0.0366146 [04/19/2021-12:49:45] [V] [TRT] Tactic: 2293759 time 0.0300196 [04/19/2021-12:49:45] [V] [TRT] Tactic: 2359295 time 0.0569791 [04/19/2021-12:49:45] [V] [TRT] Tactic: 2686975 time 0.030521 [04/19/2021-12:49:45] [V] [TRT] Tactic: 3080191 time 0.0369273 [04/19/2021-12:49:45] [V] [TRT] Tactic: 3342335 time 0.046719 [04/19/2021-12:49:45] [V] [TRT] Tactic: 3407871 time 0.0314909 [04/19/2021-12:49:45] [V] [TRT] Tactic: 3538943 time 0.0302803 [04/19/2021-12:49:45] [V] [TRT] Tactic: 3670015 time 0.0416471 [04/19/2021-12:49:45] [V] [TRT] Tactic: 3932159 time 0.0218815 [04/19/2021-12:49:45] [V] [TRT] Tactic: 3997695 time 0.064974 [04/19/2021-12:49:45] [V] [TRT] Tactic: 4063231 time 0.0415625 [04/19/2021-12:49:45] [V] [TRT] Tactic: 4194303 time 0.0664321 [04/19/2021-12:49:45] [V] [TRT] Tactic: 4325375 time 0.0651888 [04/19/2021-12:49:45] [V] [TRT] Tactic: 4521983 time 0.0580207 [04/19/2021-12:49:45] [V] [TRT] Tactic: 4587519 time 0.0670315 [04/19/2021-12:49:45] [V] [TRT] Tactic: 4653055 time 0.0643685 [04/19/2021-12:49:45] [V] [TRT] Tactic: 4915199 time 0.0683204 [04/19/2021-12:49:45] [V] [TRT] Tactic: 4980735 time 0.067552 [04/19/2021-12:49:45] [V] [TRT] Tactic: 5177343 time 0.0362824 [04/19/2021-12:49:45] [V] [TRT] Tactic: 5242879 time 0.0276496 [04/19/2021-12:49:45] [V] [TRT] Tactic: 5373951 time 0.036061 [04/19/2021-12:49:45] [V] [TRT] Tactic: 5439487 time 0.0306642 [04/19/2021-12:49:45] [V] [TRT] Tactic: 5570559 time 0.044082 [04/19/2021-12:49:45] [V] [TRT] Tactic: 5636095 time 0.0413867 [04/19/2021-12:49:45] [V] [TRT] Tactic: 5701631 time 0.0273634 [04/19/2021-12:49:45] [V] [TRT] Tactic: 5767167 time 0.0255342 [04/19/2021-12:49:45] [V] [TRT] Tactic: 5832703 time 0.0293944 [04/19/2021-12:49:45] [V] [TRT] Tactic: 5898239 time 0.0516015 [04/19/2021-12:49:45] [V] [TRT] Tactic: 6029311 time 0.0264906 [04/19/2021-12:49:46] [V] [TRT] Tactic: 6225919 time 0.0259699 [04/19/2021-12:49:46] [V] [TRT] Tactic: 6291455 time 0.0362041 [04/19/2021-12:49:46] [V] [TRT] Tactic: 6422527 time 0.024284 [04/19/2021-12:49:46] [V] [TRT] Tactic: 6750207 time 0.0348635 [04/19/2021-12:49:46] [V] [TRT] Tactic: 6815743 time 0.027422 [04/19/2021-12:49:46] [V] [TRT] Tactic: 6946815 time 0.0419141 [04/19/2021-12:49:46] [V] [TRT] Tactic: 7077887 time 0.0282487 [04/19/2021-12:49:46] [V] [TRT] Tactic: 7143423 time 0.0263933 [04/19/2021-12:49:46] [V] [TRT] Tactic: 7208959 time 0.0297525 [04/19/2021-12:49:46] [V] [TRT] Tactic: 7340031 time 0.0490886 [04/19/2021-12:49:46] [V] [TRT] Tactic: 7405567 time 0.0448567 [04/19/2021-12:49:46] [V] [TRT] Tactic: 7536639 time 0.0205926 [04/19/2021-12:49:46] [V] [TRT] Tactic: 7602175 time 0.0419921 [04/19/2021-12:49:46] [V] [TRT] Tactic: 7733247 time 0.0489846 [04/19/2021-12:49:46] [V] [TRT] Tactic: 7798783 time 0.0612891 [04/19/2021-12:49:46] [V] [TRT] Tactic: 8191999 time 0.0230988 [04/19/2021-12:49:46] [V] [TRT] Tactic: 8257535 time 0.0672396 [04/19/2021-12:49:46] [V] [TRT] Tactic: 8323071 time 0.0322916 [04/19/2021-12:49:46] [V] [TRT] Tactic: 8650751 time 0.0417771 [04/19/2021-12:49:46] [V] [TRT] Tactic: 8716287 time 0.0256444 [04/19/2021-12:49:46] [V] [TRT] Tactic: 9568255 time 0.0682162 [04/19/2021-12:49:46] [V] [TRT] Tactic: 9895935 time 0.0666213 [04/19/2021-12:49:46] [V] [TRT] Tactic: 10223615 time 0.0312499 [04/19/2021-12:49:46] [V] [TRT] Tactic: 10354687 time 0.0823698 [04/19/2021-12:49:46] [V] [TRT] Tactic: 10551295 time 0.0320635 [04/19/2021-12:49:46] [V] [TRT] Tactic: 10747903 time 0.0504429 [04/19/2021-12:49:46] [V] [TRT] Tactic: 10944511 time 0.0672657 [04/19/2021-12:49:46] [V] [TRT] Fastest Tactic: 7536639 Time: 0.0205926 [04/19/2021-12:49:46] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd (CaskConvolution) [04/19/2021-12:49:46] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:49:46] [V] [TRT] Tactic: 1062367460111450758 time 0.161159 [04/19/2021-12:49:46] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:49:46] [V] [TRT] Tactic: 4501471010995462441 time 0.125339 [04/19/2021-12:49:46] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:49:46] [V] [TRT] Tactic: 5137655947464784826 time 0.125045 [04/19/2021-12:49:46] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:49:46] [V] [TRT] Tactic: 5326823351883942011 time 0.122122 [04/19/2021-12:49:46] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:49:46] [V] [TRT] Tactic: 6645123197870846056 time 0.128731 [04/19/2021-12:49:46] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:49:46] [V] [TRT] Tactic: -6576203419454146580 time 0.145267 [04/19/2021-12:49:46] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:49:46] [V] [TRT] Tactic: -3456450830548107839 time 0.150807 [04/19/2021-12:49:46] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:49:46] [V] [TRT] Tactic: -410470605513481746 time 0.124785 [04/19/2021-12:49:46] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:49:46] [V] [TRT] Tactic: -37215280111360163 time 0.123496 [04/19/2021-12:49:46] [V] [TRT] Fastest Tactic: 5326823351883942011 Time: 0.122122 [04/19/2021-12:49:46] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd (CudaConvolution) [04/19/2021-12:49:46] [V] [TRT] Tactic: 0 time 0.0584373 [04/19/2021-12:49:46] [V] [TRT] Tactic: 2 time 0.0733855 [04/19/2021-12:49:46] [V] [TRT] Tactic: 5 time 3.57165 [04/19/2021-12:49:46] [V] [TRT] Tactic: 57 time 0.0524286 [04/19/2021-12:49:46] [V] [TRT] Fastest Tactic: 57 Time: 0.0524286 [04/19/2021-12:49:46] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd (CudaDepthwiseConvolution) [04/19/2021-12:49:46] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/19/2021-12:49:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 7536639 [04/19/2021-12:49:46] [V] [TRT] [04/19/2021-12:49:46] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:49:46] [V] [TRT] Tactic: 1002 time 0.0102994 [04/19/2021-12:49:46] [V] [TRT] Tactic: 0 time 0.0057555 [04/19/2021-12:49:46] [V] [TRT] Fastest Tactic: 0 Time: 0.0057555 [04/19/2021-12:49:46] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:49:46] [V] [TRT] Tactic: 1002 time 0.0103516 [04/19/2021-12:49:46] [V] [TRT] Tactic: 0 time 0.00569 [04/19/2021-12:49:46] [V] [TRT] Fastest Tactic: 0 Time: 0.00569 [04/19/2021-12:49:46] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:49:46] [V] [TRT] Tactic: 1002 time 0.0103775 [04/19/2021-12:49:46] [V] [TRT] Tactic: 0 time 0.0056575 [04/19/2021-12:49:46] [V] [TRT] Fastest Tactic: 0 Time: 0.0056575 [04/19/2021-12:49:46] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,1152), Float(1,7,49,56448) -> Float(1,7,49,56448) *************** [04/19/2021-12:49:46] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6b_se_excite/mul) (PointWise) [04/19/2021-12:49:46] [V] [TRT] Tactic: 128 time 0.159486 [04/19/2021-12:49:46] [V] [TRT] Tactic: 256 time 0.159753 [04/19/2021-12:49:46] [V] [TRT] Tactic: 512 time 0.160892 [04/19/2021-12:49:46] [V] [TRT] Tactic: -32 time 0.207552 [04/19/2021-12:49:46] [V] [TRT] Tactic: -64 time 0.236081 [04/19/2021-12:49:46] [V] [TRT] Tactic: -128 time 0.236575 [04/19/2021-12:49:46] [V] [TRT] Fastest Tactic: 128 Time: 0.159486 [04/19/2021-12:49:46] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6b_se_excite/mul) (PointWiseV2) [04/19/2021-12:49:46] [V] [TRT] Tactic: 0 time 0.44862 [04/19/2021-12:49:46] [V] [TRT] Tactic: 1 time 0.538776 [04/19/2021-12:49:47] [V] [TRT] Tactic: 2 time 0.492174 [04/19/2021-12:49:47] [V] [TRT] Tactic: 3 time 0.633177 [04/19/2021-12:49:47] [V] [TRT] Tactic: 4 time 0.652565 [04/19/2021-12:49:47] [V] [TRT] Tactic: 5 time 0.558379 [04/19/2021-12:49:47] [V] [TRT] Tactic: 6 time 0.844297 [04/19/2021-12:49:47] [V] [TRT] Tactic: 7 time 0.800072 [04/19/2021-12:49:47] [V] [TRT] Tactic: 8 time 0.814798 [04/19/2021-12:49:47] [V] [TRT] Tactic: 9 time 0.709512 [04/19/2021-12:49:47] [V] [TRT] Tactic: 28 time 0.102507 [04/19/2021-12:49:47] [V] [TRT] Fastest Tactic: 28 Time: 0.102507 [04/19/2021-12:49:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [04/19/2021-12:49:47] [V] [TRT] [04/19/2021-12:49:47] [V] [TRT] *************** Autotuning format combination: Float(1,1,1:32,36), Float(1,7,49:32,1764) -> Float(1,7,49:32,1764) *************** [04/19/2021-12:49:47] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6b_se_excite/mul) (PointWise) [04/19/2021-12:49:47] [V] [TRT] Tactic: 128 time 0.18099 [04/19/2021-12:49:47] [V] [TRT] Tactic: 256 time 0.181725 [04/19/2021-12:49:47] [V] [TRT] Tactic: 512 time 0.182689 [04/19/2021-12:49:47] [V] [TRT] Tactic: -32 time 0.211999 [04/19/2021-12:49:47] [V] [TRT] Tactic: -64 time 0.215111 [04/19/2021-12:49:47] [V] [TRT] Tactic: -128 time 0.214284 [04/19/2021-12:49:47] [V] [TRT] Fastest Tactic: 128 Time: 0.18099 [04/19/2021-12:49:47] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6b_se_excite/mul) (PointWiseV2) [04/19/2021-12:49:47] [V] [TRT] Tactic: 24 time 0.058366 [04/19/2021-12:49:47] [V] [TRT] Tactic: 25 time 0.0552342 [04/19/2021-12:49:47] [V] [TRT] Tactic: 26 time 0.0594205 [04/19/2021-12:49:47] [V] [TRT] Tactic: 27 time 0.0691602 [04/19/2021-12:49:47] [V] [TRT] Tactic: 31 time 0.053242 [04/19/2021-12:49:47] [V] [TRT] Fastest Tactic: 31 Time: 0.053242 [04/19/2021-12:49:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [04/19/2021-12:49:47] [V] [TRT] [04/19/2021-12:49:47] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,56448), Float(1,7,49,9408) -> Float(1,7,49,9408) *************** [04/19/2021-12:49:47] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:49:47] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:49:47] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:49:47] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:49:47] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:49:47] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:49:47] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:49:47] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:49:47] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:49:47] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6b_add/add (CaskConvolution) [04/19/2021-12:49:47] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:49:47] [V] [TRT] Tactic: 1062367460111450758 time 0.384772 [04/19/2021-12:49:47] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:49:47] [V] [TRT] Tactic: 4501471010995462441 time 0.401588 [04/19/2021-12:49:47] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:49:47] [V] [TRT] Tactic: 5137655947464784826 time 0.314928 [04/19/2021-12:49:47] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:49:47] [V] [TRT] Tactic: 5326823351883942011 time 0.383125 [04/19/2021-12:49:47] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:49:47] [V] [TRT] Tactic: 6645123197870846056 time 0.323249 [04/19/2021-12:49:47] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:49:47] [V] [TRT] Tactic: -6576203419454146580 time 0.331048 [04/19/2021-12:49:47] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:49:47] [V] [TRT] Tactic: -3456450830548107839 time 0.360137 [04/19/2021-12:49:47] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:49:47] [V] [TRT] Tactic: -410470605513481746 time 0.391764 [04/19/2021-12:49:47] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:49:47] [V] [TRT] Tactic: -37215280111360163 time 0.307916 [04/19/2021-12:49:47] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.307916 [04/19/2021-12:49:47] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6b_add/add (CudaConvolution) [04/19/2021-12:49:47] [V] [TRT] Tactic: 0 time 0.438138 [04/19/2021-12:49:47] [V] [TRT] Tactic: 2 time 0.724115 [04/19/2021-12:49:47] [V] [TRT] Tactic: 5 time 14.9968 [04/19/2021-12:49:47] [V] [TRT] Tactic: 57 time 0.378145 [04/19/2021-12:49:47] [V] [TRT] Fastest Tactic: 57 Time: 0.378145 [04/19/2021-12:49:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163 [04/19/2021-12:49:47] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:49:47] [V] [TRT] [04/19/2021-12:49:47] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:49:47] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:49:47] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:49:47] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:49:47] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:49:47] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:49:47] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:49:47] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:49:47] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:49:47] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:49:47] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,9408) -> Float(1,7,49,56448) *************** [04/19/2021-12:49:48] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,56448) -> Float(1,7,49,56448) *************** [04/19/2021-12:49:48] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6c_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6c_expand_activation/mul) (PointWise) [04/19/2021-12:49:48] [V] [TRT] Tactic: 128 time 0.128587 [04/19/2021-12:49:48] [V] [TRT] Tactic: 256 time 0.128984 [04/19/2021-12:49:48] [V] [TRT] Tactic: 512 time 0.130319 [04/19/2021-12:49:48] [V] [TRT] Tactic: -32 time 0.145833 [04/19/2021-12:49:48] [V] [TRT] Tactic: -64 time 0.139186 [04/19/2021-12:49:48] [V] [TRT] Tactic: -128 time 0.137103 [04/19/2021-12:49:48] [V] [TRT] Fastest Tactic: 128 Time: 0.128587 [04/19/2021-12:49:48] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6c_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6c_expand_activation/mul) (PointWiseV2) [04/19/2021-12:49:48] [V] [TRT] Tactic: 0 time 0.0625974 [04/19/2021-12:49:48] [V] [TRT] Tactic: 1 time 0.047526 [04/19/2021-12:49:48] [V] [TRT] Tactic: 2 time 0.0434895 [04/19/2021-12:49:48] [V] [TRT] Tactic: 3 time 0.0409178 [04/19/2021-12:49:48] [V] [TRT] Tactic: 4 time 0.0329299 [04/19/2021-12:49:48] [V] [TRT] Tactic: 5 time 0.0337174 [04/19/2021-12:49:48] [V] [TRT] Tactic: 6 time 0.0401106 [04/19/2021-12:49:48] [V] [TRT] Tactic: 7 time 0.0314451 [04/19/2021-12:49:48] [V] [TRT] Tactic: 8 time 0.028724 [04/19/2021-12:49:48] [V] [TRT] Tactic: 9 time 0.0298701 [04/19/2021-12:49:48] [V] [TRT] Tactic: 28 time 0.0605794 [04/19/2021-12:49:48] [V] [TRT] Fastest Tactic: 8 Time: 0.028724 [04/19/2021-12:49:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [04/19/2021-12:49:48] [V] [TRT] [04/19/2021-12:49:48] [V] [TRT] *************** Autotuning format combination: Float(1,7,49:32,1764) -> Float(1,7,49:32,1764) *************** [04/19/2021-12:49:48] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6c_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6c_expand_activation/mul) (PointWise) [04/19/2021-12:49:48] [V] [TRT] Tactic: 128 time 0.128835 [04/19/2021-12:49:48] [V] [TRT] Tactic: 256 time 0.128815 [04/19/2021-12:49:48] [V] [TRT] Tactic: 512 time 0.130671 [04/19/2021-12:49:48] [V] [TRT] Tactic: -32 time 0.14543 [04/19/2021-12:49:48] [V] [TRT] Tactic: -64 time 0.139095 [04/19/2021-12:49:48] [V] [TRT] Tactic: -128 time 0.137656 [04/19/2021-12:49:48] [V] [TRT] Fastest Tactic: 256 Time: 0.128815 [04/19/2021-12:49:48] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6c_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6c_expand_activation/mul) (PointWiseV2) [04/19/2021-12:49:48] [V] [TRT] Tactic: 24 time 0.0460289 [04/19/2021-12:49:48] [V] [TRT] Tactic: 25 time 0.041797 [04/19/2021-12:49:48] [V] [TRT] Tactic: 26 time 0.0418621 [04/19/2021-12:49:48] [V] [TRT] Tactic: 27 time 0.0425911 [04/19/2021-12:49:48] [V] [TRT] Tactic: 31 time 0.0457551 [04/19/2021-12:49:48] [V] [TRT] Fastest Tactic: 25 Time: 0.041797 [04/19/2021-12:49:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [04/19/2021-12:49:48] [V] [TRT] [04/19/2021-12:49:48] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,56448) -> Float(1,7,49,56448) *************** [04/19/2021-12:49:48] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,56448) -> Float(1,7,49,56448) *************** [04/19/2021-12:49:49] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6c_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6c_activation/mul) (PointWise) [04/19/2021-12:49:49] [V] [TRT] Tactic: 128 time 0.128203 [04/19/2021-12:49:49] [V] [TRT] Tactic: 256 time 0.12901 [04/19/2021-12:49:49] [V] [TRT] Tactic: 512 time 0.130514 [04/19/2021-12:49:49] [V] [TRT] Tactic: -32 time 0.144974 [04/19/2021-12:49:49] [V] [TRT] Tactic: -64 time 0.139479 [04/19/2021-12:49:49] [V] [TRT] Tactic: -128 time 0.137233 [04/19/2021-12:49:49] [V] [TRT] Fastest Tactic: 128 Time: 0.128203 [04/19/2021-12:49:49] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6c_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6c_activation/mul) (PointWiseV2) [04/19/2021-12:49:49] [V] [TRT] Tactic: 0 time 0.0622005 [04/19/2021-12:49:49] [V] [TRT] Tactic: 1 time 0.0471355 [04/19/2021-12:49:49] [V] [TRT] Tactic: 2 time 0.0433659 [04/19/2021-12:49:49] [V] [TRT] Tactic: 3 time 0.0409439 [04/19/2021-12:49:49] [V] [TRT] Tactic: 4 time 0.0327409 [04/19/2021-12:49:49] [V] [TRT] Tactic: 5 time 0.03403 [04/19/2021-12:49:49] [V] [TRT] Tactic: 6 time 0.0399935 [04/19/2021-12:49:49] [V] [TRT] Tactic: 7 time 0.0316863 [04/19/2021-12:49:49] [V] [TRT] Tactic: 8 time 0.0287044 [04/19/2021-12:49:49] [V] [TRT] Tactic: 9 time 0.0295444 [04/19/2021-12:49:49] [V] [TRT] Tactic: 28 time 0.0605535 [04/19/2021-12:49:49] [V] [TRT] Fastest Tactic: 8 Time: 0.0287044 [04/19/2021-12:49:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [04/19/2021-12:49:49] [V] [TRT] [04/19/2021-12:49:49] [V] [TRT] *************** Autotuning format combination: Float(1,7,49:32,1764) -> Float(1,7,49:32,1764) *************** [04/19/2021-12:49:49] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6c_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6c_activation/mul) (PointWise) [04/19/2021-12:49:49] [V] [TRT] Tactic: 128 time 0.128594 [04/19/2021-12:49:49] [V] [TRT] Tactic: 256 time 0.129316 [04/19/2021-12:49:49] [V] [TRT] Tactic: 512 time 0.130579 [04/19/2021-12:49:49] [V] [TRT] Tactic: -32 time 0.144701 [04/19/2021-12:49:49] [V] [TRT] Tactic: -64 time 0.139225 [04/19/2021-12:49:49] [V] [TRT] Tactic: -128 time 0.137351 [04/19/2021-12:49:49] [V] [TRT] Fastest Tactic: 128 Time: 0.128594 [04/19/2021-12:49:49] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6c_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6c_activation/mul) (PointWiseV2) [04/19/2021-12:49:49] [V] [TRT] Tactic: 24 time 0.0461852 [04/19/2021-12:49:49] [V] [TRT] Tactic: 25 time 0.042103 [04/19/2021-12:49:49] [V] [TRT] Tactic: 26 time 0.0419856 [04/19/2021-12:49:49] [V] [TRT] Tactic: 27 time 0.0424024 [04/19/2021-12:49:49] [V] [TRT] Tactic: 31 time 0.0461326 [04/19/2021-12:49:49] [V] [TRT] Fastest Tactic: 26 Time: 0.0419856 [04/19/2021-12:49:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [04/19/2021-12:49:49] [V] [TRT] [04/19/2021-12:49:49] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,56448) -> Float(1,1152) *************** [04/19/2021-12:49:49] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block6c_se_squeeze/Mean (Reduce) [04/19/2021-12:49:49] [V] [TRT] Tactic: 1 time 0.894903 [04/19/2021-12:49:49] [V] [TRT] Tactic: 3 time 0.106862 [04/19/2021-12:49:49] [V] [TRT] Tactic: 6 time 0.452383 [04/19/2021-12:49:49] [V] [TRT] Fastest Tactic: 3 Time: 0.106862 [04/19/2021-12:49:49] [V] [TRT] *************** Autotuning format combination: Float(1,1152) -> Float(1,1,1,1152) *************** [04/19/2021-12:49:49] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block6c_se_reshape/Reshape + StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/BiasAdd__295 (Shuffle) [04/19/2021-12:49:49] [V] [TRT] Tactic: 0 time 0.00336588 [04/19/2021-12:49:49] [V] [TRT] Tactic: 1 time 0.0115495 [04/19/2021-12:49:49] [V] [TRT] Fastest Tactic: 0 Time: 0.00336588 [04/19/2021-12:49:49] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,1152) -> Float(1,1,1,48) *************** [04/19/2021-12:49:50] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,48) -> Float(1,1,1,48) *************** [04/19/2021-12:49:50] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/mul) (PointWise) [04/19/2021-12:49:50] [V] [TRT] Tactic: 128 time 0.00569 [04/19/2021-12:49:50] [V] [TRT] Tactic: 256 time 0.00569025 [04/19/2021-12:49:50] [V] [TRT] Tactic: 512 time 0.00572912 [04/19/2021-12:49:50] [V] [TRT] Tactic: -32 time 0.008073 [04/19/2021-12:49:50] [V] [TRT] Tactic: -64 time 0.00572937 [04/19/2021-12:49:50] [V] [TRT] Tactic: -128 time 0.00572275 [04/19/2021-12:49:50] [V] [TRT] Fastest Tactic: 128 Time: 0.00569 [04/19/2021-12:49:50] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/mul) (PointWiseV2) [04/19/2021-12:49:50] [V] [TRT] Tactic: 0 time 0.00457675 [04/19/2021-12:49:50] [V] [TRT] Tactic: 1 time 0.00566388 [04/19/2021-12:49:50] [V] [TRT] Tactic: 2 time 0.00511712 [04/19/2021-12:49:50] [V] [TRT] Tactic: 3 time 0.00565113 [04/19/2021-12:49:50] [V] [TRT] Tactic: 4 time 0.00561863 [04/19/2021-12:49:50] [V] [TRT] Tactic: 5 time 0.00511712 [04/19/2021-12:49:50] [V] [TRT] Tactic: 6 time 0.005638 [04/19/2021-12:49:50] [V] [TRT] Tactic: 7 time 0.0056055 [04/19/2021-12:49:50] [V] [TRT] Tactic: 8 time 0.005651 [04/19/2021-12:49:50] [V] [TRT] Tactic: 9 time 0.0055925 [04/19/2021-12:49:50] [V] [TRT] Tactic: 28 time 0.00373675 [04/19/2021-12:49:50] [V] [TRT] Fastest Tactic: 28 Time: 0.00373675 [04/19/2021-12:49:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [04/19/2021-12:49:50] [V] [TRT] [04/19/2021-12:49:50] [V] [TRT] *************** Autotuning format combination: Float(1,1,1:32,2) -> Float(1,1,1:32,2) *************** [04/19/2021-12:49:50] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/mul) (PointWise) [04/19/2021-12:49:50] [V] [TRT] Tactic: 128 time 0.0057355 [04/19/2021-12:49:50] [V] [TRT] Tactic: 256 time 0.00572275 [04/19/2021-12:49:50] [V] [TRT] Tactic: 512 time 0.0057485 [04/19/2021-12:49:50] [V] [TRT] Tactic: -32 time 0.00568363 [04/19/2021-12:49:50] [V] [TRT] Tactic: -64 time 0.00576825 [04/19/2021-12:49:50] [V] [TRT] Tactic: -128 time 0.00572925 [04/19/2021-12:49:50] [V] [TRT] Fastest Tactic: -32 Time: 0.00568363 [04/19/2021-12:49:50] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/mul) (PointWiseV2) [04/19/2021-12:49:50] [V] [TRT] Tactic: 24 time 0.00566413 [04/19/2021-12:49:50] [V] [TRT] Tactic: 25 time 0.00557288 [04/19/2021-12:49:50] [V] [TRT] Tactic: 26 time 0.005599 [04/19/2021-12:49:50] [V] [TRT] Tactic: 27 time 0.007936 [04/19/2021-12:49:50] [V] [TRT] Tactic: 31 time 0.00569025 [04/19/2021-12:49:50] [V] [TRT] Fastest Tactic: 25 Time: 0.00557288 [04/19/2021-12:49:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [04/19/2021-12:49:50] [V] [TRT] [04/19/2021-12:49:50] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,48) -> Float(1,1,1,1152) *************** [04/19/2021-12:49:50] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,1152), Float(1,7,49,56448) -> Float(1,7,49,56448) *************** [04/19/2021-12:49:51] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6c_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6c_se_excite/mul) (PointWise) [04/19/2021-12:49:51] [V] [TRT] Tactic: 128 time 0.159056 [04/19/2021-12:49:51] [V] [TRT] Tactic: 256 time 0.159596 [04/19/2021-12:49:51] [V] [TRT] Tactic: 512 time 0.161139 [04/19/2021-12:49:51] [V] [TRT] Tactic: -32 time 0.208118 [04/19/2021-12:49:51] [V] [TRT] Tactic: -64 time 0.236921 [04/19/2021-12:49:51] [V] [TRT] Tactic: -128 time 0.235911 [04/19/2021-12:49:51] [V] [TRT] Fastest Tactic: 128 Time: 0.159056 [04/19/2021-12:49:51] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6c_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6c_se_excite/mul) (PointWiseV2) [04/19/2021-12:49:51] [V] [TRT] Tactic: 0 time 0.449486 [04/19/2021-12:49:51] [V] [TRT] Tactic: 1 time 0.538184 [04/19/2021-12:49:51] [V] [TRT] Tactic: 2 time 0.491985 [04/19/2021-12:49:51] [V] [TRT] Tactic: 3 time 0.633438 [04/19/2021-12:49:51] [V] [TRT] Tactic: 4 time 0.652572 [04/19/2021-12:49:51] [V] [TRT] Tactic: 5 time 0.558952 [04/19/2021-12:49:51] [V] [TRT] Tactic: 6 time 0.844694 [04/19/2021-12:49:51] [V] [TRT] Tactic: 7 time 0.800026 [04/19/2021-12:49:51] [V] [TRT] Tactic: 8 time 0.814225 [04/19/2021-12:49:51] [V] [TRT] Tactic: 9 time 0.709486 [04/19/2021-12:49:51] [V] [TRT] Tactic: 28 time 0.102969 [04/19/2021-12:49:51] [V] [TRT] Fastest Tactic: 28 Time: 0.102969 [04/19/2021-12:49:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [04/19/2021-12:49:51] [V] [TRT] [04/19/2021-12:49:51] [V] [TRT] *************** Autotuning format combination: Float(1,1,1:32,36), Float(1,7,49:32,1764) -> Float(1,7,49:32,1764) *************** [04/19/2021-12:49:51] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6c_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6c_se_excite/mul) (PointWise) [04/19/2021-12:49:51] [V] [TRT] Tactic: 128 time 0.181335 [04/19/2021-12:49:51] [V] [TRT] Tactic: 256 time 0.181803 [04/19/2021-12:49:51] [V] [TRT] Tactic: 512 time 0.183177 [04/19/2021-12:49:51] [V] [TRT] Tactic: -32 time 0.212637 [04/19/2021-12:49:51] [V] [TRT] Tactic: -64 time 0.215273 [04/19/2021-12:49:51] [V] [TRT] Tactic: -128 time 0.214844 [04/19/2021-12:49:51] [V] [TRT] Fastest Tactic: 128 Time: 0.181335 [04/19/2021-12:49:51] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6c_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6c_se_excite/mul) (PointWiseV2) [04/19/2021-12:49:51] [V] [TRT] Tactic: 24 time 0.058047 [04/19/2021-12:49:51] [V] [TRT] Tactic: 25 time 0.0548759 [04/19/2021-12:49:51] [V] [TRT] Tactic: 26 time 0.059199 [04/19/2021-12:49:51] [V] [TRT] Tactic: 27 time 0.0700456 [04/19/2021-12:49:51] [V] [TRT] Tactic: 31 time 0.053418 [04/19/2021-12:49:51] [V] [TRT] Fastest Tactic: 31 Time: 0.053418 [04/19/2021-12:49:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [04/19/2021-12:49:51] [V] [TRT] [04/19/2021-12:49:51] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,56448), Float(1,7,49,9408) -> Float(1,7,49,9408) *************** [04/19/2021-12:49:51] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,9408) -> Float(1,7,49,56448) *************** [04/19/2021-12:49:51] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,56448) -> Float(1,7,49,56448) *************** [04/19/2021-12:49:52] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6d_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6d_expand_activation/mul) (PointWise) [04/19/2021-12:49:52] [V] [TRT] Tactic: 128 time 0.128951 [04/19/2021-12:49:52] [V] [TRT] Tactic: 256 time 0.129434 [04/19/2021-12:49:52] [V] [TRT] Tactic: 512 time 0.130983 [04/19/2021-12:49:52] [V] [TRT] Tactic: -32 time 0.145306 [04/19/2021-12:49:52] [V] [TRT] Tactic: -64 time 0.138704 [04/19/2021-12:49:52] [V] [TRT] Tactic: -128 time 0.137259 [04/19/2021-12:49:52] [V] [TRT] Fastest Tactic: 128 Time: 0.128951 [04/19/2021-12:49:52] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6d_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6d_expand_activation/mul) (PointWiseV2) [04/19/2021-12:49:52] [V] [TRT] Tactic: 0 time 0.0625977 [04/19/2021-12:49:52] [V] [TRT] Tactic: 1 time 0.0472394 [04/19/2021-12:49:52] [V] [TRT] Tactic: 2 time 0.0431706 [04/19/2021-12:49:52] [V] [TRT] Tactic: 3 time 0.0416536 [04/19/2021-12:49:52] [V] [TRT] Tactic: 4 time 0.0329298 [04/19/2021-12:49:52] [V] [TRT] Tactic: 5 time 0.0335416 [04/19/2021-12:49:52] [V] [TRT] Tactic: 6 time 0.0393429 [04/19/2021-12:49:52] [V] [TRT] Tactic: 7 time 0.0314519 [04/19/2021-12:49:52] [V] [TRT] Tactic: 8 time 0.0287172 [04/19/2021-12:49:52] [V] [TRT] Tactic: 9 time 0.0291536 [04/19/2021-12:49:52] [V] [TRT] Tactic: 28 time 0.0605209 [04/19/2021-12:49:52] [V] [TRT] Fastest Tactic: 8 Time: 0.0287172 [04/19/2021-12:49:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [04/19/2021-12:49:52] [V] [TRT] [04/19/2021-12:49:52] [V] [TRT] *************** Autotuning format combination: Float(1,7,49:32,1764) -> Float(1,7,49:32,1764) *************** [04/19/2021-12:49:52] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6d_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6d_expand_activation/mul) (PointWise) [04/19/2021-12:49:52] [V] [TRT] Tactic: 128 time 0.128945 [04/19/2021-12:49:52] [V] [TRT] Tactic: 256 time 0.128893 [04/19/2021-12:49:52] [V] [TRT] Tactic: 512 time 0.130638 [04/19/2021-12:49:52] [V] [TRT] Tactic: -32 time 0.146042 [04/19/2021-12:49:52] [V] [TRT] Tactic: -64 time 0.139505 [04/19/2021-12:49:52] [V] [TRT] Tactic: -128 time 0.137376 [04/19/2021-12:49:52] [V] [TRT] Fastest Tactic: 256 Time: 0.128893 [04/19/2021-12:49:52] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6d_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6d_expand_activation/mul) (PointWiseV2) [04/19/2021-12:49:52] [V] [TRT] Tactic: 24 time 0.0462306 [04/19/2021-12:49:52] [V] [TRT] Tactic: 25 time 0.0424415 [04/19/2021-12:49:52] [V] [TRT] Tactic: 26 time 0.0422006 [04/19/2021-12:49:52] [V] [TRT] Tactic: 27 time 0.0419989 [04/19/2021-12:49:52] [V] [TRT] Tactic: 31 time 0.046302 [04/19/2021-12:49:52] [V] [TRT] Fastest Tactic: 27 Time: 0.0419989 [04/19/2021-12:49:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [04/19/2021-12:49:52] [V] [TRT] [04/19/2021-12:49:52] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,56448) -> Float(1,7,49,56448) *************** [04/19/2021-12:49:52] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,56448) -> Float(1,7,49,56448) *************** [04/19/2021-12:49:52] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6d_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6d_activation/mul) (PointWise) [04/19/2021-12:49:52] [V] [TRT] Tactic: 128 time 0.128535 [04/19/2021-12:49:52] [V] [TRT] Tactic: 256 time 0.128932 [04/19/2021-12:49:52] [V] [TRT] Tactic: 512 time 0.130501 [04/19/2021-12:49:52] [V] [TRT] Tactic: -32 time 0.145521 [04/19/2021-12:49:52] [V] [TRT] Tactic: -64 time 0.138763 [04/19/2021-12:49:52] [V] [TRT] Tactic: -128 time 0.137487 [04/19/2021-12:49:52] [V] [TRT] Fastest Tactic: 128 Time: 0.128535 [04/19/2021-12:49:52] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6d_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6d_activation/mul) (PointWiseV2) [04/19/2021-12:49:52] [V] [TRT] Tactic: 0 time 0.0631313 [04/19/2021-12:49:52] [V] [TRT] Tactic: 1 time 0.0469011 [04/19/2021-12:49:52] [V] [TRT] Tactic: 2 time 0.0438411 [04/19/2021-12:49:52] [V] [TRT] Tactic: 3 time 0.0410416 [04/19/2021-12:49:52] [V] [TRT] Tactic: 4 time 0.0328191 [04/19/2021-12:49:52] [V] [TRT] Tactic: 5 time 0.0340628 [04/19/2021-12:49:52] [V] [TRT] Tactic: 6 time 0.0397786 [04/19/2021-12:49:52] [V] [TRT] Tactic: 7 time 0.0314386 [04/19/2021-12:49:52] [V] [TRT] Tactic: 8 time 0.0291147 [04/19/2021-12:49:53] [V] [TRT] Tactic: 9 time 0.0292707 [04/19/2021-12:49:53] [V] [TRT] Tactic: 28 time 0.0607358 [04/19/2021-12:49:53] [V] [TRT] Fastest Tactic: 8 Time: 0.0291147 [04/19/2021-12:49:53] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [04/19/2021-12:49:53] [V] [TRT] [04/19/2021-12:49:53] [V] [TRT] *************** Autotuning format combination: Float(1,7,49:32,1764) -> Float(1,7,49:32,1764) *************** [04/19/2021-12:49:53] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6d_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6d_activation/mul) (PointWise) [04/19/2021-12:49:53] [V] [TRT] Tactic: 128 time 0.128587 [04/19/2021-12:49:53] [V] [TRT] Tactic: 256 time 0.129635 [04/19/2021-12:49:53] [V] [TRT] Tactic: 512 time 0.130709 [04/19/2021-12:49:53] [V] [TRT] Tactic: -32 time 0.145462 [04/19/2021-12:49:53] [V] [TRT] Tactic: -64 time 0.139707 [04/19/2021-12:49:53] [V] [TRT] Tactic: -128 time 0.136986 [04/19/2021-12:49:53] [V] [TRT] Fastest Tactic: 128 Time: 0.128587 [04/19/2021-12:49:53] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6d_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6d_activation/mul) (PointWiseV2) [04/19/2021-12:49:53] [V] [TRT] Tactic: 24 time 0.0458139 [04/19/2021-12:49:53] [V] [TRT] Tactic: 25 time 0.0424021 [04/19/2021-12:49:53] [V] [TRT] Tactic: 26 time 0.0429557 [04/19/2021-12:49:53] [V] [TRT] Tactic: 27 time 0.0421287 [04/19/2021-12:49:53] [V] [TRT] Tactic: 31 time 0.0459502 [04/19/2021-12:49:53] [V] [TRT] Fastest Tactic: 27 Time: 0.0421287 [04/19/2021-12:49:53] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [04/19/2021-12:49:53] [V] [TRT] [04/19/2021-12:49:53] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,56448) -> Float(1,1152) *************** [04/19/2021-12:49:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block6d_se_squeeze/Mean (Reduce) [04/19/2021-12:49:53] [V] [TRT] Tactic: 1 time 0.914317 [04/19/2021-12:49:53] [V] [TRT] Tactic: 3 time 0.107643 [04/19/2021-12:49:53] [V] [TRT] Tactic: 6 time 0.452702 [04/19/2021-12:49:53] [V] [TRT] Fastest Tactic: 3 Time: 0.107643 [04/19/2021-12:49:53] [V] [TRT] *************** Autotuning format combination: Float(1,1152) -> Float(1,1,1,1152) *************** [04/19/2021-12:49:53] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block6d_se_reshape/Reshape + StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/BiasAdd__315 (Shuffle) [04/19/2021-12:49:53] [V] [TRT] Tactic: 0 time 0.00326175 [04/19/2021-12:49:53] [V] [TRT] Tactic: 1 time 0.0114129 [04/19/2021-12:49:53] [V] [TRT] Fastest Tactic: 0 Time: 0.00326175 [04/19/2021-12:49:53] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,1152) -> Float(1,1,1,48) *************** [04/19/2021-12:49:53] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,48) -> Float(1,1,1,48) *************** [04/19/2021-12:49:53] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/mul) (PointWise) [04/19/2021-12:49:53] [V] [TRT] Tactic: 128 time 0.00578125 [04/19/2021-12:49:53] [V] [TRT] Tactic: 256 time 0.00574862 [04/19/2021-12:49:53] [V] [TRT] Tactic: 512 time 0.00582675 [04/19/2021-12:49:53] [V] [TRT] Tactic: -32 time 0.00787775 [04/19/2021-12:49:53] [V] [TRT] Tactic: -64 time 0.00569013 [04/19/2021-12:49:53] [V] [TRT] Tactic: -128 time 0.0057355 [04/19/2021-12:49:53] [V] [TRT] Fastest Tactic: -64 Time: 0.00569013 [04/19/2021-12:49:53] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/mul) (PointWiseV2) [04/19/2021-12:49:53] [V] [TRT] Tactic: 0 time 0.0041275 [04/19/2021-12:49:53] [V] [TRT] Tactic: 1 time 0.005651 [04/19/2021-12:49:53] [V] [TRT] Tactic: 2 time 0.00506512 [04/19/2021-12:49:54] [V] [TRT] Tactic: 3 time 0.00555988 [04/19/2021-12:49:54] [V] [TRT] Tactic: 4 time 0.00544275 [04/19/2021-12:49:54] [V] [TRT] Tactic: 5 time 0.00516925 [04/19/2021-12:49:54] [V] [TRT] Tactic: 6 time 0.0056315 [04/19/2021-12:49:54] [V] [TRT] Tactic: 7 time 0.005625 [04/19/2021-12:49:54] [V] [TRT] Tactic: 8 time 0.005638 [04/19/2021-12:49:54] [V] [TRT] Tactic: 9 time 0.00539712 [04/19/2021-12:49:54] [V] [TRT] Tactic: 28 time 0.00394537 [04/19/2021-12:49:54] [V] [TRT] Fastest Tactic: 28 Time: 0.00394537 [04/19/2021-12:49:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [04/19/2021-12:49:54] [V] [TRT] [04/19/2021-12:49:54] [V] [TRT] *************** Autotuning format combination: Float(1,1,1:32,2) -> Float(1,1,1:32,2) *************** [04/19/2021-12:49:54] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/mul) (PointWise) [04/19/2021-12:49:54] [V] [TRT] Tactic: 128 time 0.00572925 [04/19/2021-12:49:54] [V] [TRT] Tactic: 256 time 0.00569662 [04/19/2021-12:49:54] [V] [TRT] Tactic: 512 time 0.00570313 [04/19/2021-12:49:54] [V] [TRT] Tactic: -32 time 0.0057485 [04/19/2021-12:49:54] [V] [TRT] Tactic: -64 time 0.00572275 [04/19/2021-12:49:54] [V] [TRT] Tactic: -128 time 0.00576162 [04/19/2021-12:49:54] [V] [TRT] Fastest Tactic: 256 Time: 0.00569662 [04/19/2021-12:49:54] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/mul) (PointWiseV2) [04/19/2021-12:49:54] [V] [TRT] Tactic: 24 time 0.00561188 [04/19/2021-12:49:54] [V] [TRT] Tactic: 25 time 0.0056315 [04/19/2021-12:49:54] [V] [TRT] Tactic: 26 time 0.00570975 [04/19/2021-12:49:54] [V] [TRT] Tactic: 27 time 0.00784487 [04/19/2021-12:49:54] [V] [TRT] Tactic: 31 time 0.00570963 [04/19/2021-12:49:54] [V] [TRT] Fastest Tactic: 24 Time: 0.00561188 [04/19/2021-12:49:54] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [04/19/2021-12:49:54] [V] [TRT] [04/19/2021-12:49:54] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,48) -> Float(1,1,1,1152) *************** [04/19/2021-12:49:54] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,1152), Float(1,7,49,56448) -> Float(1,7,49,56448) *************** [04/19/2021-12:49:54] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6d_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6d_se_excite/mul) (PointWise) [04/19/2021-12:49:54] [V] [TRT] Tactic: 128 time 0.159251 [04/19/2021-12:49:54] [V] [TRT] Tactic: 256 time 0.159844 [04/19/2021-12:49:54] [V] [TRT] Tactic: 512 time 0.160658 [04/19/2021-12:49:54] [V] [TRT] Tactic: -32 time 0.208483 [04/19/2021-12:49:54] [V] [TRT] Tactic: -64 time 0.236647 [04/19/2021-12:49:54] [V] [TRT] Tactic: -128 time 0.236556 [04/19/2021-12:49:54] [V] [TRT] Fastest Tactic: 128 Time: 0.159251 [04/19/2021-12:49:54] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6d_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6d_se_excite/mul) (PointWiseV2) [04/19/2021-12:49:54] [V] [TRT] Tactic: 0 time 0.449102 [04/19/2021-12:49:54] [V] [TRT] Tactic: 1 time 0.538685 [04/19/2021-12:49:54] [V] [TRT] Tactic: 2 time 0.492376 [04/19/2021-12:49:54] [V] [TRT] Tactic: 3 time 0.633001 [04/19/2021-12:49:54] [V] [TRT] Tactic: 4 time 0.652773 [04/19/2021-12:49:54] [V] [TRT] Tactic: 5 time 0.559518 [04/19/2021-12:49:55] [V] [TRT] Tactic: 6 time 0.844772 [04/19/2021-12:49:55] [V] [TRT] Tactic: 7 time 0.800052 [04/19/2021-12:49:55] [V] [TRT] Tactic: 8 time 0.814759 [04/19/2021-12:49:55] [V] [TRT] Tactic: 9 time 0.71013 [04/19/2021-12:49:55] [V] [TRT] Tactic: 28 time 0.102806 [04/19/2021-12:49:55] [V] [TRT] Fastest Tactic: 28 Time: 0.102806 [04/19/2021-12:49:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [04/19/2021-12:49:55] [V] [TRT] [04/19/2021-12:49:55] [V] [TRT] *************** Autotuning format combination: Float(1,1,1:32,36), Float(1,7,49:32,1764) -> Float(1,7,49:32,1764) *************** [04/19/2021-12:49:55] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6d_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6d_se_excite/mul) (PointWise) [04/19/2021-12:49:55] [V] [TRT] Tactic: 128 time 0.181035 [04/19/2021-12:49:55] [V] [TRT] Tactic: 256 time 0.181465 [04/19/2021-12:49:55] [V] [TRT] Tactic: 512 time 0.183132 [04/19/2021-12:49:55] [V] [TRT] Tactic: -32 time 0.212441 [04/19/2021-12:49:55] [V] [TRT] Tactic: -64 time 0.214883 [04/19/2021-12:49:55] [V] [TRT] Tactic: -128 time 0.214583 [04/19/2021-12:49:55] [V] [TRT] Fastest Tactic: 128 Time: 0.181035 [04/19/2021-12:49:55] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block6d_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6d_se_excite/mul) (PointWiseV2) [04/19/2021-12:49:55] [V] [TRT] Tactic: 24 time 0.0593686 [04/19/2021-12:49:55] [V] [TRT] Tactic: 25 time 0.0544661 [04/19/2021-12:49:55] [V] [TRT] Tactic: 26 time 0.0595966 [04/19/2021-12:49:55] [V] [TRT] Tactic: 27 time 0.0697135 [04/19/2021-12:49:55] [V] [TRT] Tactic: 31 time 0.0532876 [04/19/2021-12:49:55] [V] [TRT] Fastest Tactic: 31 Time: 0.0532876 [04/19/2021-12:49:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [04/19/2021-12:49:55] [V] [TRT] [04/19/2021-12:49:55] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,56448), Float(1,7,49,9408) -> Float(1,7,49,9408) *************** [04/19/2021-12:49:55] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,9408) -> Float(1,7,49,56448) *************** [04/19/2021-12:49:55] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,56448) -> Float(1,7,49,56448) *************** [04/19/2021-12:49:55] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block7a_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block7a_expand_activation/mul) (PointWise) [04/19/2021-12:49:55] [V] [TRT] Tactic: 128 time 0.128626 [04/19/2021-12:49:55] [V] [TRT] Tactic: 256 time 0.129004 [04/19/2021-12:49:55] [V] [TRT] Tactic: 512 time 0.130573 [04/19/2021-12:49:55] [V] [TRT] Tactic: -32 time 0.145449 [04/19/2021-12:49:55] [V] [TRT] Tactic: -64 time 0.139453 [04/19/2021-12:49:55] [V] [TRT] Tactic: -128 time 0.13735 [04/19/2021-12:49:55] [V] [TRT] Fastest Tactic: 128 Time: 0.128626 [04/19/2021-12:49:55] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block7a_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block7a_expand_activation/mul) (PointWiseV2) [04/19/2021-12:49:55] [V] [TRT] Tactic: 0 time 0.0627865 [04/19/2021-12:49:55] [V] [TRT] Tactic: 1 time 0.0469859 [04/19/2021-12:49:55] [V] [TRT] Tactic: 2 time 0.0431769 [04/19/2021-12:49:55] [V] [TRT] Tactic: 3 time 0.0409049 [04/19/2021-12:49:55] [V] [TRT] Tactic: 4 time 0.0328449 [04/19/2021-12:49:55] [V] [TRT] Tactic: 5 time 0.0338214 [04/19/2021-12:49:55] [V] [TRT] Tactic: 6 time 0.039336 [04/19/2021-12:49:55] [V] [TRT] Tactic: 7 time 0.0308983 [04/19/2021-12:49:55] [V] [TRT] Tactic: 8 time 0.0278709 [04/19/2021-12:49:55] [V] [TRT] Tactic: 9 time 0.029069 [04/19/2021-12:49:55] [V] [TRT] Tactic: 28 time 0.0609375 [04/19/2021-12:49:55] [V] [TRT] Fastest Tactic: 8 Time: 0.0278709 [04/19/2021-12:49:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [04/19/2021-12:49:55] [V] [TRT] [04/19/2021-12:49:55] [V] [TRT] *************** Autotuning format combination: Float(1,7,49:32,1764) -> Float(1,7,49:32,1764) *************** [04/19/2021-12:49:56] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block7a_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block7a_expand_activation/mul) (PointWise) [04/19/2021-12:49:56] [V] [TRT] Tactic: 128 time 0.128945 [04/19/2021-12:49:56] [V] [TRT] Tactic: 256 time 0.129251 [04/19/2021-12:49:56] [V] [TRT] Tactic: 512 time 0.130241 [04/19/2021-12:49:56] [V] [TRT] Tactic: -32 time 0.14545 [04/19/2021-12:49:56] [V] [TRT] Tactic: -64 time 0.139336 [04/19/2021-12:49:56] [V] [TRT] Tactic: -128 time 0.137038 [04/19/2021-12:49:56] [V] [TRT] Fastest Tactic: 128 Time: 0.128945 [04/19/2021-12:49:56] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block7a_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block7a_expand_activation/mul) (PointWiseV2) [04/19/2021-12:49:56] [V] [TRT] Tactic: 24 time 0.0459376 [04/19/2021-12:49:56] [V] [TRT] Tactic: 25 time 0.0421745 [04/19/2021-12:49:56] [V] [TRT] Tactic: 26 time 0.0419596 [04/19/2021-12:49:56] [V] [TRT] Tactic: 27 time 0.0422916 [04/19/2021-12:49:56] [V] [TRT] Tactic: 31 time 0.0464713 [04/19/2021-12:49:56] [V] [TRT] Fastest Tactic: 26 Time: 0.0419596 [04/19/2021-12:49:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [04/19/2021-12:49:56] [V] [TRT] [04/19/2021-12:49:56] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,56448) -> Float(1,7,49,56448) *************** [04/19/2021-12:49:56] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:49:56] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [04/19/2021-12:49:56] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [04/19/2021-12:49:56] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:49:56] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:49:56] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [04/19/2021-12:49:56] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:49:56] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [04/19/2021-12:49:56] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [04/19/2021-12:49:56] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [04/19/2021-12:49:56] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [04/19/2021-12:49:56] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:49:56] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 [04/19/2021-12:49:56] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [04/19/2021-12:49:56] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:49:56] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise (FusedConvActConvolution) [04/19/2021-12:49:56] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/19/2021-12:49:56] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise (CaskConvolution) [04/19/2021-12:49:56] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:49:57] [V] [TRT] Tactic: 1062367460111450758 time 32.7393 [04/19/2021-12:49:57] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [04/19/2021-12:49:57] [V] [TRT] Tactic: 3827454225649558724 time 30.1519 [04/19/2021-12:49:57] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [04/19/2021-12:49:58] [V] [TRT] Tactic: 4337000649858996379 time 34.2185 [04/19/2021-12:49:58] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:49:59] [V] [TRT] Tactic: 4501471010995462441 time 33.8178 [04/19/2021-12:49:59] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:50:00] [V] [TRT] Tactic: 5137655947464784826 time 31.9868 [04/19/2021-12:50:00] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [04/19/2021-12:50:01] [V] [TRT] Tactic: 5921334924264294896 time 29.943 [04/19/2021-12:50:01] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:50:02] [V] [TRT] Tactic: 6645123197870846056 time 33.9352 [04/19/2021-12:50:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [04/19/2021-12:50:02] [V] [TRT] Tactic: 7852627285308570038 time 30.1 [04/19/2021-12:50:02] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [04/19/2021-12:50:03] [V] [TRT] Tactic: -9137461792520977713 time 34.9103 [04/19/2021-12:50:03] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 [04/19/2021-12:50:04] [V] [TRT] Tactic: -8776506421218919509 time 29.33 [04/19/2021-12:50:04] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [04/19/2021-12:50:05] [V] [TRT] Tactic: -6092040395344634144 time 34.4259 [04/19/2021-12:50:05] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:50:06] [V] [TRT] Tactic: -3456450830548107839 time 35.2286 [04/19/2021-12:50:06] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 [04/19/2021-12:50:06] [V] [TRT] Tactic: -2318106587342035239 time 30.6038 [04/19/2021-12:50:06] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 [04/19/2021-12:50:07] [V] [TRT] Tactic: -1343271414618805657 time 30.7842 [04/19/2021-12:50:07] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:50:08] [V] [TRT] Tactic: -410470605513481746 time 32.313 [04/19/2021-12:50:08] [V] [TRT] Fastest Tactic: -8776506421218919509 Time: 29.33 [04/19/2021-12:50:08] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise (CudaConvolution) [04/19/2021-12:50:08] [V] [TRT] Tactic: 0 time 0.423841 [04/19/2021-12:50:08] [V] [TRT] Tactic: 2 time 0.423874 [04/19/2021-12:50:14] [V] [TRT] Tactic: 5 time 360.987 [04/19/2021-12:50:15] [V] [TRT] Tactic: 6 time 59.007 [04/19/2021-12:50:15] [V] [TRT] Tactic: 57 time 0.348053 [04/19/2021-12:50:15] [V] [TRT] Fastest Tactic: 57 Time: 0.348053 [04/19/2021-12:50:15] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise (CudaDepthwiseConvolution) [04/19/2021-12:50:15] [V] [TRT] Tactic: -1 time 0.438014 [04/19/2021-12:50:15] [V] [TRT] Fastest Tactic: -1 Time: 0.438014 [04/19/2021-12:50:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 57 [04/19/2021-12:50:15] [V] [TRT] [04/19/2021-12:50:15] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,56448) -> Float(1,7,49,56448) *************** [04/19/2021-12:50:15] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block7a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block7a_activation/mul) (PointWise) [04/19/2021-12:50:15] [V] [TRT] Tactic: 128 time 0.129134 [04/19/2021-12:50:15] [V] [TRT] Tactic: 256 time 0.129323 [04/19/2021-12:50:15] [V] [TRT] Tactic: 512 time 0.130404 [04/19/2021-12:50:15] [V] [TRT] Tactic: -32 time 0.145625 [04/19/2021-12:50:15] [V] [TRT] Tactic: -64 time 0.139089 [04/19/2021-12:50:15] [V] [TRT] Tactic: -128 time 0.137617 [04/19/2021-12:50:15] [V] [TRT] Fastest Tactic: 128 Time: 0.129134 [04/19/2021-12:50:15] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block7a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block7a_activation/mul) (PointWiseV2) [04/19/2021-12:50:15] [V] [TRT] Tactic: 0 time 0.0629685 [04/19/2021-12:50:15] [V] [TRT] Tactic: 1 time 0.0477604 [04/19/2021-12:50:15] [V] [TRT] Tactic: 2 time 0.0435871 [04/19/2021-12:50:15] [V] [TRT] Tactic: 3 time 0.0409896 [04/19/2021-12:50:15] [V] [TRT] Tactic: 4 time 0.0327474 [04/19/2021-12:50:15] [V] [TRT] Tactic: 5 time 0.0340105 [04/19/2021-12:50:15] [V] [TRT] Tactic: 6 time 0.0401043 [04/19/2021-12:50:15] [V] [TRT] Tactic: 7 time 0.0312498 [04/19/2021-12:50:15] [V] [TRT] Tactic: 8 time 0.0288541 [04/19/2021-12:50:15] [V] [TRT] Tactic: 9 time 0.029225 [04/19/2021-12:50:15] [V] [TRT] Tactic: 28 time 0.0608464 [04/19/2021-12:50:15] [V] [TRT] Fastest Tactic: 8 Time: 0.0288541 [04/19/2021-12:50:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [04/19/2021-12:50:15] [V] [TRT] [04/19/2021-12:50:15] [V] [TRT] *************** Autotuning format combination: Float(1,7,49:32,1764) -> Float(1,7,49:32,1764) *************** [04/19/2021-12:50:16] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block7a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block7a_activation/mul) (PointWise) [04/19/2021-12:50:16] [V] [TRT] Tactic: 128 time 0.128678 [04/19/2021-12:50:16] [V] [TRT] Tactic: 256 time 0.129186 [04/19/2021-12:50:16] [V] [TRT] Tactic: 512 time 0.130762 [04/19/2021-12:50:16] [V] [TRT] Tactic: -32 time 0.145729 [04/19/2021-12:50:16] [V] [TRT] Tactic: -64 time 0.139121 [04/19/2021-12:50:16] [V] [TRT] Tactic: -128 time 0.137611 [04/19/2021-12:50:16] [V] [TRT] Fastest Tactic: 128 Time: 0.128678 [04/19/2021-12:50:16] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block7a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block7a_activation/mul) (PointWiseV2) [04/19/2021-12:50:16] [V] [TRT] Tactic: 24 time 0.0458464 [04/19/2021-12:50:16] [V] [TRT] Tactic: 25 time 0.0421875 [04/19/2021-12:50:16] [V] [TRT] Tactic: 26 time 0.0418877 [04/19/2021-12:50:16] [V] [TRT] Tactic: 27 time 0.0427016 [04/19/2021-12:50:16] [V] [TRT] Tactic: 31 time 0.0464389 [04/19/2021-12:50:16] [V] [TRT] Fastest Tactic: 26 Time: 0.0418877 [04/19/2021-12:50:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [04/19/2021-12:50:16] [V] [TRT] [04/19/2021-12:50:16] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,56448) -> Float(1,1152) *************** [04/19/2021-12:50:16] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block7a_se_squeeze/Mean (Reduce) [04/19/2021-12:50:16] [V] [TRT] Tactic: 1 time 0.904883 [04/19/2021-12:50:16] [V] [TRT] Tactic: 3 time 0.107259 [04/19/2021-12:50:16] [V] [TRT] Tactic: 6 time 0.45127 [04/19/2021-12:50:16] [V] [TRT] Fastest Tactic: 3 Time: 0.107259 [04/19/2021-12:50:16] [V] [TRT] *************** Autotuning format combination: Float(1,1152) -> Float(1,1,1,1152) *************** [04/19/2021-12:50:16] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block7a_se_reshape/Reshape + StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/BiasAdd__335 (Shuffle) [04/19/2021-12:50:16] [V] [TRT] Tactic: 0 time 0.00328775 [04/19/2021-12:50:16] [V] [TRT] Tactic: 1 time 0.0114581 [04/19/2021-12:50:16] [V] [TRT] Fastest Tactic: 0 Time: 0.00328775 [04/19/2021-12:50:16] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,1152) -> Float(1,1,1,48) *************** [04/19/2021-12:50:16] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,48) -> Float(1,1,1,48) *************** [04/19/2021-12:50:16] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/mul) (PointWise) [04/19/2021-12:50:16] [V] [TRT] Tactic: 128 time 0.00575525 [04/19/2021-12:50:16] [V] [TRT] Tactic: 256 time 0.00570975 [04/19/2021-12:50:16] [V] [TRT] Tactic: 512 time 0.00572263 [04/19/2021-12:50:16] [V] [TRT] Tactic: -32 time 0.0078385 [04/19/2021-12:50:16] [V] [TRT] Tactic: -64 time 0.00570325 [04/19/2021-12:50:16] [V] [TRT] Tactic: -128 time 0.00569662 [04/19/2021-12:50:16] [V] [TRT] Fastest Tactic: -128 Time: 0.00569662 [04/19/2021-12:50:16] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/mul) (PointWiseV2) [04/19/2021-12:50:16] [V] [TRT] Tactic: 0 time 0.00402363 [04/19/2021-12:50:16] [V] [TRT] Tactic: 1 time 0.00559888 [04/19/2021-12:50:16] [V] [TRT] Tactic: 2 time 0.00541663 [04/19/2021-12:50:16] [V] [TRT] Tactic: 3 time 0.00560562 [04/19/2021-12:50:16] [V] [TRT] Tactic: 4 time 0.005664 [04/19/2021-12:50:16] [V] [TRT] Tactic: 5 time 0.0055275 [04/19/2021-12:50:16] [V] [TRT] Tactic: 6 time 0.00563813 [04/19/2021-12:50:16] [V] [TRT] Tactic: 7 time 0.00561188 [04/19/2021-12:50:16] [V] [TRT] Tactic: 8 time 0.00541025 [04/19/2021-12:50:16] [V] [TRT] Tactic: 9 time 0.00533225 [04/19/2021-12:50:16] [V] [TRT] Tactic: 28 time 0.00365213 [04/19/2021-12:50:16] [V] [TRT] Fastest Tactic: 28 Time: 0.00365213 [04/19/2021-12:50:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [04/19/2021-12:50:16] [V] [TRT] [04/19/2021-12:50:17] [V] [TRT] *************** Autotuning format combination: Float(1,1,1:32,2) -> Float(1,1,1:32,2) *************** [04/19/2021-12:50:17] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/mul) (PointWise) [04/19/2021-12:50:17] [V] [TRT] Tactic: 128 time 0.00569675 [04/19/2021-12:50:17] [V] [TRT] Tactic: 256 time 0.00572912 [04/19/2021-12:50:17] [V] [TRT] Tactic: 512 time 0.00575525 [04/19/2021-12:50:17] [V] [TRT] Tactic: -32 time 0.00569012 [04/19/2021-12:50:17] [V] [TRT] Tactic: -64 time 0.00570963 [04/19/2021-12:50:17] [V] [TRT] Tactic: -128 time 0.00571625 [04/19/2021-12:50:17] [V] [TRT] Fastest Tactic: -32 Time: 0.00569012 [04/19/2021-12:50:17] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/mul) (PointWiseV2) [04/19/2021-12:50:17] [V] [TRT] Tactic: 24 time 0.0056835 [04/19/2021-12:50:17] [V] [TRT] Tactic: 25 time 0.0056055 [04/19/2021-12:50:17] [V] [TRT] Tactic: 26 time 0.005573 [04/19/2021-12:50:17] [V] [TRT] Tactic: 27 time 0.00793625 [04/19/2021-12:50:17] [V] [TRT] Tactic: 31 time 0.00558587 [04/19/2021-12:50:17] [V] [TRT] Fastest Tactic: 26 Time: 0.005573 [04/19/2021-12:50:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [04/19/2021-12:50:17] [V] [TRT] [04/19/2021-12:50:17] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,48) -> Float(1,1,1,1152) *************** [04/19/2021-12:50:17] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,1152), Float(1,7,49,56448) -> Float(1,7,49,56448) *************** [04/19/2021-12:50:17] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block7a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block7a_se_excite/mul) (PointWise) [04/19/2021-12:50:17] [V] [TRT] Tactic: 128 time 0.159733 [04/19/2021-12:50:17] [V] [TRT] Tactic: 256 time 0.159896 [04/19/2021-12:50:17] [V] [TRT] Tactic: 512 time 0.160853 [04/19/2021-12:50:17] [V] [TRT] Tactic: -32 time 0.208275 [04/19/2021-12:50:17] [V] [TRT] Tactic: -64 time 0.236686 [04/19/2021-12:50:17] [V] [TRT] Tactic: -128 time 0.236712 [04/19/2021-12:50:17] [V] [TRT] Fastest Tactic: 128 Time: 0.159733 [04/19/2021-12:50:17] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block7a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block7a_se_excite/mul) (PointWiseV2) [04/19/2021-12:50:17] [V] [TRT] Tactic: 0 time 0.449492 [04/19/2021-12:50:17] [V] [TRT] Tactic: 1 time 0.538867 [04/19/2021-12:50:17] [V] [TRT] Tactic: 2 time 0.4928 [04/19/2021-12:50:17] [V] [TRT] Tactic: 3 time 0.63362 [04/19/2021-12:50:17] [V] [TRT] Tactic: 4 time 0.652513 [04/19/2021-12:50:17] [V] [TRT] Tactic: 5 time 0.559075 [04/19/2021-12:50:17] [V] [TRT] Tactic: 6 time 0.844844 [04/19/2021-12:50:17] [V] [TRT] Tactic: 7 time 0.800163 [04/19/2021-12:50:17] [V] [TRT] Tactic: 8 time 0.814746 [04/19/2021-12:50:18] [V] [TRT] Tactic: 9 time 0.710019 [04/19/2021-12:50:18] [V] [TRT] Tactic: 28 time 0.102969 [04/19/2021-12:50:18] [V] [TRT] Fastest Tactic: 28 Time: 0.102969 [04/19/2021-12:50:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [04/19/2021-12:50:18] [V] [TRT] [04/19/2021-12:50:18] [V] [TRT] *************** Autotuning format combination: Float(1,1,1:32,36), Float(1,7,49:32,1764) -> Float(1,7,49:32,1764) *************** [04/19/2021-12:50:18] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block7a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block7a_se_excite/mul) (PointWise) [04/19/2021-12:50:18] [V] [TRT] Tactic: 128 time 0.181348 [04/19/2021-12:50:18] [V] [TRT] Tactic: 256 time 0.181895 [04/19/2021-12:50:18] [V] [TRT] Tactic: 512 time 0.183379 [04/19/2021-12:50:18] [V] [TRT] Tactic: -32 time 0.213379 [04/19/2021-12:50:18] [V] [TRT] Tactic: -64 time 0.215006 [04/19/2021-12:50:18] [V] [TRT] Tactic: -128 time 0.214531 [04/19/2021-12:50:18] [V] [TRT] Fastest Tactic: 128 Time: 0.181348 [04/19/2021-12:50:18] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/block7a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block7a_se_excite/mul) (PointWiseV2) [04/19/2021-12:50:18] [V] [TRT] Tactic: 24 time 0.0583788 [04/19/2021-12:50:18] [V] [TRT] Tactic: 25 time 0.0548437 [04/19/2021-12:50:18] [V] [TRT] Tactic: 26 time 0.0600909 [04/19/2021-12:50:18] [V] [TRT] Tactic: 27 time 0.0699608 [04/19/2021-12:50:18] [V] [TRT] Tactic: 31 time 0.0531965 [04/19/2021-12:50:18] [V] [TRT] Fastest Tactic: 31 Time: 0.0531965 [04/19/2021-12:50:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [04/19/2021-12:50:18] [V] [TRT] [04/19/2021-12:50:18] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,56448) -> Float(1,7,49,15680) *************** [04/19/2021-12:50:18] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:50:18] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:50:18] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:50:18] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:50:18] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:50:18] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:50:18] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:50:18] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:50:18] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:50:18] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block7a_project_conv/Conv2D (FusedConvActConvolution) [04/19/2021-12:50:18] [V] [TRT] Tactic: 589823 time 0.793626 [04/19/2021-12:50:18] [V] [TRT] Tactic: 655359 time 0.857695 [04/19/2021-12:50:18] [V] [TRT] Tactic: 786431 time 0.884824 [04/19/2021-12:50:18] [V] [TRT] Tactic: 851967 time 0.806732 [04/19/2021-12:50:18] [V] [TRT] Tactic: 1179647 time 0.615866 [04/19/2021-12:50:18] [V] [TRT] Tactic: 1310719 time 1.28964 [04/19/2021-12:50:18] [V] [TRT] Tactic: 1376255 time 0.523301 [04/19/2021-12:50:18] [V] [TRT] Tactic: 1441791 time 0.815072 [04/19/2021-12:50:18] [V] [TRT] Tactic: 1507327 time 0.781055 [04/19/2021-12:50:18] [V] [TRT] Tactic: 1638399 time 0.943053 [04/19/2021-12:50:18] [V] [TRT] Tactic: 1835007 time 0.683984 [04/19/2021-12:50:19] [V] [TRT] Tactic: 1900543 time 0.93345 [04/19/2021-12:50:19] [V] [TRT] Tactic: 2097151 time 0.579551 [04/19/2021-12:50:19] [V] [TRT] Tactic: 2162687 time 0.596302 [04/19/2021-12:50:19] [V] [TRT] Tactic: 2293759 time 0.502702 [04/19/2021-12:50:19] [V] [TRT] Tactic: 2359295 time 0.632084 [04/19/2021-12:50:19] [V] [TRT] Tactic: 2686975 time 0.521901 [04/19/2021-12:50:19] [V] [TRT] Tactic: 3080191 time 0.705573 [04/19/2021-12:50:19] [V] [TRT] Tactic: 3342335 time 1.03206 [04/19/2021-12:50:19] [V] [TRT] Tactic: 3407871 time 0.56651 [04/19/2021-12:50:19] [V] [TRT] Tactic: 3538943 time 0.540423 [04/19/2021-12:50:19] [V] [TRT] Tactic: 3670015 time 0.876615 [04/19/2021-12:50:19] [V] [TRT] Tactic: 3932159 time 0.815267 [04/19/2021-12:50:19] [V] [TRT] Tactic: 3997695 time 0.886953 [04/19/2021-12:50:19] [V] [TRT] Tactic: 4063231 time 0.676732 [04/19/2021-12:50:19] [V] [TRT] Tactic: 4194303 time 0.480905 [04/19/2021-12:50:19] [V] [TRT] Tactic: 4259839 time 0.601738 [04/19/2021-12:50:19] [V] [TRT] Tactic: 4325375 time 0.799779 [04/19/2021-12:50:19] [V] [TRT] Tactic: 4521983 time 1.084 [04/19/2021-12:50:19] [V] [TRT] Tactic: 4587519 time 0.697175 [04/19/2021-12:50:19] [V] [TRT] Tactic: 4653055 time 0.660827 [04/19/2021-12:50:19] [V] [TRT] Tactic: 4915199 time 0.480612 [04/19/2021-12:50:19] [V] [TRT] Tactic: 4980735 time 0.785645 [04/19/2021-12:50:20] [V] [TRT] Tactic: 5177343 time 0.622233 [04/19/2021-12:50:20] [V] [TRT] Tactic: 5242879 time 0.532507 [04/19/2021-12:50:20] [V] [TRT] Tactic: 5373951 time 0.637201 [04/19/2021-12:50:20] [V] [TRT] Tactic: 5439487 time 0.601686 [04/19/2021-12:50:20] [V] [TRT] Tactic: 5570559 time 0.529212 [04/19/2021-12:50:20] [V] [TRT] Tactic: 5636095 time 0.663958 [04/19/2021-12:50:20] [V] [TRT] Tactic: 5701631 time 0.497571 [04/19/2021-12:50:20] [V] [TRT] Tactic: 5767167 time 0.867916 [04/19/2021-12:50:20] [V] [TRT] Tactic: 5832703 time 0.563522 [04/19/2021-12:50:20] [V] [TRT] Tactic: 5898239 time 0.433164 [04/19/2021-12:50:20] [V] [TRT] Tactic: 6029311 time 0.46778 [04/19/2021-12:50:20] [V] [TRT] Tactic: 6225919 time 0.501647 [04/19/2021-12:50:20] [V] [TRT] Tactic: 6291455 time 0.608203 [04/19/2021-12:50:20] [V] [TRT] Tactic: 6422527 time 0.491934 [04/19/2021-12:50:20] [V] [TRT] Tactic: 6750207 time 0.588711 [04/19/2021-12:50:20] [V] [TRT] Tactic: 6815743 time 0.541465 [04/19/2021-12:50:20] [V] [TRT] Tactic: 6946815 time 0.866406 [04/19/2021-12:50:20] [V] [TRT] Tactic: 7012351 time 0.578268 [04/19/2021-12:50:20] [V] [TRT] Tactic: 7077887 time 0.536009 [04/19/2021-12:50:20] [V] [TRT] Tactic: 7143423 time 0.929212 [04/19/2021-12:50:20] [V] [TRT] Tactic: 7208959 time 0.565501 [04/19/2021-12:50:20] [V] [TRT] Tactic: 7340031 time 0.431074 [04/19/2021-12:50:20] [V] [TRT] Tactic: 7405567 time 0.615488 [04/19/2021-12:50:20] [V] [TRT] Tactic: 7536639 time 0.794661 [04/19/2021-12:50:21] [V] [TRT] Tactic: 7602175 time 0.859583 [04/19/2021-12:50:21] [V] [TRT] Tactic: 7733247 time 0.450501 [04/19/2021-12:50:21] [V] [TRT] Tactic: 7798783 time 0.882858 [04/19/2021-12:50:21] [V] [TRT] Tactic: 8191999 time 0.837096 [04/19/2021-12:50:21] [V] [TRT] Tactic: 8257535 time 0.481348 [04/19/2021-12:50:21] [V] [TRT] Tactic: 8323071 time 0.607168 [04/19/2021-12:50:21] [V] [TRT] Tactic: 8650751 time 0.860573 [04/19/2021-12:50:21] [V] [TRT] Tactic: 8716287 time 0.512018 [04/19/2021-12:50:21] [V] [TRT] Tactic: 9109503 time 0.580729 [04/19/2021-12:50:21] [V] [TRT] Tactic: 9568255 time 0.480352 [04/19/2021-12:50:21] [V] [TRT] Tactic: 9895935 time 0.481992 [04/19/2021-12:50:21] [V] [TRT] Tactic: 10223615 time 0.525781 [04/19/2021-12:50:21] [V] [TRT] Tactic: 10354687 time 0.606022 [04/19/2021-12:50:21] [V] [TRT] Tactic: 10551295 time 0.605788 [04/19/2021-12:50:21] [V] [TRT] Tactic: 10747903 time 0.447975 [04/19/2021-12:50:21] [V] [TRT] Tactic: 10944511 time 0.785892 [04/19/2021-12:50:21] [V] [TRT] Fastest Tactic: 7340031 Time: 0.431074 [04/19/2021-12:50:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block7a_project_conv/Conv2D (CaskConvolution) [04/19/2021-12:50:21] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:50:21] [V] [TRT] Tactic: 1062367460111450758 time 0.645287 [04/19/2021-12:50:21] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:50:21] [V] [TRT] Tactic: 4501471010995462441 time 0.615124 [04/19/2021-12:50:21] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:50:21] [V] [TRT] Tactic: 5137655947464784826 time 0.568223 [04/19/2021-12:50:21] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:50:21] [V] [TRT] Tactic: 5326823351883942011 time 0.594388 [04/19/2021-12:50:21] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:50:21] [V] [TRT] Tactic: 6645123197870846056 time 0.580794 [04/19/2021-12:50:21] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:50:21] [V] [TRT] Tactic: -6576203419454146580 time 0.568854 [04/19/2021-12:50:21] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:50:21] [V] [TRT] Tactic: -3456450830548107839 time 0.595065 [04/19/2021-12:50:21] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:50:21] [V] [TRT] Tactic: -410470605513481746 time 0.60112 [04/19/2021-12:50:21] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:50:21] [V] [TRT] Tactic: -37215280111360163 time 0.550716 [04/19/2021-12:50:21] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.550716 [04/19/2021-12:50:21] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block7a_project_conv/Conv2D (CudaConvolution) [04/19/2021-12:50:21] [V] [TRT] Tactic: 0 time 0.702292 [04/19/2021-12:50:21] [V] [TRT] Tactic: 2 time 0.888073 [04/19/2021-12:50:22] [V] [TRT] Tactic: 5 time 24.8288 [04/19/2021-12:50:22] [V] [TRT] Tactic: 57 time 0.54638 [04/19/2021-12:50:22] [V] [TRT] Fastest Tactic: 57 Time: 0.54638 [04/19/2021-12:50:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/block7a_project_conv/Conv2D (CudaDepthwiseConvolution) [04/19/2021-12:50:22] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/19/2021-12:50:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 7340031 [04/19/2021-12:50:22] [V] [TRT] [04/19/2021-12:50:22] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,15680) -> Float(1,7,49,62720) *************** [04/19/2021-12:50:22] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:50:22] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:50:22] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:50:22] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:50:22] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:50:22] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:50:22] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:50:22] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:50:22] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:50:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D (FusedConvActConvolution) [04/19/2021-12:50:22] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [04/19/2021-12:50:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D (CaskConvolution) [04/19/2021-12:50:22] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:50:22] [V] [TRT] Tactic: 1062367460111450758 time 0.757695 [04/19/2021-12:50:22] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:50:22] [V] [TRT] Tactic: 4501471010995462441 time 0.587142 [04/19/2021-12:50:22] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:50:22] [V] [TRT] Tactic: 5137655947464784826 time 0.586159 [04/19/2021-12:50:22] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:50:22] [V] [TRT] Tactic: 5326823351883942011 time 0.567637 [04/19/2021-12:50:22] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:50:22] [V] [TRT] Tactic: 6645123197870846056 time 0.594199 [04/19/2021-12:50:22] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:50:22] [V] [TRT] Tactic: -6576203419454146580 time 0.653424 [04/19/2021-12:50:22] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:50:22] [V] [TRT] Tactic: -3456450830548107839 time 0.700592 [04/19/2021-12:50:22] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:50:22] [V] [TRT] Tactic: -410470605513481746 time 0.571393 [04/19/2021-12:50:22] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:50:22] [V] [TRT] Tactic: -37215280111360163 time 0.5678 [04/19/2021-12:50:22] [V] [TRT] Fastest Tactic: 5326823351883942011 Time: 0.567637 [04/19/2021-12:50:22] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D (CudaConvolution) [04/19/2021-12:50:22] [V] [TRT] Tactic: 0 time 0.852012 [04/19/2021-12:50:22] [V] [TRT] Tactic: 2 time 0.87362 [04/19/2021-12:50:23] [V] [TRT] Tactic: 5 time 33.3227 [04/19/2021-12:50:23] [V] [TRT] Tactic: 57 time 0.729434 [04/19/2021-12:50:23] [V] [TRT] Fastest Tactic: 57 Time: 0.729434 [04/19/2021-12:50:23] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D (CudaDepthwiseConvolution) [04/19/2021-12:50:23] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [04/19/2021-12:50:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5326823351883942011 [04/19/2021-12:50:23] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:50:23] [V] [TRT] [04/19/2021-12:50:23] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [04/19/2021-12:50:23] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [04/19/2021-12:50:23] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [04/19/2021-12:50:23] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:50:23] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [04/19/2021-12:50:23] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:50:23] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [04/19/2021-12:50:23] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [04/19/2021-12:50:23] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:50:23] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:50:23] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:50:23] [V] [TRT] Tactic: 1002 time 0.197773 [04/19/2021-12:50:23] [V] [TRT] Tactic: 0 time 0.148971 [04/19/2021-12:50:23] [V] [TRT] Fastest Tactic: 0 Time: 0.148971 [04/19/2021-12:50:23] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:50:23] [V] [TRT] Tactic: 1002 time 0.197877 [04/19/2021-12:50:23] [V] [TRT] Tactic: 0 time 0.148626 [04/19/2021-12:50:23] [V] [TRT] Fastest Tactic: 0 Time: 0.148626 [04/19/2021-12:50:23] [V] [TRT] --------------- Timing Runner: (Reformat) [04/19/2021-12:50:23] [V] [TRT] Tactic: 1002 time 0.548646 [04/19/2021-12:50:23] [V] [TRT] Tactic: 0 time 0.112598 [04/19/2021-12:50:23] [V] [TRT] Fastest Tactic: 0 Time: 0.112598 [04/19/2021-12:50:23] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,62720) -> Float(1,7,49,62720) *************** [04/19/2021-12:50:23] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/top_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/top_activation/mul) (PointWise) [04/19/2021-12:50:23] [V] [TRT] Tactic: 128 time 0.142689 [04/19/2021-12:50:23] [V] [TRT] Tactic: 256 time 0.142812 [04/19/2021-12:50:23] [V] [TRT] Tactic: 512 time 0.143737 [04/19/2021-12:50:23] [V] [TRT] Tactic: -32 time 0.156218 [04/19/2021-12:50:23] [V] [TRT] Tactic: -64 time 0.157806 [04/19/2021-12:50:23] [V] [TRT] Tactic: -128 time 0.151185 [04/19/2021-12:50:23] [V] [TRT] Fastest Tactic: 128 Time: 0.142689 [04/19/2021-12:50:23] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/top_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/top_activation/mul) (PointWiseV2) [04/19/2021-12:50:23] [V] [TRT] Tactic: 0 time 0.0694599 [04/19/2021-12:50:23] [V] [TRT] Tactic: 1 time 0.0521159 [04/19/2021-12:50:23] [V] [TRT] Tactic: 2 time 0.047995 [04/19/2021-12:50:23] [V] [TRT] Tactic: 3 time 0.0450978 [04/19/2021-12:50:23] [V] [TRT] Tactic: 4 time 0.0357618 [04/19/2021-12:50:23] [V] [TRT] Tactic: 5 time 0.036836 [04/19/2021-12:50:23] [V] [TRT] Tactic: 6 time 0.043099 [04/19/2021-12:50:23] [V] [TRT] Tactic: 7 time 0.034492 [04/19/2021-12:50:23] [V] [TRT] Tactic: 8 time 0.0314711 [04/19/2021-12:50:23] [V] [TRT] Tactic: 9 time 0.0324545 [04/19/2021-12:50:23] [V] [TRT] Tactic: 28 time 0.067461 [04/19/2021-12:50:23] [V] [TRT] Fastest Tactic: 8 Time: 0.0314711 [04/19/2021-12:50:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [04/19/2021-12:50:23] [V] [TRT] [04/19/2021-12:50:23] [V] [TRT] *************** Autotuning format combination: Float(1,7,49:32,1960) -> Float(1,7,49:32,1960) *************** [04/19/2021-12:50:23] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/top_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/top_activation/mul) (PointWise) [04/19/2021-12:50:23] [V] [TRT] Tactic: 128 time 0.142031 [04/19/2021-12:50:23] [V] [TRT] Tactic: 256 time 0.14237 [04/19/2021-12:50:23] [V] [TRT] Tactic: 512 time 0.144492 [04/19/2021-12:50:23] [V] [TRT] Tactic: -32 time 0.156029 [04/19/2021-12:50:23] [V] [TRT] Tactic: -64 time 0.157194 [04/19/2021-12:50:23] [V] [TRT] Tactic: -128 time 0.151413 [04/19/2021-12:50:23] [V] [TRT] Fastest Tactic: 128 Time: 0.142031 [04/19/2021-12:50:23] [V] [TRT] --------------- Timing Runner: PWN(StatefulPartitionedCall/efficientnet-b0/top_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/top_activation/mul) (PointWiseV2) [04/19/2021-12:50:23] [V] [TRT] Tactic: 24 time 0.0503777 [04/19/2021-12:50:23] [V] [TRT] Tactic: 25 time 0.0461979 [04/19/2021-12:50:23] [V] [TRT] Tactic: 26 time 0.0469531 [04/19/2021-12:50:23] [V] [TRT] Tactic: 27 time 0.0463086 [04/19/2021-12:50:23] [V] [TRT] Tactic: 31 time 0.0496813 [04/19/2021-12:50:23] [V] [TRT] Fastest Tactic: 25 Time: 0.0461979 [04/19/2021-12:50:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [04/19/2021-12:50:23] [V] [TRT] [04/19/2021-12:50:24] [V] [TRT] *************** Autotuning format combination: Float(1,7,49,62720) -> Float(1,1280) *************** [04/19/2021-12:50:24] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/avg_pool/Mean (Reduce) [04/19/2021-12:50:24] [V] [TRT] Tactic: 1 time 0.998971 [04/19/2021-12:50:24] [V] [TRT] Tactic: 3 time 0.114622 [04/19/2021-12:50:24] [V] [TRT] Tactic: 6 time 0.48099 [04/19/2021-12:50:24] [V] [TRT] Fastest Tactic: 3 Time: 0.114622 [04/19/2021-12:50:24] [V] [TRT] *************** Autotuning format combination: -> Float(1,1000) *************** [04/19/2021-12:50:24] [V] [TRT] *************** Autotuning format combination: Float(1,1280), Float(1,1000) -> Float(1,1000) *************** [04/19/2021-12:50:24] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/probs/MatMul_Gemm__22 (MatrixMultiply) [04/19/2021-12:50:24] [V] [TRT] Tactic: 0 is the only option, timing skipped [04/19/2021-12:50:24] [V] [TRT] Fastest Tactic: 0 Time: 0 [04/19/2021-12:50:24] [V] [TRT] *************** Autotuning format combination: -> Float(1,1000) *************** [04/19/2021-12:50:24] [V] [TRT] *************** Autotuning format combination: Float(1,1000), Float(1,1000) -> Float(1,1000) *************** [04/19/2021-12:50:24] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 281) [ElementWise] (ElementWise) [04/19/2021-12:50:24] [V] [TRT] Tactic: 1 time 0.0033725 [04/19/2021-12:50:24] [V] [TRT] Tactic: 2 time 0.012591 [04/19/2021-12:50:24] [V] [TRT] Fastest Tactic: 1 Time: 0.0033725 [04/19/2021-12:50:24] [V] [TRT] *************** Autotuning format combination: Float(1,1000) -> Float(1,1000) *************** [04/19/2021-12:50:24] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/probs/Softmax (SoftMax) [04/19/2021-12:50:24] [V] [TRT] Tactic: 1001 time 0.012565 [04/19/2021-12:50:24] [V] [TRT] Fastest Tactic: 1001 Time: 0.012565 [04/19/2021-12:50:24] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/efficientnet-b0/probs/Softmax (ExtSoftMax) [04/19/2021-12:50:24] [V] [TRT] Tactic: 0 time 0.0080665 [04/19/2021-12:50:24] [V] [TRT] Fastest Tactic: 0 Time: 0.0080665 [04/19/2021-12:50:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ExtSoftMax Tactic: 0 [04/19/2021-12:50:24] [V] [TRT] [04/19/2021-12:50:24] [V] [TRT] Formats and tactics selection completed in 332.899 seconds. [04/19/2021-12:50:24] [V] [TRT] After reformat layers: 185 layers [04/19/2021-12:50:24] [V] [TRT] Block size 1073741824 [04/19/2021-12:50:24] [V] [TRT] Block size 4816896 [04/19/2021-12:50:24] [V] [TRT] Block size 4816896 [04/19/2021-12:50:24] [V] [TRT] Block size 802816 [04/19/2021-12:50:24] [V] [TRT] Block size 301056 [04/19/2021-12:50:24] [V] [TRT] Block size 1 [04/19/2021-12:50:24] [V] [TRT] Total Activation Memory: 1084479489 [04/19/2021-12:50:24] [I] [TRT] Detected 1 inputs and 1 output network tensors. [04/19/2021-12:50:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:50:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:50:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:50:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:50:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block2b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:50:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:50:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:50:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:50:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block3b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:50:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:50:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [04/19/2021-12:50:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:50:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block4b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:50:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4c_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:50:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block4c_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block4c_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:50:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:50:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:50:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:50:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block5b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:50:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5c_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:50:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block5c_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block5c_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:50:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6a_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:50:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:50:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6b_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:50:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6c_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:50:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6c_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6c_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:50:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6d_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:50:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block6d_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6d_add/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [04/19/2021-12:50:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/block7a_expand_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:50:24] [V] [TRT] StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D__23 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D Weights: 3456 HostPersistent: 8 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/stem_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/stem_activation/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise Weights: 1152 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block1a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block1a_activation/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block1a_se_squeeze/Mean Weights: 0 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd Weights: 1024 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd Weights: 1024 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block1a_se_excite/mul) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D Weights: 0 HostPersistent: 3200 DevicePersistent: 77824 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D Weights: 0 HostPersistent: 3200 DevicePersistent: 81920 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block2a_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2a_expand_activation/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block2a_dwconv/depthwise Weights: 3456 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block2a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2a_activation/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block2a_se_squeeze/Mean Weights: 0 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd Weights: 1536 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd Weights: 1536 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2a_se_excite/mul) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D Weights: 0 HostPersistent: 3200 DevicePersistent: 28672 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D Weights: 0 HostPersistent: 3200 DevicePersistent: 33792 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block2b_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2b_expand_activation/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise Weights: 5184 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block2b_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2b_activation/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block2b_se_squeeze/Mean Weights: 0 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd Weights: 3456 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd Weights: 3456 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2b_se_excite/mul) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block2b_add/add Weights: 0 HostPersistent: 3200 DevicePersistent: 33280 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block3a_expand_conv/Conv2D Weights: 0 HostPersistent: 3200 DevicePersistent: 33792 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block3a_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3a_expand_activation/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block3a_dwconv/depthwise Weights: 14400 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block3a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3a_activation/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block3a_se_squeeze/Mean Weights: 0 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/BiasAdd Weights: 3456 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block3a_se_expand/BiasAdd Weights: 3456 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block3a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3a_se_excite/mul) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D Weights: 0 HostPersistent: 3200 DevicePersistent: 28160 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D Weights: 0 HostPersistent: 3200 DevicePersistent: 44544 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block3b_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3b_expand_activation/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block3b_dwconv/depthwise Weights: 24000 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block3b_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3b_activation/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block3b_se_squeeze/Mean Weights: 0 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd Weights: 9600 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd Weights: 9600 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3b_se_excite/mul) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block3b_add/add Weights: 0 HostPersistent: 3200 DevicePersistent: 43520 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block4a_expand_conv/Conv2D Weights: 0 HostPersistent: 3200 DevicePersistent: 44544 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block4a_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4a_expand_activation/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block4a_dwconv/depthwise Weights: 8640 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block4a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4a_activation/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block4a_se_squeeze/Mean Weights: 0 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/BiasAdd Weights: 9600 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block4a_se_expand/BiasAdd Weights: 9600 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block4a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4a_se_excite/mul) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D Weights: 0 HostPersistent: 3200 DevicePersistent: 78848 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D Weights: 0 HostPersistent: 3200 DevicePersistent: 157184 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block4b_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4b_expand_activation/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise Weights: 17280 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block4b_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4b_activation/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block4b_se_squeeze/Mean Weights: 0 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd Weights: 38400 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd Weights: 38400 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4b_se_excite/mul) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block4b_add/add Weights: 0 HostPersistent: 3200 DevicePersistent: 155648 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block4c_expand_conv/Conv2D Weights: 0 HostPersistent: 3200 DevicePersistent: 157184 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block4c_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4c_expand_activation/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block4c_dwconv/depthwise Weights: 17280 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block4c_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4c_activation/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block4c_se_squeeze/Mean Weights: 0 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/BiasAdd Weights: 38400 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block4c_se_expand/BiasAdd Weights: 38400 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block4c_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4c_se_excite/mul) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block4c_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block4c_add/add Weights: 0 HostPersistent: 3200 DevicePersistent: 155648 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block5a_expand_conv/Conv2D Weights: 0 HostPersistent: 3200 DevicePersistent: 157184 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block5a_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5a_expand_activation/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block5a_dwconv/depthwise Weights: 48000 HostPersistent: 8 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block5a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5a_activation/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block5a_se_squeeze/Mean Weights: 0 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/BiasAdd Weights: 38400 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block5a_se_expand/BiasAdd Weights: 38400 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block5a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5a_se_excite/mul) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D Weights: 0 HostPersistent: 3200 DevicePersistent: 217088 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D Weights: 0 HostPersistent: 3200 DevicePersistent: 305152 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block5b_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5b_expand_activation/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block5b_dwconv/depthwise Weights: 67200 HostPersistent: 8 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block5b_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5b_activation/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block5b_se_squeeze/Mean Weights: 0 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd Weights: 75264 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd Weights: 75264 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5b_se_excite/mul) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block5b_add/add Weights: 0 HostPersistent: 3200 DevicePersistent: 303104 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block5c_expand_conv/Conv2D Weights: 0 HostPersistent: 3200 DevicePersistent: 305152 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block5c_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5c_expand_activation/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block5c_dwconv/depthwise Weights: 67200 HostPersistent: 8 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block5c_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5c_activation/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block5c_se_squeeze/Mean Weights: 0 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/BiasAdd Weights: 75264 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block5c_se_expand/BiasAdd Weights: 75264 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block5c_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5c_se_excite/mul) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block5c_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block5c_add/add Weights: 0 HostPersistent: 3200 DevicePersistent: 303104 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block6a_expand_conv/Conv2D Weights: 0 HostPersistent: 3200 DevicePersistent: 305152 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block6a_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6a_expand_activation/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block6a_dwconv/depthwise Weights: 67200 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block6a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6a_activation/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block6a_se_squeeze/Mean Weights: 0 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/BiasAdd Weights: 75264 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block6a_se_expand/BiasAdd Weights: 75264 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block6a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6a_se_excite/mul) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block6a_project_conv/Conv2D Weights: 516096 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D Weights: 0 HostPersistent: 3200 DevicePersistent: 889856 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block6b_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6b_expand_activation/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block6b_dwconv/depthwise Weights: 115200 HostPersistent: 8 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block6b_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6b_activation/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block6b_se_squeeze/Mean Weights: 0 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd Weights: 221184 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd Weights: 221184 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6b_se_excite/mul) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6b_add/add Weights: 0 HostPersistent: 3200 DevicePersistent: 886272 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block6c_expand_conv/Conv2D Weights: 0 HostPersistent: 3200 DevicePersistent: 889856 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block6c_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6c_expand_activation/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block6c_dwconv/depthwise Weights: 115200 HostPersistent: 8 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block6c_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6c_activation/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block6c_se_squeeze/Mean Weights: 0 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/BiasAdd Weights: 221184 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block6c_se_expand/BiasAdd Weights: 221184 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block6c_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6c_se_excite/mul) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block6c_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6c_add/add Weights: 0 HostPersistent: 3200 DevicePersistent: 886272 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block6d_expand_conv/Conv2D Weights: 0 HostPersistent: 3200 DevicePersistent: 889856 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block6d_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6d_expand_activation/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block6d_dwconv/depthwise Weights: 115200 HostPersistent: 8 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block6d_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6d_activation/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block6d_se_squeeze/Mean Weights: 0 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/BiasAdd Weights: 221184 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block6d_se_expand/BiasAdd Weights: 221184 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block6d_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6d_se_excite/mul) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block6d_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6d_add/add Weights: 0 HostPersistent: 3200 DevicePersistent: 886272 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block7a_expand_conv/Conv2D Weights: 0 HostPersistent: 3200 DevicePersistent: 889856 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block7a_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block7a_expand_activation/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise Weights: 41472 HostPersistent: 8 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block7a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block7a_activation/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block7a_se_squeeze/Mean Weights: 0 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/BiasAdd Weights: 221184 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block7a_se_expand/BiasAdd Weights: 221184 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/block7a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block7a_se_excite/mul) Weights: 0 HostPersistent: 404 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/block7a_project_conv/Conv2D Weights: 1474560 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D Weights: 0 HostPersistent: 3200 DevicePersistent: 1644032 [04/19/2021-12:50:24] [V] [TRT] Layer: PWN(StatefulPartitionedCall/efficientnet-b0/top_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/top_activation/mul) Weights: 0 HostPersistent: 276 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/avg_pool/Mean Weights: 0 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/probs/MatMul/ReadVariableOp:0 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/probs/MatMul_Gemm__22 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: (Unnamed Layer* 279) [Constant] + (Unnamed Layer* 280) [Shuffle] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: (Unnamed Layer* 281) [ElementWise] Weights: 0 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Layer: StatefulPartitionedCall/efficientnet-b0/probs/Softmax Weights: 0 HostPersistent: 0 DevicePersistent: 0 [04/19/2021-12:50:24] [V] [TRT] Total Host Persistent Memory: 116052 [04/19/2021-12:50:24] [V] [TRT] Total Device Persistent Memory: 10912768 [04/19/2021-12:50:24] [V] [TRT] Total Weight Memory: 5230976 [04/19/2021-12:50:24] [V] [TRT] Builder timing cache: created 136 entries, 271 hit(s) [04/19/2021-12:50:24] [V] [TRT] Engine generation completed in 364.942 seconds. [04/19/2021-12:50:24] [V] [TRT] Engine Layer Information: [04/19/2021-12:50:24] [V] [TRT] Layer(Shuffle): StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D__23, Tactic: 0, input_1:0[Float(224,224,3)] -> StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D__23:0[Float(3,224,224)] [04/19/2021-12:50:24] [V] [TRT] Layer(Convolution): StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D, Tactic: 57, StatefulPartitionedCall/efficientnet-b0/stem_conv/Conv2D__23:0[Float(3,224,224)] -> StatefulPartitionedCall/efficientnet-b0/stem_bn/FusedBatchNormV3:0[Float(32,112,112)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/stem_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/stem_activation/mul), Tactic: 8, StatefulPartitionedCall/efficientnet-b0/stem_bn/FusedBatchNormV3:0[Float(32,112,112)] -> StatefulPartitionedCall/efficientnet-b0/stem_activation/mul:0[Float(32,112,112)] [04/19/2021-12:50:24] [V] [TRT] Layer(DepthwiseConvolution): StatefulPartitionedCall/efficientnet-b0/block1a_dwconv/depthwise, Tactic: -1, StatefulPartitionedCall/efficientnet-b0/stem_activation/mul:0[Float(32,112,112)] -> StatefulPartitionedCall/efficientnet-b0/block1a_bn/FusedBatchNormV3:0[Float(32,112,112)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block1a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block1a_activation/mul), Tactic: 8, StatefulPartitionedCall/efficientnet-b0/block1a_bn/FusedBatchNormV3:0[Float(32,112,112)] -> StatefulPartitionedCall/efficientnet-b0/block1a_activation/mul:0[Float(32,112,112)] [04/19/2021-12:50:24] [V] [TRT] Layer(Reduce): StatefulPartitionedCall/efficientnet-b0/block1a_se_squeeze/Mean, Tactic: 1, StatefulPartitionedCall/efficientnet-b0/block1a_activation/mul:0[Float(32,112,112)] -> StatefulPartitionedCall/efficientnet-b0/block1a_se_squeeze/Mean:0[Float(32)] [04/19/2021-12:50:24] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd, Tactic: 5177343, StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd__35:0[Float(32,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd:0[Float(8,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/mul), Tactic: 0, StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/BiasAdd:0[Float(8,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/mul:0[Float(8,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd, Tactic: 8716287, StatefulPartitionedCall/efficientnet-b0/block1a_se_reduce/mul:0[Float(8,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd:0[Float(32,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block1a_se_excite/mul), Tactic: 5, StatefulPartitionedCall/efficientnet-b0/block1a_se_expand/BiasAdd:0[Float(32,1,1)], StatefulPartitionedCall/efficientnet-b0/block1a_activation/mul:0[Float(32,112,112)] -> StatefulPartitionedCall/efficientnet-b0/block1a_se_excite/mul:0[Float(32,112,112)] [04/19/2021-12:50:24] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/efficientnet-b0/block1a_project_conv/Conv2D, Tactic: -6576203419454146580, StatefulPartitionedCall/efficientnet-b0/block1a_se_excite/mul:0[Float(32,112,112)] -> StatefulPartitionedCall/efficientnet-b0/block1a_project_bn/FusedBatchNormV3:0[Float(16,112,112)] [04/19/2021-12:50:24] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/efficientnet-b0/block2a_expand_conv/Conv2D, Tactic: -6576203419454146580, StatefulPartitionedCall/efficientnet-b0/block1a_project_bn/FusedBatchNormV3:0[Float(16,112,112)] -> StatefulPartitionedCall/efficientnet-b0/block2a_expand_bn/FusedBatchNormV3:0[Float(96,112,112)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block2a_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2a_expand_activation/mul), Tactic: 8, StatefulPartitionedCall/efficientnet-b0/block2a_expand_bn/FusedBatchNormV3:0[Float(96,112,112)] -> StatefulPartitionedCall/efficientnet-b0/block2a_expand_activation/mul:0[Float(96,112,112)] [04/19/2021-12:50:24] [V] [TRT] Layer(DepthwiseConvolution): StatefulPartitionedCall/efficientnet-b0/block2a_dwconv/depthwise, Tactic: -1, StatefulPartitionedCall/efficientnet-b0/block2a_expand_activation/mul:0[Float(96,112,112)] -> StatefulPartitionedCall/efficientnet-b0/block2a_bn/FusedBatchNormV3:0[Float(96,56,56)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block2a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2a_activation/mul), Tactic: 8, StatefulPartitionedCall/efficientnet-b0/block2a_bn/FusedBatchNormV3:0[Float(96,56,56)] -> StatefulPartitionedCall/efficientnet-b0/block2a_activation/mul:0[Float(96,56,56)] [04/19/2021-12:50:24] [V] [TRT] Layer(Reduce): StatefulPartitionedCall/efficientnet-b0/block2a_se_squeeze/Mean, Tactic: 1, StatefulPartitionedCall/efficientnet-b0/block2a_activation/mul:0[Float(96,56,56)] -> StatefulPartitionedCall/efficientnet-b0/block2a_se_squeeze/Mean:0[Float(96)] [04/19/2021-12:50:24] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd, Tactic: 9109503, StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd__55:0[Float(96,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd:0[Float(4,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/mul), Tactic: 0, StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/BiasAdd:0[Float(4,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/mul:0[Float(4,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd, Tactic: 7143423, StatefulPartitionedCall/efficientnet-b0/block2a_se_reduce/mul:0[Float(4,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd:0[Float(96,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2a_se_excite/mul), Tactic: 2, StatefulPartitionedCall/efficientnet-b0/block2a_se_expand/BiasAdd:0[Float(96,1,1)], StatefulPartitionedCall/efficientnet-b0/block2a_activation/mul:0[Float(96,56,56)] -> StatefulPartitionedCall/efficientnet-b0/block2a_se_excite/mul:0[Float(96,56,56)] [04/19/2021-12:50:24] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/efficientnet-b0/block2a_project_conv/Conv2D, Tactic: -6576203419454146580, StatefulPartitionedCall/efficientnet-b0/block2a_se_excite/mul:0[Float(96,56,56)] -> StatefulPartitionedCall/efficientnet-b0/block2a_project_bn/FusedBatchNormV3:0[Float(24,56,56)] [04/19/2021-12:50:24] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/efficientnet-b0/block2b_expand_conv/Conv2D, Tactic: -37215280111360163, StatefulPartitionedCall/efficientnet-b0/block2a_project_bn/FusedBatchNormV3:0[Float(24,56,56)] -> StatefulPartitionedCall/efficientnet-b0/block2b_expand_bn/FusedBatchNormV3:0[Float(144,56,56)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block2b_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2b_expand_activation/mul), Tactic: 8, StatefulPartitionedCall/efficientnet-b0/block2b_expand_bn/FusedBatchNormV3:0[Float(144,56,56)] -> StatefulPartitionedCall/efficientnet-b0/block2b_expand_activation/mul:0[Float(144,56,56)] [04/19/2021-12:50:24] [V] [TRT] Layer(DepthwiseConvolution): StatefulPartitionedCall/efficientnet-b0/block2b_dwconv/depthwise, Tactic: -1, StatefulPartitionedCall/efficientnet-b0/block2b_expand_activation/mul:0[Float(144,56,56)] -> StatefulPartitionedCall/efficientnet-b0/block2b_bn/FusedBatchNormV3:0[Float(144,56,56)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block2b_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2b_activation/mul), Tactic: 8, StatefulPartitionedCall/efficientnet-b0/block2b_bn/FusedBatchNormV3:0[Float(144,56,56)] -> StatefulPartitionedCall/efficientnet-b0/block2b_activation/mul:0[Float(144,56,56)] [04/19/2021-12:50:24] [V] [TRT] Layer(Reduce): StatefulPartitionedCall/efficientnet-b0/block2b_se_squeeze/Mean, Tactic: 1, StatefulPartitionedCall/efficientnet-b0/block2b_activation/mul:0[Float(144,56,56)] -> StatefulPartitionedCall/efficientnet-b0/block2b_se_squeeze/Mean:0[Float(144)] [04/19/2021-12:50:24] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd, Tactic: 5177343, StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd__75:0[Float(144,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd:0[Float(6,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/mul), Tactic: 0, StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/BiasAdd:0[Float(6,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/mul:0[Float(6,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd, Tactic: 7536639, StatefulPartitionedCall/efficientnet-b0/block2b_se_reduce/mul:0[Float(6,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd:0[Float(144,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block2b_se_excite/mul), Tactic: 2, StatefulPartitionedCall/efficientnet-b0/block2b_se_expand/BiasAdd:0[Float(144,1,1)], StatefulPartitionedCall/efficientnet-b0/block2b_activation/mul:0[Float(144,56,56)] -> StatefulPartitionedCall/efficientnet-b0/block2b_se_excite/mul:0[Float(144,56,56)] [04/19/2021-12:50:24] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/efficientnet-b0/block2b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block2b_add/add, Tactic: -6576203419454146580, StatefulPartitionedCall/efficientnet-b0/block2b_se_excite/mul:0[Float(144,56,56)], StatefulPartitionedCall/efficientnet-b0/block2a_project_bn/FusedBatchNormV3:0[Float(24,56,56)] -> StatefulPartitionedCall/efficientnet-b0/block2b_add/add:0[Float(24,56,56)] [04/19/2021-12:50:24] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/efficientnet-b0/block3a_expand_conv/Conv2D, Tactic: -37215280111360163, StatefulPartitionedCall/efficientnet-b0/block2b_add/add:0[Float(24,56,56)] -> StatefulPartitionedCall/efficientnet-b0/block3a_expand_bn/FusedBatchNormV3:0[Float(144,56,56)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block3a_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3a_expand_activation/mul), Tactic: 8, StatefulPartitionedCall/efficientnet-b0/block3a_expand_bn/FusedBatchNormV3:0[Float(144,56,56)] -> StatefulPartitionedCall/efficientnet-b0/block3a_expand_activation/mul:0[Float(144,56,56)] [04/19/2021-12:50:24] [V] [TRT] Layer(DepthwiseConvolution): StatefulPartitionedCall/efficientnet-b0/block3a_dwconv/depthwise, Tactic: -1, StatefulPartitionedCall/efficientnet-b0/block3a_expand_activation/mul:0[Float(144,56,56)] -> StatefulPartitionedCall/efficientnet-b0/block3a_bn/FusedBatchNormV3:0[Float(144,28,28)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block3a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3a_activation/mul), Tactic: 8, StatefulPartitionedCall/efficientnet-b0/block3a_bn/FusedBatchNormV3:0[Float(144,28,28)] -> StatefulPartitionedCall/efficientnet-b0/block3a_activation/mul:0[Float(144,28,28)] [04/19/2021-12:50:24] [V] [TRT] Layer(Reduce): StatefulPartitionedCall/efficientnet-b0/block3a_se_squeeze/Mean, Tactic: 1, StatefulPartitionedCall/efficientnet-b0/block3a_activation/mul:0[Float(144,28,28)] -> StatefulPartitionedCall/efficientnet-b0/block3a_se_squeeze/Mean:0[Float(144)] [04/19/2021-12:50:24] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/BiasAdd, Tactic: 5177343, StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/BiasAdd__95:0[Float(144,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/BiasAdd:0[Float(6,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/mul), Tactic: 0, StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/BiasAdd:0[Float(6,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/mul:0[Float(6,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/efficientnet-b0/block3a_se_expand/BiasAdd, Tactic: 7536639, StatefulPartitionedCall/efficientnet-b0/block3a_se_reduce/mul:0[Float(6,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block3a_se_expand/BiasAdd:0[Float(144,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block3a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3a_se_excite/mul), Tactic: 28, StatefulPartitionedCall/efficientnet-b0/block3a_se_expand/BiasAdd:0[Float(144,1,1)], StatefulPartitionedCall/efficientnet-b0/block3a_activation/mul:0[Float(144,28,28)] -> StatefulPartitionedCall/efficientnet-b0/block3a_se_excite/mul:0[Float(144,28,28)] [04/19/2021-12:50:24] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/efficientnet-b0/block3a_project_conv/Conv2D, Tactic: -37215280111360163, StatefulPartitionedCall/efficientnet-b0/block3a_se_excite/mul:0[Float(144,28,28)] -> StatefulPartitionedCall/efficientnet-b0/block3a_project_bn/FusedBatchNormV3:0[Float(40,28,28)] [04/19/2021-12:50:24] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/efficientnet-b0/block3b_expand_conv/Conv2D, Tactic: 5326823351883942011, StatefulPartitionedCall/efficientnet-b0/block3a_project_bn/FusedBatchNormV3:0[Float(40,28,28)] -> StatefulPartitionedCall/efficientnet-b0/block3b_expand_bn/FusedBatchNormV3:0[Float(240,28,28)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block3b_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3b_expand_activation/mul), Tactic: 8, StatefulPartitionedCall/efficientnet-b0/block3b_expand_bn/FusedBatchNormV3:0[Float(240,28,28)] -> StatefulPartitionedCall/efficientnet-b0/block3b_expand_activation/mul:0[Float(240,28,28)] [04/19/2021-12:50:24] [V] [TRT] Layer(DepthwiseConvolution): StatefulPartitionedCall/efficientnet-b0/block3b_dwconv/depthwise, Tactic: -1, StatefulPartitionedCall/efficientnet-b0/block3b_expand_activation/mul:0[Float(240,28,28)] -> StatefulPartitionedCall/efficientnet-b0/block3b_bn/FusedBatchNormV3:0[Float(240,28,28)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block3b_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3b_activation/mul), Tactic: 8, StatefulPartitionedCall/efficientnet-b0/block3b_bn/FusedBatchNormV3:0[Float(240,28,28)] -> StatefulPartitionedCall/efficientnet-b0/block3b_activation/mul:0[Float(240,28,28)] [04/19/2021-12:50:24] [V] [TRT] Layer(Reduce): StatefulPartitionedCall/efficientnet-b0/block3b_se_squeeze/Mean, Tactic: 1, StatefulPartitionedCall/efficientnet-b0/block3b_activation/mul:0[Float(240,28,28)] -> StatefulPartitionedCall/efficientnet-b0/block3b_se_squeeze/Mean:0[Float(240)] [04/19/2021-12:50:24] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd, Tactic: 5177343, StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd__115:0[Float(240,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd:0[Float(10,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/mul), Tactic: 28, StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/BiasAdd:0[Float(10,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/mul:0[Float(10,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd, Tactic: 7536639, StatefulPartitionedCall/efficientnet-b0/block3b_se_reduce/mul:0[Float(10,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd:0[Float(240,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block3b_se_excite/mul), Tactic: 28, StatefulPartitionedCall/efficientnet-b0/block3b_se_expand/BiasAdd:0[Float(240,1,1)], StatefulPartitionedCall/efficientnet-b0/block3b_activation/mul:0[Float(240,28,28)] -> StatefulPartitionedCall/efficientnet-b0/block3b_se_excite/mul:0[Float(240,28,28)] [04/19/2021-12:50:24] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/efficientnet-b0/block3b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block3b_add/add, Tactic: -37215280111360163, StatefulPartitionedCall/efficientnet-b0/block3b_se_excite/mul:0[Float(240,28,28)], StatefulPartitionedCall/efficientnet-b0/block3a_project_bn/FusedBatchNormV3:0[Float(40,28,28)] -> StatefulPartitionedCall/efficientnet-b0/block3b_add/add:0[Float(40,28,28)] [04/19/2021-12:50:24] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/efficientnet-b0/block4a_expand_conv/Conv2D, Tactic: 5326823351883942011, StatefulPartitionedCall/efficientnet-b0/block3b_add/add:0[Float(40,28,28)] -> StatefulPartitionedCall/efficientnet-b0/block4a_expand_bn/FusedBatchNormV3:0[Float(240,28,28)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block4a_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4a_expand_activation/mul), Tactic: 8, StatefulPartitionedCall/efficientnet-b0/block4a_expand_bn/FusedBatchNormV3:0[Float(240,28,28)] -> StatefulPartitionedCall/efficientnet-b0/block4a_expand_activation/mul:0[Float(240,28,28)] [04/19/2021-12:50:24] [V] [TRT] Layer(DepthwiseConvolution): StatefulPartitionedCall/efficientnet-b0/block4a_dwconv/depthwise, Tactic: -1, StatefulPartitionedCall/efficientnet-b0/block4a_expand_activation/mul:0[Float(240,28,28)] -> StatefulPartitionedCall/efficientnet-b0/block4a_bn/FusedBatchNormV3:0[Float(240,14,14)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block4a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4a_activation/mul), Tactic: 8, StatefulPartitionedCall/efficientnet-b0/block4a_bn/FusedBatchNormV3:0[Float(240,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block4a_activation/mul:0[Float(240,14,14)] [04/19/2021-12:50:24] [V] [TRT] Layer(Reduce): StatefulPartitionedCall/efficientnet-b0/block4a_se_squeeze/Mean, Tactic: 3, StatefulPartitionedCall/efficientnet-b0/block4a_activation/mul:0[Float(240,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block4a_se_squeeze/Mean:0[Float(240)] [04/19/2021-12:50:24] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/BiasAdd, Tactic: 5177343, StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/BiasAdd__135:0[Float(240,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/BiasAdd:0[Float(10,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/mul), Tactic: 28, StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/BiasAdd:0[Float(10,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/mul:0[Float(10,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/efficientnet-b0/block4a_se_expand/BiasAdd, Tactic: 7536639, StatefulPartitionedCall/efficientnet-b0/block4a_se_reduce/mul:0[Float(10,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block4a_se_expand/BiasAdd:0[Float(240,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block4a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4a_se_excite/mul), Tactic: 28, StatefulPartitionedCall/efficientnet-b0/block4a_se_expand/BiasAdd:0[Float(240,1,1)], StatefulPartitionedCall/efficientnet-b0/block4a_activation/mul:0[Float(240,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block4a_se_excite/mul:0[Float(240,14,14)] [04/19/2021-12:50:24] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/efficientnet-b0/block4a_project_conv/Conv2D, Tactic: -6576203419454146580, StatefulPartitionedCall/efficientnet-b0/block4a_se_excite/mul:0[Float(240,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block4a_project_bn/FusedBatchNormV3:0[Float(80,14,14)] [04/19/2021-12:50:24] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/efficientnet-b0/block4b_expand_conv/Conv2D, Tactic: 5326823351883942011, StatefulPartitionedCall/efficientnet-b0/block4a_project_bn/FusedBatchNormV3:0[Float(80,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block4b_expand_bn/FusedBatchNormV3:0[Float(480,14,14)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block4b_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4b_expand_activation/mul), Tactic: 8, StatefulPartitionedCall/efficientnet-b0/block4b_expand_bn/FusedBatchNormV3:0[Float(480,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block4b_expand_activation/mul:0[Float(480,14,14)] [04/19/2021-12:50:24] [V] [TRT] Layer(DepthwiseConvolution): StatefulPartitionedCall/efficientnet-b0/block4b_dwconv/depthwise, Tactic: -1, StatefulPartitionedCall/efficientnet-b0/block4b_expand_activation/mul:0[Float(480,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block4b_bn/FusedBatchNormV3:0[Float(480,14,14)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block4b_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4b_activation/mul), Tactic: 8, StatefulPartitionedCall/efficientnet-b0/block4b_bn/FusedBatchNormV3:0[Float(480,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block4b_activation/mul:0[Float(480,14,14)] [04/19/2021-12:50:24] [V] [TRT] Layer(Reduce): StatefulPartitionedCall/efficientnet-b0/block4b_se_squeeze/Mean, Tactic: 3, StatefulPartitionedCall/efficientnet-b0/block4b_activation/mul:0[Float(480,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block4b_se_squeeze/Mean:0[Float(480)] [04/19/2021-12:50:24] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd, Tactic: 4259839, StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd__155:0[Float(480,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd:0[Float(20,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/mul), Tactic: 28, StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/BiasAdd:0[Float(20,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/mul:0[Float(20,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd, Tactic: 5767167, StatefulPartitionedCall/efficientnet-b0/block4b_se_reduce/mul:0[Float(20,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd:0[Float(480,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4b_se_excite/mul), Tactic: 28, StatefulPartitionedCall/efficientnet-b0/block4b_se_expand/BiasAdd:0[Float(480,1,1)], StatefulPartitionedCall/efficientnet-b0/block4b_activation/mul:0[Float(480,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block4b_se_excite/mul:0[Float(480,14,14)] [04/19/2021-12:50:24] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/efficientnet-b0/block4b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block4b_add/add, Tactic: 5326823351883942011, StatefulPartitionedCall/efficientnet-b0/block4b_se_excite/mul:0[Float(480,14,14)], StatefulPartitionedCall/efficientnet-b0/block4a_project_bn/FusedBatchNormV3:0[Float(80,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block4b_add/add:0[Float(80,14,14)] [04/19/2021-12:50:24] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/efficientnet-b0/block4c_expand_conv/Conv2D, Tactic: 5326823351883942011, StatefulPartitionedCall/efficientnet-b0/block4b_add/add:0[Float(80,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block4c_expand_bn/FusedBatchNormV3:0[Float(480,14,14)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block4c_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4c_expand_activation/mul), Tactic: 8, StatefulPartitionedCall/efficientnet-b0/block4c_expand_bn/FusedBatchNormV3:0[Float(480,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block4c_expand_activation/mul:0[Float(480,14,14)] [04/19/2021-12:50:24] [V] [TRT] Layer(DepthwiseConvolution): StatefulPartitionedCall/efficientnet-b0/block4c_dwconv/depthwise, Tactic: -1, StatefulPartitionedCall/efficientnet-b0/block4c_expand_activation/mul:0[Float(480,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block4c_bn/FusedBatchNormV3:0[Float(480,14,14)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block4c_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4c_activation/mul), Tactic: 8, StatefulPartitionedCall/efficientnet-b0/block4c_bn/FusedBatchNormV3:0[Float(480,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block4c_activation/mul:0[Float(480,14,14)] [04/19/2021-12:50:24] [V] [TRT] Layer(Reduce): StatefulPartitionedCall/efficientnet-b0/block4c_se_squeeze/Mean, Tactic: 3, StatefulPartitionedCall/efficientnet-b0/block4c_activation/mul:0[Float(480,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block4c_se_squeeze/Mean:0[Float(480)] [04/19/2021-12:50:24] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/BiasAdd, Tactic: 4259839, StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/BiasAdd__175:0[Float(480,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/BiasAdd:0[Float(20,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/mul), Tactic: 0, StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/BiasAdd:0[Float(20,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/mul:0[Float(20,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/efficientnet-b0/block4c_se_expand/BiasAdd, Tactic: 5767167, StatefulPartitionedCall/efficientnet-b0/block4c_se_reduce/mul:0[Float(20,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block4c_se_expand/BiasAdd:0[Float(480,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block4c_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block4c_se_excite/mul), Tactic: 28, StatefulPartitionedCall/efficientnet-b0/block4c_se_expand/BiasAdd:0[Float(480,1,1)], StatefulPartitionedCall/efficientnet-b0/block4c_activation/mul:0[Float(480,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block4c_se_excite/mul:0[Float(480,14,14)] [04/19/2021-12:50:24] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/efficientnet-b0/block4c_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block4c_add/add, Tactic: 5326823351883942011, StatefulPartitionedCall/efficientnet-b0/block4c_se_excite/mul:0[Float(480,14,14)], StatefulPartitionedCall/efficientnet-b0/block4b_add/add:0[Float(80,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block4c_add/add:0[Float(80,14,14)] [04/19/2021-12:50:24] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/efficientnet-b0/block5a_expand_conv/Conv2D, Tactic: 5326823351883942011, StatefulPartitionedCall/efficientnet-b0/block4c_add/add:0[Float(80,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block5a_expand_bn/FusedBatchNormV3:0[Float(480,14,14)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block5a_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5a_expand_activation/mul), Tactic: 8, StatefulPartitionedCall/efficientnet-b0/block5a_expand_bn/FusedBatchNormV3:0[Float(480,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block5a_expand_activation/mul:0[Float(480,14,14)] [04/19/2021-12:50:24] [V] [TRT] Layer(Convolution): StatefulPartitionedCall/efficientnet-b0/block5a_dwconv/depthwise, Tactic: 0, StatefulPartitionedCall/efficientnet-b0/block5a_expand_activation/mul:0[Float(480,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block5a_bn/FusedBatchNormV3:0[Float(480,14,14)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block5a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5a_activation/mul), Tactic: 8, StatefulPartitionedCall/efficientnet-b0/block5a_bn/FusedBatchNormV3:0[Float(480,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block5a_activation/mul:0[Float(480,14,14)] [04/19/2021-12:50:24] [V] [TRT] Layer(Reduce): StatefulPartitionedCall/efficientnet-b0/block5a_se_squeeze/Mean, Tactic: 3, StatefulPartitionedCall/efficientnet-b0/block5a_activation/mul:0[Float(480,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block5a_se_squeeze/Mean:0[Float(480)] [04/19/2021-12:50:24] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/BiasAdd, Tactic: 4259839, StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/BiasAdd__195:0[Float(480,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/BiasAdd:0[Float(20,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/mul), Tactic: 28, StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/BiasAdd:0[Float(20,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/mul:0[Float(20,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/efficientnet-b0/block5a_se_expand/BiasAdd, Tactic: 5767167, StatefulPartitionedCall/efficientnet-b0/block5a_se_reduce/mul:0[Float(20,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block5a_se_expand/BiasAdd:0[Float(480,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block5a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5a_se_excite/mul), Tactic: 28, StatefulPartitionedCall/efficientnet-b0/block5a_se_expand/BiasAdd:0[Float(480,1,1)], StatefulPartitionedCall/efficientnet-b0/block5a_activation/mul:0[Float(480,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block5a_se_excite/mul:0[Float(480,14,14)] [04/19/2021-12:50:24] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/efficientnet-b0/block5a_project_conv/Conv2D, Tactic: 5326823351883942011, StatefulPartitionedCall/efficientnet-b0/block5a_se_excite/mul:0[Float(480,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block5a_project_bn/FusedBatchNormV3:0[Float(112,14,14)] [04/19/2021-12:50:24] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/efficientnet-b0/block5b_expand_conv/Conv2D, Tactic: -37215280111360163, StatefulPartitionedCall/efficientnet-b0/block5a_project_bn/FusedBatchNormV3:0[Float(112,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block5b_expand_bn/FusedBatchNormV3:0[Float(672,14,14)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block5b_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5b_expand_activation/mul), Tactic: 8, StatefulPartitionedCall/efficientnet-b0/block5b_expand_bn/FusedBatchNormV3:0[Float(672,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block5b_expand_activation/mul:0[Float(672,14,14)] [04/19/2021-12:50:24] [V] [TRT] Layer(Convolution): StatefulPartitionedCall/efficientnet-b0/block5b_dwconv/depthwise, Tactic: 2, StatefulPartitionedCall/efficientnet-b0/block5b_expand_activation/mul:0[Float(672,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block5b_bn/FusedBatchNormV3:0[Float(672,14,14)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block5b_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5b_activation/mul), Tactic: 8, StatefulPartitionedCall/efficientnet-b0/block5b_bn/FusedBatchNormV3:0[Float(672,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block5b_activation/mul:0[Float(672,14,14)] [04/19/2021-12:50:24] [V] [TRT] Layer(Reduce): StatefulPartitionedCall/efficientnet-b0/block5b_se_squeeze/Mean, Tactic: 3, StatefulPartitionedCall/efficientnet-b0/block5b_activation/mul:0[Float(672,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block5b_se_squeeze/Mean:0[Float(672)] [04/19/2021-12:50:24] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd, Tactic: 4259839, StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd__215:0[Float(672,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd:0[Float(28,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/mul), Tactic: 28, StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/BiasAdd:0[Float(28,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/mul:0[Float(28,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd, Tactic: 5767167, StatefulPartitionedCall/efficientnet-b0/block5b_se_reduce/mul:0[Float(28,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd:0[Float(672,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5b_se_excite/mul), Tactic: 28, StatefulPartitionedCall/efficientnet-b0/block5b_se_expand/BiasAdd:0[Float(672,1,1)], StatefulPartitionedCall/efficientnet-b0/block5b_activation/mul:0[Float(672,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block5b_se_excite/mul:0[Float(672,14,14)] [04/19/2021-12:50:24] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/efficientnet-b0/block5b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block5b_add/add, Tactic: 5326823351883942011, StatefulPartitionedCall/efficientnet-b0/block5b_se_excite/mul:0[Float(672,14,14)], StatefulPartitionedCall/efficientnet-b0/block5a_project_bn/FusedBatchNormV3:0[Float(112,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block5b_add/add:0[Float(112,14,14)] [04/19/2021-12:50:24] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/efficientnet-b0/block5c_expand_conv/Conv2D, Tactic: -37215280111360163, StatefulPartitionedCall/efficientnet-b0/block5b_add/add:0[Float(112,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block5c_expand_bn/FusedBatchNormV3:0[Float(672,14,14)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block5c_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5c_expand_activation/mul), Tactic: 8, StatefulPartitionedCall/efficientnet-b0/block5c_expand_bn/FusedBatchNormV3:0[Float(672,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block5c_expand_activation/mul:0[Float(672,14,14)] [04/19/2021-12:50:24] [V] [TRT] Layer(Convolution): StatefulPartitionedCall/efficientnet-b0/block5c_dwconv/depthwise, Tactic: 2, StatefulPartitionedCall/efficientnet-b0/block5c_expand_activation/mul:0[Float(672,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block5c_bn/FusedBatchNormV3:0[Float(672,14,14)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block5c_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5c_activation/mul), Tactic: 8, StatefulPartitionedCall/efficientnet-b0/block5c_bn/FusedBatchNormV3:0[Float(672,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block5c_activation/mul:0[Float(672,14,14)] [04/19/2021-12:50:24] [V] [TRT] Layer(Reduce): StatefulPartitionedCall/efficientnet-b0/block5c_se_squeeze/Mean, Tactic: 3, StatefulPartitionedCall/efficientnet-b0/block5c_activation/mul:0[Float(672,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block5c_se_squeeze/Mean:0[Float(672)] [04/19/2021-12:50:24] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/BiasAdd, Tactic: 4259839, StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/BiasAdd__235:0[Float(672,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/BiasAdd:0[Float(28,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/mul), Tactic: 28, StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/BiasAdd:0[Float(28,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/mul:0[Float(28,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/efficientnet-b0/block5c_se_expand/BiasAdd, Tactic: 5767167, StatefulPartitionedCall/efficientnet-b0/block5c_se_reduce/mul:0[Float(28,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block5c_se_expand/BiasAdd:0[Float(672,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block5c_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block5c_se_excite/mul), Tactic: 28, StatefulPartitionedCall/efficientnet-b0/block5c_se_expand/BiasAdd:0[Float(672,1,1)], StatefulPartitionedCall/efficientnet-b0/block5c_activation/mul:0[Float(672,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block5c_se_excite/mul:0[Float(672,14,14)] [04/19/2021-12:50:24] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/efficientnet-b0/block5c_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block5c_add/add, Tactic: 5326823351883942011, StatefulPartitionedCall/efficientnet-b0/block5c_se_excite/mul:0[Float(672,14,14)], StatefulPartitionedCall/efficientnet-b0/block5b_add/add:0[Float(112,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block5c_add/add:0[Float(112,14,14)] [04/19/2021-12:50:24] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/efficientnet-b0/block6a_expand_conv/Conv2D, Tactic: -37215280111360163, StatefulPartitionedCall/efficientnet-b0/block5c_add/add:0[Float(112,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block6a_expand_bn/FusedBatchNormV3:0[Float(672,14,14)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block6a_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6a_expand_activation/mul), Tactic: 8, StatefulPartitionedCall/efficientnet-b0/block6a_expand_bn/FusedBatchNormV3:0[Float(672,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block6a_expand_activation/mul:0[Float(672,14,14)] [04/19/2021-12:50:24] [V] [TRT] Layer(DepthwiseConvolution): StatefulPartitionedCall/efficientnet-b0/block6a_dwconv/depthwise, Tactic: -1, StatefulPartitionedCall/efficientnet-b0/block6a_expand_activation/mul:0[Float(672,14,14)] -> StatefulPartitionedCall/efficientnet-b0/block6a_bn/FusedBatchNormV3:0[Float(672,7,7)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block6a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6a_activation/mul), Tactic: 8, StatefulPartitionedCall/efficientnet-b0/block6a_bn/FusedBatchNormV3:0[Float(672,7,7)] -> StatefulPartitionedCall/efficientnet-b0/block6a_activation/mul:0[Float(672,7,7)] [04/19/2021-12:50:24] [V] [TRT] Layer(Reduce): StatefulPartitionedCall/efficientnet-b0/block6a_se_squeeze/Mean, Tactic: 3, StatefulPartitionedCall/efficientnet-b0/block6a_activation/mul:0[Float(672,7,7)] -> StatefulPartitionedCall/efficientnet-b0/block6a_se_squeeze/Mean:0[Float(672)] [04/19/2021-12:50:24] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/BiasAdd, Tactic: 4259839, StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/BiasAdd__255:0[Float(672,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/BiasAdd:0[Float(28,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/mul), Tactic: 28, StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/BiasAdd:0[Float(28,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/mul:0[Float(28,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/efficientnet-b0/block6a_se_expand/BiasAdd, Tactic: 5767167, StatefulPartitionedCall/efficientnet-b0/block6a_se_reduce/mul:0[Float(28,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block6a_se_expand/BiasAdd:0[Float(672,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block6a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6a_se_excite/mul), Tactic: 28, StatefulPartitionedCall/efficientnet-b0/block6a_se_expand/BiasAdd:0[Float(672,1,1)], StatefulPartitionedCall/efficientnet-b0/block6a_activation/mul:0[Float(672,7,7)] -> StatefulPartitionedCall/efficientnet-b0/block6a_se_excite/mul:0[Float(672,7,7)] [04/19/2021-12:50:24] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/efficientnet-b0/block6a_project_conv/Conv2D, Tactic: 7340031, StatefulPartitionedCall/efficientnet-b0/block6a_se_excite/mul:0[Float(672,7,7)] -> StatefulPartitionedCall/efficientnet-b0/block6a_project_bn/FusedBatchNormV3:0[Float(192,7,7)] [04/19/2021-12:50:24] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/efficientnet-b0/block6b_expand_conv/Conv2D, Tactic: 5326823351883942011, StatefulPartitionedCall/efficientnet-b0/block6a_project_bn/FusedBatchNormV3:0[Float(192,7,7)] -> StatefulPartitionedCall/efficientnet-b0/block6b_expand_bn/FusedBatchNormV3:0[Float(1152,7,7)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block6b_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6b_expand_activation/mul), Tactic: 8, StatefulPartitionedCall/efficientnet-b0/block6b_expand_bn/FusedBatchNormV3:0[Float(1152,7,7)] -> StatefulPartitionedCall/efficientnet-b0/block6b_expand_activation/mul:0[Float(1152,7,7)] [04/19/2021-12:50:24] [V] [TRT] Layer(Convolution): StatefulPartitionedCall/efficientnet-b0/block6b_dwconv/depthwise, Tactic: 57, StatefulPartitionedCall/efficientnet-b0/block6b_expand_activation/mul:0[Float(1152,7,7)] -> StatefulPartitionedCall/efficientnet-b0/block6b_bn/FusedBatchNormV3:0[Float(1152,7,7)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block6b_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6b_activation/mul), Tactic: 8, StatefulPartitionedCall/efficientnet-b0/block6b_bn/FusedBatchNormV3:0[Float(1152,7,7)] -> StatefulPartitionedCall/efficientnet-b0/block6b_activation/mul:0[Float(1152,7,7)] [04/19/2021-12:50:24] [V] [TRT] Layer(Reduce): StatefulPartitionedCall/efficientnet-b0/block6b_se_squeeze/Mean, Tactic: 3, StatefulPartitionedCall/efficientnet-b0/block6b_activation/mul:0[Float(1152,7,7)] -> StatefulPartitionedCall/efficientnet-b0/block6b_se_squeeze/Mean:0[Float(1152)] [04/19/2021-12:50:24] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd, Tactic: 6291455, StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd__275:0[Float(1152,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd:0[Float(48,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/mul), Tactic: 0, StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/BiasAdd:0[Float(48,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/mul:0[Float(48,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd, Tactic: 7536639, StatefulPartitionedCall/efficientnet-b0/block6b_se_reduce/mul:0[Float(48,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd:0[Float(1152,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6b_se_excite/mul), Tactic: 28, StatefulPartitionedCall/efficientnet-b0/block6b_se_expand/BiasAdd:0[Float(1152,1,1)], StatefulPartitionedCall/efficientnet-b0/block6b_activation/mul:0[Float(1152,7,7)] -> StatefulPartitionedCall/efficientnet-b0/block6b_se_excite/mul:0[Float(1152,7,7)] [04/19/2021-12:50:24] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/efficientnet-b0/block6b_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6b_add/add, Tactic: -37215280111360163, StatefulPartitionedCall/efficientnet-b0/block6b_se_excite/mul:0[Float(1152,7,7)], StatefulPartitionedCall/efficientnet-b0/block6a_project_bn/FusedBatchNormV3:0[Float(192,7,7)] -> StatefulPartitionedCall/efficientnet-b0/block6b_add/add:0[Float(192,7,7)] [04/19/2021-12:50:24] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/efficientnet-b0/block6c_expand_conv/Conv2D, Tactic: 5326823351883942011, StatefulPartitionedCall/efficientnet-b0/block6b_add/add:0[Float(192,7,7)] -> StatefulPartitionedCall/efficientnet-b0/block6c_expand_bn/FusedBatchNormV3:0[Float(1152,7,7)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block6c_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6c_expand_activation/mul), Tactic: 8, StatefulPartitionedCall/efficientnet-b0/block6c_expand_bn/FusedBatchNormV3:0[Float(1152,7,7)] -> StatefulPartitionedCall/efficientnet-b0/block6c_expand_activation/mul:0[Float(1152,7,7)] [04/19/2021-12:50:24] [V] [TRT] Layer(Convolution): StatefulPartitionedCall/efficientnet-b0/block6c_dwconv/depthwise, Tactic: 57, StatefulPartitionedCall/efficientnet-b0/block6c_expand_activation/mul:0[Float(1152,7,7)] -> StatefulPartitionedCall/efficientnet-b0/block6c_bn/FusedBatchNormV3:0[Float(1152,7,7)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block6c_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6c_activation/mul), Tactic: 8, StatefulPartitionedCall/efficientnet-b0/block6c_bn/FusedBatchNormV3:0[Float(1152,7,7)] -> StatefulPartitionedCall/efficientnet-b0/block6c_activation/mul:0[Float(1152,7,7)] [04/19/2021-12:50:24] [V] [TRT] Layer(Reduce): StatefulPartitionedCall/efficientnet-b0/block6c_se_squeeze/Mean, Tactic: 3, StatefulPartitionedCall/efficientnet-b0/block6c_activation/mul:0[Float(1152,7,7)] -> StatefulPartitionedCall/efficientnet-b0/block6c_se_squeeze/Mean:0[Float(1152)] [04/19/2021-12:50:24] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/BiasAdd, Tactic: 6291455, StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/BiasAdd__295:0[Float(1152,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/BiasAdd:0[Float(48,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/mul), Tactic: 28, StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/BiasAdd:0[Float(48,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/mul:0[Float(48,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/efficientnet-b0/block6c_se_expand/BiasAdd, Tactic: 7536639, StatefulPartitionedCall/efficientnet-b0/block6c_se_reduce/mul:0[Float(48,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block6c_se_expand/BiasAdd:0[Float(1152,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block6c_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6c_se_excite/mul), Tactic: 28, StatefulPartitionedCall/efficientnet-b0/block6c_se_expand/BiasAdd:0[Float(1152,1,1)], StatefulPartitionedCall/efficientnet-b0/block6c_activation/mul:0[Float(1152,7,7)] -> StatefulPartitionedCall/efficientnet-b0/block6c_se_excite/mul:0[Float(1152,7,7)] [04/19/2021-12:50:24] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/efficientnet-b0/block6c_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6c_add/add, Tactic: -37215280111360163, StatefulPartitionedCall/efficientnet-b0/block6c_se_excite/mul:0[Float(1152,7,7)], StatefulPartitionedCall/efficientnet-b0/block6b_add/add:0[Float(192,7,7)] -> StatefulPartitionedCall/efficientnet-b0/block6c_add/add:0[Float(192,7,7)] [04/19/2021-12:50:24] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/efficientnet-b0/block6d_expand_conv/Conv2D, Tactic: 5326823351883942011, StatefulPartitionedCall/efficientnet-b0/block6c_add/add:0[Float(192,7,7)] -> StatefulPartitionedCall/efficientnet-b0/block6d_expand_bn/FusedBatchNormV3:0[Float(1152,7,7)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block6d_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6d_expand_activation/mul), Tactic: 8, StatefulPartitionedCall/efficientnet-b0/block6d_expand_bn/FusedBatchNormV3:0[Float(1152,7,7)] -> StatefulPartitionedCall/efficientnet-b0/block6d_expand_activation/mul:0[Float(1152,7,7)] [04/19/2021-12:50:24] [V] [TRT] Layer(Convolution): StatefulPartitionedCall/efficientnet-b0/block6d_dwconv/depthwise, Tactic: 57, StatefulPartitionedCall/efficientnet-b0/block6d_expand_activation/mul:0[Float(1152,7,7)] -> StatefulPartitionedCall/efficientnet-b0/block6d_bn/FusedBatchNormV3:0[Float(1152,7,7)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block6d_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6d_activation/mul), Tactic: 8, StatefulPartitionedCall/efficientnet-b0/block6d_bn/FusedBatchNormV3:0[Float(1152,7,7)] -> StatefulPartitionedCall/efficientnet-b0/block6d_activation/mul:0[Float(1152,7,7)] [04/19/2021-12:50:24] [V] [TRT] Layer(Reduce): StatefulPartitionedCall/efficientnet-b0/block6d_se_squeeze/Mean, Tactic: 3, StatefulPartitionedCall/efficientnet-b0/block6d_activation/mul:0[Float(1152,7,7)] -> StatefulPartitionedCall/efficientnet-b0/block6d_se_squeeze/Mean:0[Float(1152)] [04/19/2021-12:50:24] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/BiasAdd, Tactic: 6291455, StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/BiasAdd__315:0[Float(1152,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/BiasAdd:0[Float(48,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/mul), Tactic: 28, StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/BiasAdd:0[Float(48,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/mul:0[Float(48,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/efficientnet-b0/block6d_se_expand/BiasAdd, Tactic: 7536639, StatefulPartitionedCall/efficientnet-b0/block6d_se_reduce/mul:0[Float(48,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block6d_se_expand/BiasAdd:0[Float(1152,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block6d_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block6d_se_excite/mul), Tactic: 28, StatefulPartitionedCall/efficientnet-b0/block6d_se_expand/BiasAdd:0[Float(1152,1,1)], StatefulPartitionedCall/efficientnet-b0/block6d_activation/mul:0[Float(1152,7,7)] -> StatefulPartitionedCall/efficientnet-b0/block6d_se_excite/mul:0[Float(1152,7,7)] [04/19/2021-12:50:24] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/efficientnet-b0/block6d_project_conv/Conv2D + StatefulPartitionedCall/efficientnet-b0/block6d_add/add, Tactic: -37215280111360163, StatefulPartitionedCall/efficientnet-b0/block6d_se_excite/mul:0[Float(1152,7,7)], StatefulPartitionedCall/efficientnet-b0/block6c_add/add:0[Float(192,7,7)] -> StatefulPartitionedCall/efficientnet-b0/block6d_add/add:0[Float(192,7,7)] [04/19/2021-12:50:24] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/efficientnet-b0/block7a_expand_conv/Conv2D, Tactic: 5326823351883942011, StatefulPartitionedCall/efficientnet-b0/block6d_add/add:0[Float(192,7,7)] -> StatefulPartitionedCall/efficientnet-b0/block7a_expand_bn/FusedBatchNormV3:0[Float(1152,7,7)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block7a_expand_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block7a_expand_activation/mul), Tactic: 8, StatefulPartitionedCall/efficientnet-b0/block7a_expand_bn/FusedBatchNormV3:0[Float(1152,7,7)] -> StatefulPartitionedCall/efficientnet-b0/block7a_expand_activation/mul:0[Float(1152,7,7)] [04/19/2021-12:50:24] [V] [TRT] Layer(Convolution): StatefulPartitionedCall/efficientnet-b0/block7a_dwconv/depthwise, Tactic: 57, StatefulPartitionedCall/efficientnet-b0/block7a_expand_activation/mul:0[Float(1152,7,7)] -> StatefulPartitionedCall/efficientnet-b0/block7a_bn/FusedBatchNormV3:0[Float(1152,7,7)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block7a_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block7a_activation/mul), Tactic: 8, StatefulPartitionedCall/efficientnet-b0/block7a_bn/FusedBatchNormV3:0[Float(1152,7,7)] -> StatefulPartitionedCall/efficientnet-b0/block7a_activation/mul:0[Float(1152,7,7)] [04/19/2021-12:50:24] [V] [TRT] Layer(Reduce): StatefulPartitionedCall/efficientnet-b0/block7a_se_squeeze/Mean, Tactic: 3, StatefulPartitionedCall/efficientnet-b0/block7a_activation/mul:0[Float(1152,7,7)] -> StatefulPartitionedCall/efficientnet-b0/block7a_se_squeeze/Mean:0[Float(1152)] [04/19/2021-12:50:24] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/BiasAdd, Tactic: 6291455, StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/BiasAdd__335:0[Float(1152,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/BiasAdd:0[Float(48,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/mul), Tactic: 28, StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/BiasAdd:0[Float(48,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/mul:0[Float(48,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/efficientnet-b0/block7a_se_expand/BiasAdd, Tactic: 7536639, StatefulPartitionedCall/efficientnet-b0/block7a_se_reduce/mul:0[Float(48,1,1)] -> StatefulPartitionedCall/efficientnet-b0/block7a_se_expand/BiasAdd:0[Float(1152,1,1)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/block7a_se_expand/Sigmoid, StatefulPartitionedCall/efficientnet-b0/block7a_se_excite/mul), Tactic: 28, StatefulPartitionedCall/efficientnet-b0/block7a_se_expand/BiasAdd:0[Float(1152,1,1)], StatefulPartitionedCall/efficientnet-b0/block7a_activation/mul:0[Float(1152,7,7)] -> StatefulPartitionedCall/efficientnet-b0/block7a_se_excite/mul:0[Float(1152,7,7)] [04/19/2021-12:50:24] [V] [TRT] Layer(FusedConvActDirect): StatefulPartitionedCall/efficientnet-b0/block7a_project_conv/Conv2D, Tactic: 7340031, StatefulPartitionedCall/efficientnet-b0/block7a_se_excite/mul:0[Float(1152,7,7)] -> StatefulPartitionedCall/efficientnet-b0/block7a_project_bn/FusedBatchNormV3:0[Float(320,7,7)] [04/19/2021-12:50:24] [V] [TRT] Layer(scudnn): StatefulPartitionedCall/efficientnet-b0/top_conv/Conv2D, Tactic: 5326823351883942011, StatefulPartitionedCall/efficientnet-b0/block7a_project_bn/FusedBatchNormV3:0[Float(320,7,7)] -> StatefulPartitionedCall/efficientnet-b0/top_bn/FusedBatchNormV3:0[Float(1280,7,7)] [04/19/2021-12:50:24] [V] [TRT] Layer(PointWiseV2): PWN(StatefulPartitionedCall/efficientnet-b0/top_activation/Sigmoid, StatefulPartitionedCall/efficientnet-b0/top_activation/mul), Tactic: 8, StatefulPartitionedCall/efficientnet-b0/top_bn/FusedBatchNormV3:0[Float(1280,7,7)] -> StatefulPartitionedCall/efficientnet-b0/top_activation/mul:0[Float(1280,7,7)] [04/19/2021-12:50:24] [V] [TRT] Layer(Reduce): StatefulPartitionedCall/efficientnet-b0/avg_pool/Mean, Tactic: 3, StatefulPartitionedCall/efficientnet-b0/top_activation/mul:0[Float(1280,7,7)] -> StatefulPartitionedCall/efficientnet-b0/avg_pool/Mean:0[Float(1280)] [04/19/2021-12:50:24] [V] [TRT] Layer(Constant): StatefulPartitionedCall/efficientnet-b0/probs/MatMul/ReadVariableOp:0, Tactic: 0, -> (Unnamed Layer* 277) [Constant]_output[Float(1000)] [04/19/2021-12:50:24] [V] [TRT] Layer(MatrixMultiply): StatefulPartitionedCall/efficientnet-b0/probs/MatMul_Gemm__22, Tactic: 0, StatefulPartitionedCall/efficientnet-b0/avg_pool/Mean:0[Float(1280)], (Unnamed Layer* 277) [Constant]_output[Float(1000)] -> (Unnamed Layer* 278) [Matrix Multiply]_output[Float(1000)] [04/19/2021-12:50:24] [V] [TRT] Layer(Constant): (Unnamed Layer* 279) [Constant] + (Unnamed Layer* 280) [Shuffle], Tactic: 0, -> (Unnamed Layer* 280) [Shuffle]_output[Float(1000)] [04/19/2021-12:50:24] [V] [TRT] Layer(ElementWise): (Unnamed Layer* 281) [ElementWise], Tactic: 1, (Unnamed Layer* 278) [Matrix Multiply]_output[Float(1000)], (Unnamed Layer* 280) [Shuffle]_output[Float(1000)] -> StatefulPartitionedCall/efficientnet-b0/probs/MatMul_Gemm__22:0[Float(1000)] [04/19/2021-12:50:24] [V] [TRT] Layer(ExtSoftMax): StatefulPartitionedCall/efficientnet-b0/probs/Softmax, Tactic: 0, StatefulPartitionedCall/efficientnet-b0/probs/MatMul_Gemm__22:0[Float(1000)] -> probs[Float(1000)] [04/19/2021-12:50:25] [I] Starting inference threads [04/19/2021-12:50:28] [I] Warmup completed 0 queries over 200 ms [04/19/2021-12:50:28] [I] Timing trace has 0 queries over 3.06723 s [04/19/2021-12:50:28] [I] Trace averages of 10 runs: [04/19/2021-12:50:28] [I] Average on 10 runs - GPU latency: 30.3548 ms - Host latency: 30.5242 ms (end to end 30.5638 ms, enqueue 30.3383 ms) [04/19/2021-12:50:28] [I] Average on 10 runs - GPU latency: 30.3718 ms - Host latency: 30.5398 ms (end to end 30.576 ms, enqueue 30.3523 ms) [04/19/2021-12:50:28] [I] Average on 10 runs - GPU latency: 30.3995 ms - Host latency: 30.5687 ms (end to end 30.606 ms, enqueue 30.38 ms) [04/19/2021-12:50:28] [I] Average on 10 runs - GPU latency: 30.3718 ms - Host latency: 30.5399 ms (end to end 30.577 ms, enqueue 30.3534 ms) [04/19/2021-12:50:28] [I] Average on 10 runs - GPU latency: 30.3758 ms - Host latency: 30.5447 ms (end to end 30.5863 ms, enqueue 30.3564 ms) [04/19/2021-12:50:28] [I] Average on 10 runs - GPU latency: 30.4416 ms - Host latency: 30.6489 ms (end to end 30.7053 ms, enqueue 30.4163 ms) [04/19/2021-12:50:28] [I] Average on 10 runs - GPU latency: 30.504 ms - Host latency: 30.756 ms (end to end 30.8264 ms, enqueue 30.4757 ms) [04/19/2021-12:50:28] [I] Average on 10 runs - GPU latency: 30.4261 ms - Host latency: 30.5987 ms (end to end 30.6356 ms, enqueue 30.4006 ms) [04/19/2021-12:50:28] [I] Average on 10 runs - GPU latency: 30.3742 ms - Host latency: 30.5426 ms (end to end 30.5793 ms, enqueue 30.3557 ms) [04/19/2021-12:50:28] [I] Average on 10 runs - GPU latency: 30.4016 ms - Host latency: 30.569 ms (end to end 30.6054 ms, enqueue 30.3818 ms) [04/19/2021-12:50:28] [I] Host Latency [04/19/2021-12:50:28] [I] min: 30.4398 ms (end to end 30.4773 ms) [04/19/2021-12:50:28] [I] max: 30.8469 ms (end to end 30.917 ms) [04/19/2021-12:50:28] [I] mean: 30.5833 ms (end to end 30.6261 ms) [04/19/2021-12:50:28] [I] median: 30.5605 ms (end to end 30.6007 ms) [04/19/2021-12:50:28] [I] percentile: 30.8469 ms at 99% (end to end 30.917 ms at 99%) [04/19/2021-12:50:28] [I] throughput: 0 qps [04/19/2021-12:50:28] [I] walltime: 3.06723 s [04/19/2021-12:50:28] [I] Enqueue Time [04/19/2021-12:50:28] [I] min: 30.2551 ms [04/19/2021-12:50:28] [I] max: 30.5654 ms [04/19/2021-12:50:28] [I] median: 30.3754 ms [04/19/2021-12:50:28] [I] GPU Compute [04/19/2021-12:50:28] [I] min: 30.2732 ms [04/19/2021-12:50:28] [I] max: 30.5945 ms [04/19/2021-12:50:28] [I] mean: 30.4021 ms [04/19/2021-12:50:28] [I] median: 30.3927 ms [04/19/2021-12:50:28] [I] percentile: 30.5945 ms at 99% [04/19/2021-12:50:28] [I] total compute time: 3.04021 s &&&& PASSED TensorRT.trtexec # ./trtexec --onnx=/home/sesa/model.onnx --explicitBatch --verbose --workspace=1024 --exportTimes=trace.json --saveEngine=/home/sesa/target/model.trt