&&&& RUNNING TensorRT.trtexec # /usr/src/tensorrt/bin/trtexec --verbose --uff=frozen_inference_graph.uff --batch=1 --uffInput=Input,3,300,300 --output=NMS --saveEngine=mobilenetssd.trt [10/07/2020-14:47:21] [I] === Model Options === [10/07/2020-14:47:21] [I] Format: UFF [10/07/2020-14:47:21] [I] Model: frozen_inference_graph.uff [10/07/2020-14:47:21] [I] Uff Inputs Layout: NCHW [10/07/2020-14:47:21] [I] Input: Input,3,300,300 [10/07/2020-14:47:21] [I] Output: NMS [10/07/2020-14:47:21] [I] === Build Options === [10/07/2020-14:47:21] [I] Max batch: 1 [10/07/2020-14:47:21] [I] Workspace: 16 MB [10/07/2020-14:47:21] [I] minTiming: 1 [10/07/2020-14:47:21] [I] avgTiming: 8 [10/07/2020-14:47:21] [I] Precision: FP32 [10/07/2020-14:47:21] [I] Calibration: [10/07/2020-14:47:21] [I] Safe mode: Disabled [10/07/2020-14:47:21] [I] Save engine: mobilenetssd.trt [10/07/2020-14:47:21] [I] Load engine: [10/07/2020-14:47:21] [I] Builder Cache: Enabled [10/07/2020-14:47:21] [I] NVTX verbosity: 0 [10/07/2020-14:47:21] [I] Inputs format: fp32:CHW [10/07/2020-14:47:21] [I] Outputs format: fp32:CHW [10/07/2020-14:47:21] [I] Input build shapes: model [10/07/2020-14:47:21] [I] Input calibration shapes: model [10/07/2020-14:47:21] [I] === System Options === [10/07/2020-14:47:21] [I] Device: 0 [10/07/2020-14:47:21] [I] DLACore: [10/07/2020-14:47:21] [I] Plugins: [10/07/2020-14:47:21] [I] === Inference Options === [10/07/2020-14:47:21] [I] Batch: 1 [10/07/2020-14:47:21] [I] Input inference shapes: model [10/07/2020-14:47:21] [I] Iterations: 10 [10/07/2020-14:47:21] [I] Duration: 3s (+ 200ms warm up) [10/07/2020-14:47:21] [I] Sleep time: 0ms [10/07/2020-14:47:21] [I] Streams: 1 [10/07/2020-14:47:21] [I] ExposeDMA: Disabled [10/07/2020-14:47:21] [I] Spin-wait: Disabled [10/07/2020-14:47:21] [I] Multithreading: Disabled [10/07/2020-14:47:21] [I] CUDA Graph: Disabled [10/07/2020-14:47:21] [I] Skip inference: Disabled [10/07/2020-14:47:21] [I] Inputs: [10/07/2020-14:47:21] [I] === Reporting Options === [10/07/2020-14:47:21] [I] Verbose: Enabled [10/07/2020-14:47:21] [I] Averages: 10 inferences [10/07/2020-14:47:21] [I] Percentile: 99 [10/07/2020-14:47:21] [I] Dump output: Disabled [10/07/2020-14:47:21] [I] Profile: Disabled [10/07/2020-14:47:21] [I] Export timing to JSON file: [10/07/2020-14:47:21] [I] Export output to JSON file: [10/07/2020-14:47:21] [I] Export profile to JSON file: [10/07/2020-14:47:21] [I] [10/07/2020-14:47:21] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1 [10/07/2020-14:47:21] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1 [10/07/2020-14:47:21] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1 [10/07/2020-14:47:21] [V] [TRT] Registered plugin creator - ::Region_TRT version 1 [10/07/2020-14:47:21] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1 [10/07/2020-14:47:21] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1 [10/07/2020-14:47:21] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1 [10/07/2020-14:47:21] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1 [10/07/2020-14:47:21] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1 [10/07/2020-14:47:21] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1 [10/07/2020-14:47:21] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1 [10/07/2020-14:47:21] [V] [TRT] Registered plugin creator - ::CropAndResize version 1 [10/07/2020-14:47:21] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1 [10/07/2020-14:47:21] [V] [TRT] Registered plugin creator - ::Proposal version 1 [10/07/2020-14:47:21] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1 [10/07/2020-14:47:21] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1 [10/07/2020-14:47:21] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1 [10/07/2020-14:47:21] [V] [TRT] Registered plugin creator - ::Split version 1 [10/07/2020-14:47:21] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1 [10/07/2020-14:47:21] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing Input[Op: Input]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: Input -> [3,300,300] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: Input [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_0/weights/read/_166__cf__169[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_0/weights/read/_166__cf__169 -> [3,3,3,32] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_0/weights/read/_166__cf__169 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1[Op: Conv]. Inputs: Input, FeatureExtractor/MobilenetV1/Conv2d_0/weights/read/_166__cf__169 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1 -> [32,150,150] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/sub/_165__cf__168[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/sub/_165__cf__168 -> [32] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/sub/_165__cf__168 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/sub/_165__cf__168 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/add_1 -> [32,150,150] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] Setting dynamic range for (Unnamed Layer* 4) [Activation]_output to [0,6] [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6 -> [32,150,150] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_1_depthwise/depthwise_weights/read/_163__cf__166[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_1_depthwise/depthwise_weights/read/_163__cf__166 -> [3,3,32,1] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_1_depthwise/depthwise_weights/read/_163__cf__166 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/depthwise[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6, FeatureExtractor/MobilenetV1/Conv2d_1_depthwise/depthwise_weights/read/_163__cf__166 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/depthwise -> [32,150,150] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/depthwise [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/BatchNorm/batchnorm/mul/_161__cf__164[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/BatchNorm/batchnorm/mul/_161__cf__164 -> [32] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/BatchNorm/batchnorm/mul/_161__cf__164 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/depthwise, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/BatchNorm/batchnorm/mul/_161__cf__164 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/BatchNorm/batchnorm/mul_1 -> [32,150,150] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/BatchNorm/batchnorm/sub/_162__cf__165[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/BatchNorm/batchnorm/sub/_162__cf__165 -> [32] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/BatchNorm/batchnorm/sub/_162__cf__165 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/BatchNorm/batchnorm/sub/_162__cf__165 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/BatchNorm/batchnorm/add_1 -> [32,150,150] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] Setting dynamic range for (Unnamed Layer* 11) [Activation]_output to [0,6] [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/Relu6 -> [32,150,150] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/Relu6 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_1_pointwise/weights/read/_160__cf__163[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_1_pointwise/weights/read/_160__cf__163 -> [1,1,32,64] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_1_pointwise/weights/read/_160__cf__163 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/Relu6, FeatureExtractor/MobilenetV1/Conv2d_1_pointwise/weights/read/_160__cf__163 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 -> [64,150,150] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/sub/_159__cf__162[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/sub/_159__cf__162 -> [64] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/sub/_159__cf__162 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/sub/_159__cf__162 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/add_1 -> [64,150,150] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] Setting dynamic range for (Unnamed Layer* 16) [Activation]_output to [0,6] [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6 -> [64,150,150] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_2_depthwise/depthwise_weights/read/_157__cf__160[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_2_depthwise/depthwise_weights/read/_157__cf__160 -> [3,3,64,1] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_2_depthwise/depthwise_weights/read/_157__cf__160 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/depthwise[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6, FeatureExtractor/MobilenetV1/Conv2d_2_depthwise/depthwise_weights/read/_157__cf__160 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/depthwise -> [64,75,75] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/depthwise [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/BatchNorm/batchnorm/mul/_155__cf__158[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/BatchNorm/batchnorm/mul/_155__cf__158 -> [64] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/BatchNorm/batchnorm/mul/_155__cf__158 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/depthwise, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/BatchNorm/batchnorm/mul/_155__cf__158 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/BatchNorm/batchnorm/mul_1 -> [64,75,75] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/BatchNorm/batchnorm/sub/_156__cf__159[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/BatchNorm/batchnorm/sub/_156__cf__159 -> [64] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/BatchNorm/batchnorm/sub/_156__cf__159 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/BatchNorm/batchnorm/sub/_156__cf__159 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/BatchNorm/batchnorm/add_1 -> [64,75,75] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] Setting dynamic range for (Unnamed Layer* 23) [Activation]_output to [0,6] [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/Relu6 -> [64,75,75] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/Relu6 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_2_pointwise/weights/read/_154__cf__157[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_2_pointwise/weights/read/_154__cf__157 -> [1,1,64,128] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_2_pointwise/weights/read/_154__cf__157 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/Relu6, FeatureExtractor/MobilenetV1/Conv2d_2_pointwise/weights/read/_154__cf__157 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 -> [128,75,75] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/sub/_153__cf__156[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/sub/_153__cf__156 -> [128] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/sub/_153__cf__156 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/sub/_153__cf__156 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/add_1 -> [128,75,75] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] Setting dynamic range for (Unnamed Layer* 28) [Activation]_output to [0,6] [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6 -> [128,75,75] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_3_depthwise/depthwise_weights/read/_151__cf__154[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_3_depthwise/depthwise_weights/read/_151__cf__154 -> [3,3,128,1] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_3_depthwise/depthwise_weights/read/_151__cf__154 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/depthwise[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6, FeatureExtractor/MobilenetV1/Conv2d_3_depthwise/depthwise_weights/read/_151__cf__154 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/depthwise -> [128,75,75] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/depthwise [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/BatchNorm/batchnorm/mul/_149__cf__152[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/BatchNorm/batchnorm/mul/_149__cf__152 -> [128] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/BatchNorm/batchnorm/mul/_149__cf__152 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/depthwise, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/BatchNorm/batchnorm/mul/_149__cf__152 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/BatchNorm/batchnorm/mul_1 -> [128,75,75] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/BatchNorm/batchnorm/sub/_150__cf__153[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/BatchNorm/batchnorm/sub/_150__cf__153 -> [128] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/BatchNorm/batchnorm/sub/_150__cf__153 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/BatchNorm/batchnorm/sub/_150__cf__153 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/BatchNorm/batchnorm/add_1 -> [128,75,75] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] Setting dynamic range for (Unnamed Layer* 35) [Activation]_output to [0,6] [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/Relu6 -> [128,75,75] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/Relu6 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_3_pointwise/weights/read/_148__cf__151[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_3_pointwise/weights/read/_148__cf__151 -> [1,1,128,128] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_3_pointwise/weights/read/_148__cf__151 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/Relu6, FeatureExtractor/MobilenetV1/Conv2d_3_pointwise/weights/read/_148__cf__151 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 -> [128,75,75] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/sub/_147__cf__150[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/sub/_147__cf__150 -> [128] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/sub/_147__cf__150 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/sub/_147__cf__150 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/add_1 -> [128,75,75] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] Setting dynamic range for (Unnamed Layer* 40) [Activation]_output to [0,6] [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6 -> [128,75,75] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_4_depthwise/depthwise_weights/read/_145__cf__148[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_4_depthwise/depthwise_weights/read/_145__cf__148 -> [3,3,128,1] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_4_depthwise/depthwise_weights/read/_145__cf__148 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/depthwise[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6, FeatureExtractor/MobilenetV1/Conv2d_4_depthwise/depthwise_weights/read/_145__cf__148 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/depthwise -> [128,38,38] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/depthwise [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/BatchNorm/batchnorm/mul/_143__cf__146[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/BatchNorm/batchnorm/mul/_143__cf__146 -> [128] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/BatchNorm/batchnorm/mul/_143__cf__146 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/depthwise, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/BatchNorm/batchnorm/mul/_143__cf__146 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/BatchNorm/batchnorm/mul_1 -> [128,38,38] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/BatchNorm/batchnorm/sub/_144__cf__147[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/BatchNorm/batchnorm/sub/_144__cf__147 -> [128] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/BatchNorm/batchnorm/sub/_144__cf__147 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/BatchNorm/batchnorm/sub/_144__cf__147 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/BatchNorm/batchnorm/add_1 -> [128,38,38] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] Setting dynamic range for (Unnamed Layer* 47) [Activation]_output to [0,6] [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/Relu6 -> [128,38,38] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/Relu6 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_4_pointwise/weights/read/_142__cf__145[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_4_pointwise/weights/read/_142__cf__145 -> [1,1,128,256] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_4_pointwise/weights/read/_142__cf__145 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/Relu6, FeatureExtractor/MobilenetV1/Conv2d_4_pointwise/weights/read/_142__cf__145 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 -> [256,38,38] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/sub/_141__cf__144[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/sub/_141__cf__144 -> [256] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/sub/_141__cf__144 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/sub/_141__cf__144 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/add_1 -> [256,38,38] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] Setting dynamic range for (Unnamed Layer* 52) [Activation]_output to [0,6] [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6 -> [256,38,38] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_5_depthwise/depthwise_weights/read/_139__cf__142[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_5_depthwise/depthwise_weights/read/_139__cf__142 -> [3,3,256,1] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_5_depthwise/depthwise_weights/read/_139__cf__142 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/depthwise[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6, FeatureExtractor/MobilenetV1/Conv2d_5_depthwise/depthwise_weights/read/_139__cf__142 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/depthwise -> [256,38,38] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/depthwise [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/BatchNorm/batchnorm/mul/_137__cf__140[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/BatchNorm/batchnorm/mul/_137__cf__140 -> [256] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/BatchNorm/batchnorm/mul/_137__cf__140 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/depthwise, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/BatchNorm/batchnorm/mul/_137__cf__140 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/BatchNorm/batchnorm/mul_1 -> [256,38,38] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/BatchNorm/batchnorm/sub/_138__cf__141[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/BatchNorm/batchnorm/sub/_138__cf__141 -> [256] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/BatchNorm/batchnorm/sub/_138__cf__141 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/BatchNorm/batchnorm/sub/_138__cf__141 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/BatchNorm/batchnorm/add_1 -> [256,38,38] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] Setting dynamic range for (Unnamed Layer* 59) [Activation]_output to [0,6] [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/Relu6 -> [256,38,38] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/Relu6 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_5_pointwise/weights/read/_136__cf__139[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_5_pointwise/weights/read/_136__cf__139 -> [1,1,256,256] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_5_pointwise/weights/read/_136__cf__139 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/Relu6, FeatureExtractor/MobilenetV1/Conv2d_5_pointwise/weights/read/_136__cf__139 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 -> [256,38,38] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/sub/_135__cf__138[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/sub/_135__cf__138 -> [256] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/sub/_135__cf__138 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/sub/_135__cf__138 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/add_1 -> [256,38,38] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] Setting dynamic range for (Unnamed Layer* 64) [Activation]_output to [0,6] [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6 -> [256,38,38] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_6_depthwise/depthwise_weights/read/_133__cf__136[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_6_depthwise/depthwise_weights/read/_133__cf__136 -> [3,3,256,1] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_6_depthwise/depthwise_weights/read/_133__cf__136 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/depthwise[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6, FeatureExtractor/MobilenetV1/Conv2d_6_depthwise/depthwise_weights/read/_133__cf__136 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/depthwise -> [256,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/depthwise [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/BatchNorm/batchnorm/mul/_131__cf__134[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/BatchNorm/batchnorm/mul/_131__cf__134 -> [256] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/BatchNorm/batchnorm/mul/_131__cf__134 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/depthwise, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/BatchNorm/batchnorm/mul/_131__cf__134 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/BatchNorm/batchnorm/mul_1 -> [256,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/BatchNorm/batchnorm/sub/_132__cf__135[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/BatchNorm/batchnorm/sub/_132__cf__135 -> [256] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/BatchNorm/batchnorm/sub/_132__cf__135 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/BatchNorm/batchnorm/sub/_132__cf__135 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/BatchNorm/batchnorm/add_1 -> [256,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] Setting dynamic range for (Unnamed Layer* 71) [Activation]_output to [0,6] [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/Relu6 -> [256,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/Relu6 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_6_pointwise/weights/read/_130__cf__133[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_6_pointwise/weights/read/_130__cf__133 -> [1,1,256,512] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_6_pointwise/weights/read/_130__cf__133 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/Relu6, FeatureExtractor/MobilenetV1/Conv2d_6_pointwise/weights/read/_130__cf__133 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 -> [512,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/sub/_129__cf__132[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/sub/_129__cf__132 -> [512] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/sub/_129__cf__132 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/sub/_129__cf__132 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/add_1 -> [512,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] Setting dynamic range for (Unnamed Layer* 76) [Activation]_output to [0,6] [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6 -> [512,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_7_depthwise/depthwise_weights/read/_127__cf__130[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_7_depthwise/depthwise_weights/read/_127__cf__130 -> [3,3,512,1] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_7_depthwise/depthwise_weights/read/_127__cf__130 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/depthwise[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6, FeatureExtractor/MobilenetV1/Conv2d_7_depthwise/depthwise_weights/read/_127__cf__130 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/depthwise -> [512,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/depthwise [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/BatchNorm/batchnorm/mul/_125__cf__128[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/BatchNorm/batchnorm/mul/_125__cf__128 -> [512] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/BatchNorm/batchnorm/mul/_125__cf__128 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/depthwise, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/BatchNorm/batchnorm/mul/_125__cf__128 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/BatchNorm/batchnorm/mul_1 -> [512,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/BatchNorm/batchnorm/sub/_126__cf__129[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/BatchNorm/batchnorm/sub/_126__cf__129 -> [512] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/BatchNorm/batchnorm/sub/_126__cf__129 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/BatchNorm/batchnorm/sub/_126__cf__129 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/BatchNorm/batchnorm/add_1 -> [512,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] Setting dynamic range for (Unnamed Layer* 83) [Activation]_output to [0,6] [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/Relu6 -> [512,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/Relu6 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_7_pointwise/weights/read/_124__cf__127[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_7_pointwise/weights/read/_124__cf__127 -> [1,1,512,512] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_7_pointwise/weights/read/_124__cf__127 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/Relu6, FeatureExtractor/MobilenetV1/Conv2d_7_pointwise/weights/read/_124__cf__127 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 -> [512,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/sub/_123__cf__126[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/sub/_123__cf__126 -> [512] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/sub/_123__cf__126 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/sub/_123__cf__126 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/add_1 -> [512,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] Setting dynamic range for (Unnamed Layer* 88) [Activation]_output to [0,6] [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6 -> [512,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_8_depthwise/depthwise_weights/read/_121__cf__124[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_8_depthwise/depthwise_weights/read/_121__cf__124 -> [3,3,512,1] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_8_depthwise/depthwise_weights/read/_121__cf__124 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/depthwise[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6, FeatureExtractor/MobilenetV1/Conv2d_8_depthwise/depthwise_weights/read/_121__cf__124 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/depthwise -> [512,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/depthwise [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/BatchNorm/batchnorm/mul/_119__cf__122[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/BatchNorm/batchnorm/mul/_119__cf__122 -> [512] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/BatchNorm/batchnorm/mul/_119__cf__122 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/depthwise, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/BatchNorm/batchnorm/mul/_119__cf__122 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/BatchNorm/batchnorm/mul_1 -> [512,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/BatchNorm/batchnorm/sub/_120__cf__123[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/BatchNorm/batchnorm/sub/_120__cf__123 -> [512] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/BatchNorm/batchnorm/sub/_120__cf__123 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/BatchNorm/batchnorm/sub/_120__cf__123 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/BatchNorm/batchnorm/add_1 -> [512,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] Setting dynamic range for (Unnamed Layer* 95) [Activation]_output to [0,6] [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/Relu6 -> [512,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/Relu6 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_8_pointwise/weights/read/_118__cf__121[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_8_pointwise/weights/read/_118__cf__121 -> [1,1,512,512] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_8_pointwise/weights/read/_118__cf__121 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_pointwise/BatchNorm/batchnorm/mul_1[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/Relu6, FeatureExtractor/MobilenetV1/Conv2d_8_pointwise/weights/read/_118__cf__121 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_pointwise/BatchNorm/batchnorm/mul_1 -> [512,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_pointwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_pointwise/BatchNorm/batchnorm/sub/_117__cf__120[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_pointwise/BatchNorm/batchnorm/sub/_117__cf__120 -> [512] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_pointwise/BatchNorm/batchnorm/sub/_117__cf__120 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_pointwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_pointwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_pointwise/BatchNorm/batchnorm/sub/_117__cf__120 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_pointwise/BatchNorm/batchnorm/add_1 -> [512,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_pointwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] Setting dynamic range for (Unnamed Layer* 100) [Activation]_output to [0,6] [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_pointwise/Relu6 -> [512,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_pointwise/Relu6 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_9_depthwise/depthwise_weights/read/_115__cf__118[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_9_depthwise/depthwise_weights/read/_115__cf__118 -> [3,3,512,1] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_9_depthwise/depthwise_weights/read/_115__cf__118 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/depthwise[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_pointwise/Relu6, FeatureExtractor/MobilenetV1/Conv2d_9_depthwise/depthwise_weights/read/_115__cf__118 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/depthwise -> [512,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/depthwise [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/BatchNorm/batchnorm/mul/_113__cf__116[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/BatchNorm/batchnorm/mul/_113__cf__116 -> [512] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/BatchNorm/batchnorm/mul/_113__cf__116 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/depthwise, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/BatchNorm/batchnorm/mul/_113__cf__116 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/BatchNorm/batchnorm/mul_1 -> [512,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/BatchNorm/batchnorm/sub/_114__cf__117[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/BatchNorm/batchnorm/sub/_114__cf__117 -> [512] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/BatchNorm/batchnorm/sub/_114__cf__117 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/BatchNorm/batchnorm/sub/_114__cf__117 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/BatchNorm/batchnorm/add_1 -> [512,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] Setting dynamic range for (Unnamed Layer* 107) [Activation]_output to [0,6] [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/Relu6 -> [512,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/Relu6 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_9_pointwise/weights/read/_112__cf__115[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_9_pointwise/weights/read/_112__cf__115 -> [1,1,512,512] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_9_pointwise/weights/read/_112__cf__115 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_pointwise/BatchNorm/batchnorm/mul_1[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/Relu6, FeatureExtractor/MobilenetV1/Conv2d_9_pointwise/weights/read/_112__cf__115 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_pointwise/BatchNorm/batchnorm/mul_1 -> [512,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_pointwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_pointwise/BatchNorm/batchnorm/sub/_111__cf__114[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_pointwise/BatchNorm/batchnorm/sub/_111__cf__114 -> [512] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_pointwise/BatchNorm/batchnorm/sub/_111__cf__114 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_pointwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_pointwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_pointwise/BatchNorm/batchnorm/sub/_111__cf__114 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_pointwise/BatchNorm/batchnorm/add_1 -> [512,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_pointwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] Setting dynamic range for (Unnamed Layer* 112) [Activation]_output to [0,6] [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_pointwise/Relu6 -> [512,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_pointwise/Relu6 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_10_depthwise/depthwise_weights/read/_109__cf__112[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_10_depthwise/depthwise_weights/read/_109__cf__112 -> [3,3,512,1] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_10_depthwise/depthwise_weights/read/_109__cf__112 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/depthwise[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_pointwise/Relu6, FeatureExtractor/MobilenetV1/Conv2d_10_depthwise/depthwise_weights/read/_109__cf__112 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/depthwise -> [512,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/depthwise [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/BatchNorm/batchnorm/mul/_107__cf__110[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/BatchNorm/batchnorm/mul/_107__cf__110 -> [512] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/BatchNorm/batchnorm/mul/_107__cf__110 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/depthwise, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/BatchNorm/batchnorm/mul/_107__cf__110 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/BatchNorm/batchnorm/mul_1 -> [512,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/BatchNorm/batchnorm/sub/_108__cf__111[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/BatchNorm/batchnorm/sub/_108__cf__111 -> [512] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/BatchNorm/batchnorm/sub/_108__cf__111 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/BatchNorm/batchnorm/sub/_108__cf__111 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/BatchNorm/batchnorm/add_1 -> [512,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] Setting dynamic range for (Unnamed Layer* 119) [Activation]_output to [0,6] [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/Relu6 -> [512,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/Relu6 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_10_pointwise/weights/read/_106__cf__109[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_10_pointwise/weights/read/_106__cf__109 -> [1,1,512,512] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_10_pointwise/weights/read/_106__cf__109 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_pointwise/BatchNorm/batchnorm/mul_1[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/Relu6, FeatureExtractor/MobilenetV1/Conv2d_10_pointwise/weights/read/_106__cf__109 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_pointwise/BatchNorm/batchnorm/mul_1 -> [512,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_pointwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_pointwise/BatchNorm/batchnorm/sub/_105__cf__108[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_pointwise/BatchNorm/batchnorm/sub/_105__cf__108 -> [512] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_pointwise/BatchNorm/batchnorm/sub/_105__cf__108 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_pointwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_pointwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_pointwise/BatchNorm/batchnorm/sub/_105__cf__108 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_pointwise/BatchNorm/batchnorm/add_1 -> [512,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_pointwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] Setting dynamic range for (Unnamed Layer* 124) [Activation]_output to [0,6] [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_pointwise/Relu6 -> [512,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_pointwise/Relu6 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_11_depthwise/depthwise_weights/read/_103__cf__106[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_11_depthwise/depthwise_weights/read/_103__cf__106 -> [3,3,512,1] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_11_depthwise/depthwise_weights/read/_103__cf__106 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/depthwise[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_pointwise/Relu6, FeatureExtractor/MobilenetV1/Conv2d_11_depthwise/depthwise_weights/read/_103__cf__106 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/depthwise -> [512,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/depthwise [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/BatchNorm/batchnorm/mul/_101__cf__104[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/BatchNorm/batchnorm/mul/_101__cf__104 -> [512] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/BatchNorm/batchnorm/mul/_101__cf__104 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/depthwise, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/BatchNorm/batchnorm/mul/_101__cf__104 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/BatchNorm/batchnorm/mul_1 -> [512,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/BatchNorm/batchnorm/sub/_102__cf__105[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/BatchNorm/batchnorm/sub/_102__cf__105 -> [512] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/BatchNorm/batchnorm/sub/_102__cf__105 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/BatchNorm/batchnorm/sub/_102__cf__105 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/BatchNorm/batchnorm/add_1 -> [512,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] Setting dynamic range for (Unnamed Layer* 131) [Activation]_output to [0,6] [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/Relu6 -> [512,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/Relu6 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_11_pointwise/weights/read/_100__cf__103[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_11_pointwise/weights/read/_100__cf__103 -> [1,1,512,512] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_11_pointwise/weights/read/_100__cf__103 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_pointwise/BatchNorm/batchnorm/mul_1[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/Relu6, FeatureExtractor/MobilenetV1/Conv2d_11_pointwise/weights/read/_100__cf__103 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_pointwise/BatchNorm/batchnorm/mul_1 -> [512,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_pointwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_pointwise/BatchNorm/batchnorm/sub/_99__cf__102[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_pointwise/BatchNorm/batchnorm/sub/_99__cf__102 -> [512] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_pointwise/BatchNorm/batchnorm/sub/_99__cf__102 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_pointwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_pointwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_pointwise/BatchNorm/batchnorm/sub/_99__cf__102 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_pointwise/BatchNorm/batchnorm/add_1 -> [512,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_pointwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] Setting dynamic range for (Unnamed Layer* 136) [Activation]_output to [0,6] [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_pointwise/Relu6 -> [512,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_pointwise/Relu6 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing BoxPredictor_0/BoxEncodingPredictor/weights/read/_178__cf__181[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: BoxPredictor_0/BoxEncodingPredictor/weights/read/_178__cf__181 -> [1,1,512,12] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/BoxEncodingPredictor/weights/read/_178__cf__181 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing BoxPredictor_0/BoxEncodingPredictor/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_pointwise/Relu6, BoxPredictor_0/BoxEncodingPredictor/weights/read/_178__cf__181 [10/07/2020-14:47:23] [V] [TRT] UFFParser: BoxPredictor_0/BoxEncodingPredictor/Conv2D -> [12,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/BoxEncodingPredictor/Conv2D [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing BoxPredictor_0/BoxEncodingPredictor/biases/read/_177__cf__180[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: BoxPredictor_0/BoxEncodingPredictor/biases/read/_177__cf__180 -> [12] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/BoxEncodingPredictor/biases/read/_177__cf__180 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing BoxPredictor_0/BoxEncodingPredictor/BiasAdd[Op: Binary]. Inputs: BoxPredictor_0/BoxEncodingPredictor/Conv2D, BoxPredictor_0/BoxEncodingPredictor/biases/read/_177__cf__180 [10/07/2020-14:47:23] [V] [TRT] UFFParser: BoxPredictor_0/BoxEncodingPredictor/BiasAdd -> [12,19,19] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/BoxEncodingPredictor/BiasAdd [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing BoxPredictor_0/Shape[Op: Shape]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_pointwise/Relu6 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/Shape [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing BoxPredictor_0/strided_slice/stack[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: BoxPredictor_0/strided_slice/stack -> [1] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/strided_slice/stack [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing BoxPredictor_0/strided_slice/stack_1[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: BoxPredictor_0/strided_slice/stack_1 -> [1] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/strided_slice/stack_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing BoxPredictor_0/strided_slice/stack_2[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: BoxPredictor_0/strided_slice/stack_2 -> [1] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/strided_slice/stack_2 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing BoxPredictor_0/strided_slice[Op: StridedSlice]. Inputs: BoxPredictor_0/Shape, BoxPredictor_0/strided_slice/stack, BoxPredictor_0/strided_slice/stack_1, BoxPredictor_0/strided_slice/stack_2 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/strided_slice [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing BoxPredictor_0/stack/1[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: BoxPredictor_0/stack/1 -> [] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/stack/1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing BoxPredictor_0/stack/2[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: BoxPredictor_0/stack/2 -> [] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/stack/2 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing BoxPredictor_0/stack/3[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: BoxPredictor_0/stack/3 -> [] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/stack/3 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing BoxPredictor_0/stack[Op: Stack]. Inputs: BoxPredictor_0/strided_slice, BoxPredictor_0/stack/1, BoxPredictor_0/stack/2, BoxPredictor_0/stack/3 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/stack [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing BoxPredictor_0/Reshape[Op: Reshape]. Inputs: BoxPredictor_0/BoxEncodingPredictor/BiasAdd, BoxPredictor_0/stack [10/07/2020-14:47:23] [V] [TRT] UFFParser: BoxPredictor_0/Reshape -> [1083,1,4] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/Reshape [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_12_depthwise/depthwise_weights/read/_97__cf__100[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_12_depthwise/depthwise_weights/read/_97__cf__100 -> [3,3,512,1] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_12_depthwise/depthwise_weights/read/_97__cf__100 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/depthwise[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_pointwise/Relu6, FeatureExtractor/MobilenetV1/Conv2d_12_depthwise/depthwise_weights/read/_97__cf__100 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/depthwise -> [512,10,10] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/depthwise [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/BatchNorm/batchnorm/mul/_95__cf__98[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/BatchNorm/batchnorm/mul/_95__cf__98 -> [512] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/BatchNorm/batchnorm/mul/_95__cf__98 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/depthwise, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/BatchNorm/batchnorm/mul/_95__cf__98 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/BatchNorm/batchnorm/mul_1 -> [512,10,10] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/BatchNorm/batchnorm/sub/_96__cf__99[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/BatchNorm/batchnorm/sub/_96__cf__99 -> [512] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/BatchNorm/batchnorm/sub/_96__cf__99 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/BatchNorm/batchnorm/sub/_96__cf__99 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/BatchNorm/batchnorm/add_1 -> [512,10,10] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] Setting dynamic range for (Unnamed Layer* 155) [Activation]_output to [0,6] [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/Relu6 -> [512,10,10] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/Relu6 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_12_pointwise/weights/read/_94__cf__97[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_12_pointwise/weights/read/_94__cf__97 -> [1,1,512,1024] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_12_pointwise/weights/read/_94__cf__97 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/Relu6, FeatureExtractor/MobilenetV1/Conv2d_12_pointwise/weights/read/_94__cf__97 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 -> [1024,10,10] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/sub/_93__cf__96[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/sub/_93__cf__96 -> [1024] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/sub/_93__cf__96 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/sub/_93__cf__96 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/add_1 -> [1024,10,10] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] Setting dynamic range for (Unnamed Layer* 160) [Activation]_output to [0,6] [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6 -> [1024,10,10] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_depthwise/depthwise_weights/read/_91__cf__94[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_depthwise/depthwise_weights/read/_91__cf__94 -> [3,3,1024,1] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_depthwise/depthwise_weights/read/_91__cf__94 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/depthwise[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6, FeatureExtractor/MobilenetV1/Conv2d_13_depthwise/depthwise_weights/read/_91__cf__94 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/depthwise -> [1024,10,10] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/depthwise [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/BatchNorm/batchnorm/mul/_89__cf__92[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/BatchNorm/batchnorm/mul/_89__cf__92 -> [1024] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/BatchNorm/batchnorm/mul/_89__cf__92 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/depthwise, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/BatchNorm/batchnorm/mul/_89__cf__92 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/BatchNorm/batchnorm/mul_1 -> [1024,10,10] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/BatchNorm/batchnorm/sub/_90__cf__93[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/BatchNorm/batchnorm/sub/_90__cf__93 -> [1024] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/BatchNorm/batchnorm/sub/_90__cf__93 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/BatchNorm/batchnorm/sub/_90__cf__93 [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/BatchNorm/batchnorm/add_1 -> [1024,10,10] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:23] [V] [TRT] Setting dynamic range for (Unnamed Layer* 167) [Activation]_output to [0,6] [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/Relu6 -> [1024,10,10] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/Relu6 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise/weights/read/_88__cf__91[Op: Const]. [10/07/2020-14:47:23] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise/weights/read/_88__cf__91 -> [1,1,1024,1024] [10/07/2020-14:47:23] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise/weights/read/_88__cf__91 [10/07/2020-14:47:23] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/Relu6, FeatureExtractor/MobilenetV1/Conv2d_13_pointwise/weights/read/_88__cf__91 [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 -> [1024,10,10] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/sub/_87__cf__90[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/sub/_87__cf__90 -> [1024] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/sub/_87__cf__90 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/sub/_87__cf__90 [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/add_1 -> [1024,10,10] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Setting dynamic range for (Unnamed Layer* 172) [Activation]_output to [0,6] [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 -> [1024,10,10] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_1/BoxEncodingPredictor/weights/read/_176__cf__179[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_1/BoxEncodingPredictor/weights/read/_176__cf__179 -> [1,1,1024,24] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/BoxEncodingPredictor/weights/read/_176__cf__179 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_1/BoxEncodingPredictor/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6, BoxPredictor_1/BoxEncodingPredictor/weights/read/_176__cf__179 [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_1/BoxEncodingPredictor/Conv2D -> [24,10,10] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/BoxEncodingPredictor/Conv2D [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_1/BoxEncodingPredictor/biases/read/_175__cf__178[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_1/BoxEncodingPredictor/biases/read/_175__cf__178 -> [24] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/BoxEncodingPredictor/biases/read/_175__cf__178 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_1/BoxEncodingPredictor/BiasAdd[Op: Binary]. Inputs: BoxPredictor_1/BoxEncodingPredictor/Conv2D, BoxPredictor_1/BoxEncodingPredictor/biases/read/_175__cf__178 [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_1/BoxEncodingPredictor/BiasAdd -> [24,10,10] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/BoxEncodingPredictor/BiasAdd [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_1/Shape[Op: Shape]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/Shape [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_1/strided_slice/stack[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_1/strided_slice/stack -> [1] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/strided_slice/stack [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_1/strided_slice/stack_1[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_1/strided_slice/stack_1 -> [1] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/strided_slice/stack_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_1/strided_slice/stack_2[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_1/strided_slice/stack_2 -> [1] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/strided_slice/stack_2 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_1/strided_slice[Op: StridedSlice]. Inputs: BoxPredictor_1/Shape, BoxPredictor_1/strided_slice/stack, BoxPredictor_1/strided_slice/stack_1, BoxPredictor_1/strided_slice/stack_2 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/strided_slice [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_1/stack/1[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_1/stack/1 -> [] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/stack/1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_1/stack/2[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_1/stack/2 -> [] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/stack/2 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_1/stack/3[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_1/stack/3 -> [] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/stack/3 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_1/stack[Op: Stack]. Inputs: BoxPredictor_1/strided_slice, BoxPredictor_1/stack/1, BoxPredictor_1/stack/2, BoxPredictor_1/stack/3 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/stack [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_1/Reshape[Op: Reshape]. Inputs: BoxPredictor_1/BoxEncodingPredictor/BiasAdd, BoxPredictor_1/stack [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_1/Reshape -> [600,1,4] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/Reshape [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/weights/read/_85__cf__88[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/weights/read/_85__cf__88 -> [1,1,1024,256] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/weights/read/_85__cf__88 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_1[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6, FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/weights/read/_85__cf__88 [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_1 -> [256,10,10] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/sub/_84__cf__87[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/sub/_84__cf__87 -> [256] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/sub/_84__cf__87 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/sub/_84__cf__87 [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/add_1 -> [256,10,10] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Setting dynamic range for (Unnamed Layer* 189) [Activation]_output to [0,6] [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/Relu6 -> [256,10,10] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/Relu6 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/weights/read/_82__cf__85[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/weights/read/_82__cf__85 -> [3,3,256,512] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/weights/read/_82__cf__85 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul_1[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/Relu6, FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/weights/read/_82__cf__85 [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul_1 -> [512,5,5] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/sub/_81__cf__84[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/sub/_81__cf__84 -> [512] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/sub/_81__cf__84 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/sub/_81__cf__84 [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/add_1 -> [512,5,5] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Setting dynamic range for (Unnamed Layer* 194) [Activation]_output to [0,6] [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/Relu6 -> [512,5,5] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/Relu6 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_2/BoxEncodingPredictor/weights/read/_174__cf__177[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_2/BoxEncodingPredictor/weights/read/_174__cf__177 -> [1,1,512,24] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/BoxEncodingPredictor/weights/read/_174__cf__177 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_2/BoxEncodingPredictor/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/Relu6, BoxPredictor_2/BoxEncodingPredictor/weights/read/_174__cf__177 [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_2/BoxEncodingPredictor/Conv2D -> [24,5,5] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/BoxEncodingPredictor/Conv2D [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_2/BoxEncodingPredictor/biases/read/_173__cf__176[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_2/BoxEncodingPredictor/biases/read/_173__cf__176 -> [24] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/BoxEncodingPredictor/biases/read/_173__cf__176 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_2/BoxEncodingPredictor/BiasAdd[Op: Binary]. Inputs: BoxPredictor_2/BoxEncodingPredictor/Conv2D, BoxPredictor_2/BoxEncodingPredictor/biases/read/_173__cf__176 [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_2/BoxEncodingPredictor/BiasAdd -> [24,5,5] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/BoxEncodingPredictor/BiasAdd [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_2/Shape[Op: Shape]. Inputs: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/Relu6 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/Shape [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_2/strided_slice/stack[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_2/strided_slice/stack -> [1] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/strided_slice/stack [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_2/strided_slice/stack_1[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_2/strided_slice/stack_1 -> [1] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/strided_slice/stack_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_2/strided_slice/stack_2[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_2/strided_slice/stack_2 -> [1] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/strided_slice/stack_2 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_2/strided_slice[Op: StridedSlice]. Inputs: BoxPredictor_2/Shape, BoxPredictor_2/strided_slice/stack, BoxPredictor_2/strided_slice/stack_1, BoxPredictor_2/strided_slice/stack_2 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/strided_slice [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_2/stack/1[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_2/stack/1 -> [] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/stack/1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_2/stack/2[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_2/stack/2 -> [] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/stack/2 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_2/stack/3[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_2/stack/3 -> [] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/stack/3 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_2/stack[Op: Stack]. Inputs: BoxPredictor_2/strided_slice, BoxPredictor_2/stack/1, BoxPredictor_2/stack/2, BoxPredictor_2/stack/3 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/stack [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_2/Reshape[Op: Reshape]. Inputs: BoxPredictor_2/BoxEncodingPredictor/BiasAdd, BoxPredictor_2/stack [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_2/Reshape -> [150,1,4] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/Reshape [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/weights/read/_79__cf__82[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/weights/read/_79__cf__82 -> [1,1,512,128] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/weights/read/_79__cf__82 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_1[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/Relu6, FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/weights/read/_79__cf__82 [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_1 -> [128,5,5] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/sub/_78__cf__81[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/sub/_78__cf__81 -> [128] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/sub/_78__cf__81 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/sub/_78__cf__81 [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/add_1 -> [128,5,5] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Setting dynamic range for (Unnamed Layer* 211) [Activation]_output to [0,6] [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/Relu6 -> [128,5,5] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/Relu6 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/weights/read/_76__cf__79[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/weights/read/_76__cf__79 -> [3,3,128,256] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/weights/read/_76__cf__79 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul_1[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/Relu6, FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/weights/read/_76__cf__79 [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul_1 -> [256,3,3] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/sub/_75__cf__78[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/sub/_75__cf__78 -> [256] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/sub/_75__cf__78 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/sub/_75__cf__78 [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/add_1 -> [256,3,3] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Setting dynamic range for (Unnamed Layer* 216) [Activation]_output to [0,6] [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/Relu6 -> [256,3,3] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/Relu6 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_3/BoxEncodingPredictor/weights/read/_172__cf__175[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_3/BoxEncodingPredictor/weights/read/_172__cf__175 -> [1,1,256,24] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/BoxEncodingPredictor/weights/read/_172__cf__175 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_3/BoxEncodingPredictor/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/Relu6, BoxPredictor_3/BoxEncodingPredictor/weights/read/_172__cf__175 [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_3/BoxEncodingPredictor/Conv2D -> [24,3,3] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/BoxEncodingPredictor/Conv2D [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_3/BoxEncodingPredictor/biases/read/_171__cf__174[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_3/BoxEncodingPredictor/biases/read/_171__cf__174 -> [24] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/BoxEncodingPredictor/biases/read/_171__cf__174 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_3/BoxEncodingPredictor/BiasAdd[Op: Binary]. Inputs: BoxPredictor_3/BoxEncodingPredictor/Conv2D, BoxPredictor_3/BoxEncodingPredictor/biases/read/_171__cf__174 [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_3/BoxEncodingPredictor/BiasAdd -> [24,3,3] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/BoxEncodingPredictor/BiasAdd [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_3/Shape[Op: Shape]. Inputs: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/Relu6 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/Shape [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_3/strided_slice/stack[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_3/strided_slice/stack -> [1] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/strided_slice/stack [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_3/strided_slice/stack_1[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_3/strided_slice/stack_1 -> [1] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/strided_slice/stack_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_3/strided_slice/stack_2[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_3/strided_slice/stack_2 -> [1] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/strided_slice/stack_2 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_3/strided_slice[Op: StridedSlice]. Inputs: BoxPredictor_3/Shape, BoxPredictor_3/strided_slice/stack, BoxPredictor_3/strided_slice/stack_1, BoxPredictor_3/strided_slice/stack_2 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/strided_slice [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_3/stack/1[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_3/stack/1 -> [] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/stack/1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_3/stack/2[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_3/stack/2 -> [] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/stack/2 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_3/stack/3[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_3/stack/3 -> [] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/stack/3 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_3/stack[Op: Stack]. Inputs: BoxPredictor_3/strided_slice, BoxPredictor_3/stack/1, BoxPredictor_3/stack/2, BoxPredictor_3/stack/3 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/stack [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_3/Reshape[Op: Reshape]. Inputs: BoxPredictor_3/BoxEncodingPredictor/BiasAdd, BoxPredictor_3/stack [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_3/Reshape -> [54,1,4] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/Reshape [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/weights/read/_73__cf__76[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/weights/read/_73__cf__76 -> [1,1,256,128] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/weights/read/_73__cf__76 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_1[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/Relu6, FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/weights/read/_73__cf__76 [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_1 -> [128,3,3] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/sub/_72__cf__75[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/sub/_72__cf__75 -> [128] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/sub/_72__cf__75 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/sub/_72__cf__75 [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/add_1 -> [128,3,3] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Setting dynamic range for (Unnamed Layer* 233) [Activation]_output to [0,6] [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/Relu6 -> [128,3,3] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/Relu6 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/weights/read/_70__cf__73[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/weights/read/_70__cf__73 -> [3,3,128,256] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/weights/read/_70__cf__73 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul_1[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/Relu6, FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/weights/read/_70__cf__73 [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul_1 -> [256,2,2] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/sub/_69__cf__72[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/sub/_69__cf__72 -> [256] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/sub/_69__cf__72 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/sub/_69__cf__72 [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/add_1 -> [256,2,2] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Setting dynamic range for (Unnamed Layer* 238) [Activation]_output to [0,6] [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/Relu6 -> [256,2,2] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/Relu6 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_4/BoxEncodingPredictor/weights/read/_170__cf__173[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_4/BoxEncodingPredictor/weights/read/_170__cf__173 -> [1,1,256,24] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/BoxEncodingPredictor/weights/read/_170__cf__173 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_4/BoxEncodingPredictor/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/Relu6, BoxPredictor_4/BoxEncodingPredictor/weights/read/_170__cf__173 [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_4/BoxEncodingPredictor/Conv2D -> [24,2,2] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/BoxEncodingPredictor/Conv2D [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_4/BoxEncodingPredictor/biases/read/_169__cf__172[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_4/BoxEncodingPredictor/biases/read/_169__cf__172 -> [24] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/BoxEncodingPredictor/biases/read/_169__cf__172 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_4/BoxEncodingPredictor/BiasAdd[Op: Binary]. Inputs: BoxPredictor_4/BoxEncodingPredictor/Conv2D, BoxPredictor_4/BoxEncodingPredictor/biases/read/_169__cf__172 [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_4/BoxEncodingPredictor/BiasAdd -> [24,2,2] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/BoxEncodingPredictor/BiasAdd [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_4/Shape[Op: Shape]. Inputs: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/Relu6 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/Shape [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_4/strided_slice/stack[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_4/strided_slice/stack -> [1] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/strided_slice/stack [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_4/strided_slice/stack_1[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_4/strided_slice/stack_1 -> [1] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/strided_slice/stack_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_4/strided_slice/stack_2[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_4/strided_slice/stack_2 -> [1] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/strided_slice/stack_2 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_4/strided_slice[Op: StridedSlice]. Inputs: BoxPredictor_4/Shape, BoxPredictor_4/strided_slice/stack, BoxPredictor_4/strided_slice/stack_1, BoxPredictor_4/strided_slice/stack_2 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/strided_slice [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_4/stack/1[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_4/stack/1 -> [] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/stack/1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_4/stack/2[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_4/stack/2 -> [] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/stack/2 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_4/stack/3[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_4/stack/3 -> [] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/stack/3 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_4/stack[Op: Stack]. Inputs: BoxPredictor_4/strided_slice, BoxPredictor_4/stack/1, BoxPredictor_4/stack/2, BoxPredictor_4/stack/3 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/stack [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_4/Reshape[Op: Reshape]. Inputs: BoxPredictor_4/BoxEncodingPredictor/BiasAdd, BoxPredictor_4/stack [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_4/Reshape -> [24,1,4] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/Reshape [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/weights/read/_67__cf__70[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/weights/read/_67__cf__70 -> [1,1,256,64] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/weights/read/_67__cf__70 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_1[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/Relu6, FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/weights/read/_67__cf__70 [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_1 -> [64,2,2] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/sub/_66__cf__69[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/sub/_66__cf__69 -> [64] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/sub/_66__cf__69 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/sub/_66__cf__69 [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/add_1 -> [64,2,2] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Setting dynamic range for (Unnamed Layer* 255) [Activation]_output to [0,6] [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/Relu6 -> [64,2,2] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/Relu6 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/weights/read/_64__cf__67[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/weights/read/_64__cf__67 -> [3,3,64,128] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/weights/read/_64__cf__67 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/mul_1[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/Relu6, FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/weights/read/_64__cf__67 [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/mul_1 -> [128,1,1] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/sub/_63__cf__66[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/sub/_63__cf__66 -> [128] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/sub/_63__cf__66 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/sub/_63__cf__66 [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/add_1 -> [128,1,1] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Setting dynamic range for (Unnamed Layer* 260) [Activation]_output to [0,6] [10/07/2020-14:47:24] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/Relu6 -> [128,1,1] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/Relu6 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_5/BoxEncodingPredictor/weights/read/_168__cf__171[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_5/BoxEncodingPredictor/weights/read/_168__cf__171 -> [1,1,128,24] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/BoxEncodingPredictor/weights/read/_168__cf__171 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_5/BoxEncodingPredictor/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/Relu6, BoxPredictor_5/BoxEncodingPredictor/weights/read/_168__cf__171 [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_5/BoxEncodingPredictor/Conv2D -> [24,1,1] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/BoxEncodingPredictor/Conv2D [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_5/BoxEncodingPredictor/biases/read/_167__cf__170[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_5/BoxEncodingPredictor/biases/read/_167__cf__170 -> [24] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/BoxEncodingPredictor/biases/read/_167__cf__170 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_5/BoxEncodingPredictor/BiasAdd[Op: Binary]. Inputs: BoxPredictor_5/BoxEncodingPredictor/Conv2D, BoxPredictor_5/BoxEncodingPredictor/biases/read/_167__cf__170 [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_5/BoxEncodingPredictor/BiasAdd -> [24,1,1] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/BoxEncodingPredictor/BiasAdd [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_5/Shape[Op: Shape]. Inputs: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/Relu6 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/Shape [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_5/strided_slice/stack[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_5/strided_slice/stack -> [1] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/strided_slice/stack [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_5/strided_slice/stack_1[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_5/strided_slice/stack_1 -> [1] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/strided_slice/stack_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_5/strided_slice/stack_2[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_5/strided_slice/stack_2 -> [1] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/strided_slice/stack_2 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_5/strided_slice[Op: StridedSlice]. Inputs: BoxPredictor_5/Shape, BoxPredictor_5/strided_slice/stack, BoxPredictor_5/strided_slice/stack_1, BoxPredictor_5/strided_slice/stack_2 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/strided_slice [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_5/stack/1[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_5/stack/1 -> [] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/stack/1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_5/stack/2[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_5/stack/2 -> [] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/stack/2 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_5/stack/3[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_5/stack/3 -> [] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/stack/3 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_5/stack[Op: Stack]. Inputs: BoxPredictor_5/strided_slice, BoxPredictor_5/stack/1, BoxPredictor_5/stack/2, BoxPredictor_5/stack/3 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/stack [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_5/Reshape[Op: Reshape]. Inputs: BoxPredictor_5/BoxEncodingPredictor/BiasAdd, BoxPredictor_5/stack [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_5/Reshape -> [6,1,4] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/Reshape [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing concat_box_loc[Op: _FlattenConcat_TRT]. Inputs: BoxPredictor_0/Reshape, BoxPredictor_1/Reshape, BoxPredictor_2/Reshape, BoxPredictor_3/Reshape, BoxPredictor_4/Reshape, BoxPredictor_5/Reshape [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing Squeeze[Op: Squeeze]. Inputs: concat_box_loc [10/07/2020-14:47:24] [V] [TRT] UFFParser: Squeeze -> [7668,1,1] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: Squeeze [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing Shape_6[Op: Shape]. Inputs: Input [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: Shape_6 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing strided_slice_6/stack[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: strided_slice_6/stack -> [1] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: strided_slice_6/stack [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing strided_slice_6/stack_1[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: strided_slice_6/stack_1 -> [1] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: strided_slice_6/stack_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing strided_slice_6/stack_2[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: strided_slice_6/stack_2 -> [1] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: strided_slice_6/stack_2 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing strided_slice_6[Op: StridedSlice]. Inputs: Shape_6, strided_slice_6/stack, strided_slice_6/stack_1, strided_slice_6/stack_2 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: strided_slice_6 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing strided_slice_7/stack[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: strided_slice_7/stack -> [1] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: strided_slice_7/stack [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing strided_slice_7/stack_1[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: strided_slice_7/stack_1 -> [1] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: strided_slice_7/stack_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing strided_slice_7/stack_2[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: strided_slice_7/stack_2 -> [1] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: strided_slice_7/stack_2 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing strided_slice_7[Op: StridedSlice]. Inputs: Shape_6, strided_slice_7/stack, strided_slice_7/stack_1, strided_slice_7/stack_2 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: strided_slice_7 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing GridAnchor[Op: _GridAnchor_TRT]. Inputs: strided_slice_6, strided_slice_7 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing concat_priorbox[Op: Concat]. Inputs: GridAnchor [10/07/2020-14:47:24] [V] [TRT] UFFParser: concat_priorbox -> [2,7668,1] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: concat_priorbox [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_0/ClassPredictor/weights/read/_52__cf__55[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_0/ClassPredictor/weights/read/_52__cf__55 -> [1,1,512,273] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/ClassPredictor/weights/read/_52__cf__55 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_0/ClassPredictor/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_pointwise/Relu6, BoxPredictor_0/ClassPredictor/weights/read/_52__cf__55 [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_0/ClassPredictor/Conv2D -> [273,19,19] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/ClassPredictor/Conv2D [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_0/ClassPredictor/biases/read/_51__cf__54[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_0/ClassPredictor/biases/read/_51__cf__54 -> [273] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/ClassPredictor/biases/read/_51__cf__54 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_0/ClassPredictor/BiasAdd[Op: Binary]. Inputs: BoxPredictor_0/ClassPredictor/Conv2D, BoxPredictor_0/ClassPredictor/biases/read/_51__cf__54 [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_0/ClassPredictor/BiasAdd -> [273,19,19] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/ClassPredictor/BiasAdd [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_0/stack_1/1[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_0/stack_1/1 -> [] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/stack_1/1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_0/stack_1/2[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_0/stack_1/2 -> [] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/stack_1/2 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_0/stack_1[Op: Stack]. Inputs: BoxPredictor_0/strided_slice, BoxPredictor_0/stack_1/1, BoxPredictor_0/stack_1/2 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/stack_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_0/Reshape_1[Op: Reshape]. Inputs: BoxPredictor_0/ClassPredictor/BiasAdd, BoxPredictor_0/stack_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_0/Reshape_1 -> [1083,91,1] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/Reshape_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_1/ClassPredictor/weights/read/_50__cf__53[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_1/ClassPredictor/weights/read/_50__cf__53 -> [1,1,1024,546] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/ClassPredictor/weights/read/_50__cf__53 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_1/ClassPredictor/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6, BoxPredictor_1/ClassPredictor/weights/read/_50__cf__53 [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_1/ClassPredictor/Conv2D -> [546,10,10] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/ClassPredictor/Conv2D [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_1/ClassPredictor/biases/read/_49__cf__52[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_1/ClassPredictor/biases/read/_49__cf__52 -> [546] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/ClassPredictor/biases/read/_49__cf__52 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_1/ClassPredictor/BiasAdd[Op: Binary]. Inputs: BoxPredictor_1/ClassPredictor/Conv2D, BoxPredictor_1/ClassPredictor/biases/read/_49__cf__52 [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_1/ClassPredictor/BiasAdd -> [546,10,10] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/ClassPredictor/BiasAdd [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_1/stack_1/1[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_1/stack_1/1 -> [] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/stack_1/1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_1/stack_1/2[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_1/stack_1/2 -> [] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/stack_1/2 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_1/stack_1[Op: Stack]. Inputs: BoxPredictor_1/strided_slice, BoxPredictor_1/stack_1/1, BoxPredictor_1/stack_1/2 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/stack_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_1/Reshape_1[Op: Reshape]. Inputs: BoxPredictor_1/ClassPredictor/BiasAdd, BoxPredictor_1/stack_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_1/Reshape_1 -> [600,91,1] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/Reshape_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_2/ClassPredictor/weights/read/_48__cf__51[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_2/ClassPredictor/weights/read/_48__cf__51 -> [1,1,512,546] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/ClassPredictor/weights/read/_48__cf__51 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_2/ClassPredictor/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/Relu6, BoxPredictor_2/ClassPredictor/weights/read/_48__cf__51 [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_2/ClassPredictor/Conv2D -> [546,5,5] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/ClassPredictor/Conv2D [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_2/ClassPredictor/biases/read/_47__cf__50[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_2/ClassPredictor/biases/read/_47__cf__50 -> [546] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/ClassPredictor/biases/read/_47__cf__50 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_2/ClassPredictor/BiasAdd[Op: Binary]. Inputs: BoxPredictor_2/ClassPredictor/Conv2D, BoxPredictor_2/ClassPredictor/biases/read/_47__cf__50 [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_2/ClassPredictor/BiasAdd -> [546,5,5] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/ClassPredictor/BiasAdd [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_2/stack_1/1[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_2/stack_1/1 -> [] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/stack_1/1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_2/stack_1/2[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_2/stack_1/2 -> [] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/stack_1/2 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_2/stack_1[Op: Stack]. Inputs: BoxPredictor_2/strided_slice, BoxPredictor_2/stack_1/1, BoxPredictor_2/stack_1/2 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/stack_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_2/Reshape_1[Op: Reshape]. Inputs: BoxPredictor_2/ClassPredictor/BiasAdd, BoxPredictor_2/stack_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_2/Reshape_1 -> [150,91,1] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/Reshape_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_3/ClassPredictor/weights/read/_46__cf__49[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_3/ClassPredictor/weights/read/_46__cf__49 -> [1,1,256,546] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/ClassPredictor/weights/read/_46__cf__49 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_3/ClassPredictor/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/Relu6, BoxPredictor_3/ClassPredictor/weights/read/_46__cf__49 [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_3/ClassPredictor/Conv2D -> [546,3,3] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/ClassPredictor/Conv2D [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_3/ClassPredictor/biases/read/_45__cf__48[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_3/ClassPredictor/biases/read/_45__cf__48 -> [546] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/ClassPredictor/biases/read/_45__cf__48 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_3/ClassPredictor/BiasAdd[Op: Binary]. Inputs: BoxPredictor_3/ClassPredictor/Conv2D, BoxPredictor_3/ClassPredictor/biases/read/_45__cf__48 [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_3/ClassPredictor/BiasAdd -> [546,3,3] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/ClassPredictor/BiasAdd [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_3/stack_1/1[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_3/stack_1/1 -> [] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/stack_1/1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_3/stack_1/2[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_3/stack_1/2 -> [] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/stack_1/2 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_3/stack_1[Op: Stack]. Inputs: BoxPredictor_3/strided_slice, BoxPredictor_3/stack_1/1, BoxPredictor_3/stack_1/2 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/stack_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_3/Reshape_1[Op: Reshape]. Inputs: BoxPredictor_3/ClassPredictor/BiasAdd, BoxPredictor_3/stack_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_3/Reshape_1 -> [54,91,1] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/Reshape_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_4/ClassPredictor/weights/read/_44__cf__47[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_4/ClassPredictor/weights/read/_44__cf__47 -> [1,1,256,546] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/ClassPredictor/weights/read/_44__cf__47 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_4/ClassPredictor/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/Relu6, BoxPredictor_4/ClassPredictor/weights/read/_44__cf__47 [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_4/ClassPredictor/Conv2D -> [546,2,2] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/ClassPredictor/Conv2D [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_4/ClassPredictor/biases/read/_43__cf__46[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_4/ClassPredictor/biases/read/_43__cf__46 -> [546] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/ClassPredictor/biases/read/_43__cf__46 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_4/ClassPredictor/BiasAdd[Op: Binary]. Inputs: BoxPredictor_4/ClassPredictor/Conv2D, BoxPredictor_4/ClassPredictor/biases/read/_43__cf__46 [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_4/ClassPredictor/BiasAdd -> [546,2,2] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/ClassPredictor/BiasAdd [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_4/stack_1/1[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_4/stack_1/1 -> [] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/stack_1/1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_4/stack_1/2[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_4/stack_1/2 -> [] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/stack_1/2 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_4/stack_1[Op: Stack]. Inputs: BoxPredictor_4/strided_slice, BoxPredictor_4/stack_1/1, BoxPredictor_4/stack_1/2 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/stack_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_4/Reshape_1[Op: Reshape]. Inputs: BoxPredictor_4/ClassPredictor/BiasAdd, BoxPredictor_4/stack_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_4/Reshape_1 -> [24,91,1] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/Reshape_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_5/ClassPredictor/weights/read/_42__cf__45[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_5/ClassPredictor/weights/read/_42__cf__45 -> [1,1,128,546] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/ClassPredictor/weights/read/_42__cf__45 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_5/ClassPredictor/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/Relu6, BoxPredictor_5/ClassPredictor/weights/read/_42__cf__45 [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_5/ClassPredictor/Conv2D -> [546,1,1] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/ClassPredictor/Conv2D [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_5/ClassPredictor/biases/read/_41__cf__44[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_5/ClassPredictor/biases/read/_41__cf__44 -> [546] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/ClassPredictor/biases/read/_41__cf__44 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_5/ClassPredictor/BiasAdd[Op: Binary]. Inputs: BoxPredictor_5/ClassPredictor/Conv2D, BoxPredictor_5/ClassPredictor/biases/read/_41__cf__44 [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_5/ClassPredictor/BiasAdd -> [546,1,1] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/ClassPredictor/BiasAdd [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_5/stack_1/1[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_5/stack_1/1 -> [] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/stack_1/1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_5/stack_1/2[Op: Const]. [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_5/stack_1/2 -> [] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/stack_1/2 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_5/stack_1[Op: Stack]. Inputs: BoxPredictor_5/strided_slice, BoxPredictor_5/stack_1/1, BoxPredictor_5/stack_1/2 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/stack_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing BoxPredictor_5/Reshape_1[Op: Reshape]. Inputs: BoxPredictor_5/ClassPredictor/BiasAdd, BoxPredictor_5/stack_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: BoxPredictor_5/Reshape_1 -> [6,91,1] [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/Reshape_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing concat_box_conf[Op: _FlattenConcat_TRT]. Inputs: BoxPredictor_0/Reshape_1, BoxPredictor_1/Reshape_1, BoxPredictor_2/Reshape_1, BoxPredictor_3/Reshape_1, BoxPredictor_4/Reshape_1, BoxPredictor_5/Reshape_1 [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing NMS[Op: _NMS_TRT]. Inputs: Squeeze, concat_priorbox, concat_box_conf [10/07/2020-14:47:24] [V] [TRT] UFFParser: Parsing MarkOutput_0[Op: MarkOutput]. Inputs: NMS [10/07/2020-14:47:24] [V] [TRT] UFFParser: Applying order forwarding to: MarkOutput_0 [10/07/2020-14:47:24] [V] [TRT] Applying generic optimizations to the graph for inference. [10/07/2020-14:47:24] [V] [TRT] Original: 332 layers [10/07/2020-14:47:24] [V] [TRT] After dead-layer removal: 171 layers [10/07/2020-14:47:24] [V] [TRT] Fusing (Unnamed Layer* 147) [Shuffle] with BoxPredictor_0/Reshape [10/07/2020-14:47:24] [V] [TRT] Fusing (Unnamed Layer* 183) [Shuffle] with BoxPredictor_1/Reshape [10/07/2020-14:47:24] [V] [TRT] Fusing (Unnamed Layer* 205) [Shuffle] with BoxPredictor_2/Reshape [10/07/2020-14:47:24] [V] [TRT] Fusing (Unnamed Layer* 227) [Shuffle] with BoxPredictor_3/Reshape [10/07/2020-14:47:24] [V] [TRT] Fusing (Unnamed Layer* 249) [Shuffle] with BoxPredictor_4/Reshape [10/07/2020-14:47:24] [V] [TRT] Fusing (Unnamed Layer* 271) [Shuffle] with BoxPredictor_5/Reshape [10/07/2020-14:47:24] [V] [TRT] Fusing (Unnamed Layer* 288) [Shuffle] with BoxPredictor_0/Reshape_1 [10/07/2020-14:47:24] [V] [TRT] Fusing (Unnamed Layer* 296) [Shuffle] with BoxPredictor_1/Reshape_1 [10/07/2020-14:47:24] [V] [TRT] Fusing (Unnamed Layer* 304) [Shuffle] with BoxPredictor_2/Reshape_1 [10/07/2020-14:47:24] [V] [TRT] Fusing (Unnamed Layer* 312) [Shuffle] with BoxPredictor_3/Reshape_1 [10/07/2020-14:47:24] [V] [TRT] Fusing (Unnamed Layer* 320) [Shuffle] with BoxPredictor_4/Reshape_1 [10/07/2020-14:47:24] [V] [TRT] Fusing (Unnamed Layer* 328) [Shuffle] with BoxPredictor_5/Reshape_1 [10/07/2020-14:47:24] [V] [TRT] After Myelin optimization: 159 layers [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1 with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/depthwise with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/depthwise with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/depthwise with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/depthwise with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/depthwise with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/depthwise with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/depthwise with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/depthwise with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/depthwise with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/depthwise with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/depthwise with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/depthwise with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/depthwise with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/depthwise with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/depthwise with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/depthwise with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_pointwise/BatchNorm/batchnorm/mul_1 with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/depthwise with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/depthwise with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_pointwise/BatchNorm/batchnorm/mul_1 with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/depthwise with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/depthwise with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_pointwise/BatchNorm/batchnorm/mul_1 with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/depthwise with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/depthwise with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_pointwise/BatchNorm/batchnorm/mul_1 with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from BoxPredictor_0/ClassPredictor/Conv2D with scale BoxPredictor_0/ClassPredictor/BiasAdd [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/depthwise with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/depthwise with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from BoxPredictor_0/BoxEncodingPredictor/Conv2D with scale BoxPredictor_0/BoxEncodingPredictor/BiasAdd [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/depthwise with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/BatchNorm/batchnorm/mul_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/depthwise with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 with scale FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from BoxPredictor_1/ClassPredictor/Conv2D with scale BoxPredictor_1/ClassPredictor/BiasAdd [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_1 with scale FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from BoxPredictor_1/BoxEncodingPredictor/Conv2D with scale BoxPredictor_1/BoxEncodingPredictor/BiasAdd [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul_1 with scale FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from BoxPredictor_2/ClassPredictor/Conv2D with scale BoxPredictor_2/ClassPredictor/BiasAdd [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_1 with scale FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from BoxPredictor_2/BoxEncodingPredictor/Conv2D with scale BoxPredictor_2/BoxEncodingPredictor/BiasAdd [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul_1 with scale FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from BoxPredictor_3/ClassPredictor/Conv2D with scale BoxPredictor_3/ClassPredictor/BiasAdd [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_1 with scale FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from BoxPredictor_3/BoxEncodingPredictor/Conv2D with scale BoxPredictor_3/BoxEncodingPredictor/BiasAdd [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul_1 with scale FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from BoxPredictor_4/ClassPredictor/Conv2D with scale BoxPredictor_4/ClassPredictor/BiasAdd [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_1 with scale FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from BoxPredictor_4/BoxEncodingPredictor/Conv2D with scale BoxPredictor_4/BoxEncodingPredictor/BiasAdd [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/mul_1 with scale FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/add_1 [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from BoxPredictor_5/ClassPredictor/Conv2D with scale BoxPredictor_5/ClassPredictor/BiasAdd [10/07/2020-14:47:24] [V] [TRT] Fusing convolution weights from BoxPredictor_5/BoxEncodingPredictor/Conv2D with scale BoxPredictor_5/BoxEncodingPredictor/BiasAdd [10/07/2020-14:47:24] [V] [TRT] After scale fusion: 99 layers [10/07/2020-14:47:24] [V] [TRT] Fusing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1 with FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6 [10/07/2020-14:47:24] [V] [TRT] Fusing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/depthwise with FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/Relu6 [10/07/2020-14:47:24] [V] [TRT] Fusing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 with FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6 [10/07/2020-14:47:24] [V] [TRT] Fusing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/depthwise with FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/Relu6 [10/07/2020-14:47:24] [V] [TRT] Fusing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 with FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6 [10/07/2020-14:47:24] [V] [TRT] Fusing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/depthwise with FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/Relu6 [10/07/2020-14:47:24] [V] [TRT] Fusing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 with FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6 [10/07/2020-14:47:24] [V] [TRT] Fusing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/depthwise with FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/Relu6 [10/07/2020-14:47:24] [V] [TRT] Fusing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 with FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6 [10/07/2020-14:47:24] [V] [TRT] Fusing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/depthwise with FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/Relu6 [10/07/2020-14:47:24] [V] [TRT] Fusing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 with FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6 [10/07/2020-14:47:24] [V] [TRT] Fusing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/depthwise with FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/Relu6 [10/07/2020-14:47:24] [V] [TRT] Fusing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 with FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6 [10/07/2020-14:47:24] [V] [TRT] Fusing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/depthwise with FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/Relu6 [10/07/2020-14:47:24] [V] [TRT] Fusing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 with FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6 [10/07/2020-14:47:24] [V] [TRT] Fusing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/depthwise with FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/Relu6 [10/07/2020-14:47:24] [V] [TRT] Fusing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_pointwise/BatchNorm/batchnorm/mul_1 with FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_pointwise/Relu6 [10/07/2020-14:47:24] [V] [TRT] Fusing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/depthwise with FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/Relu6 [10/07/2020-14:47:24] [V] [TRT] Fusing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_pointwise/BatchNorm/batchnorm/mul_1 with FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_pointwise/Relu6 [10/07/2020-14:47:24] [V] [TRT] Fusing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/depthwise with FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/Relu6 [10/07/2020-14:47:24] [V] [TRT] Fusing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_pointwise/BatchNorm/batchnorm/mul_1 with FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_pointwise/Relu6 [10/07/2020-14:47:24] [V] [TRT] Fusing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/depthwise with FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/Relu6 [10/07/2020-14:47:24] [V] [TRT] Fusing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_pointwise/BatchNorm/batchnorm/mul_1 with FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_pointwise/Relu6 [10/07/2020-14:47:24] [V] [TRT] Fusing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/depthwise with FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/Relu6 [10/07/2020-14:47:24] [V] [TRT] Fusing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 with FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6 [10/07/2020-14:47:24] [V] [TRT] Fusing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/depthwise with FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/Relu6 [10/07/2020-14:47:24] [V] [TRT] Fusing FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 with FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 [10/07/2020-14:47:24] [V] [TRT] Fusing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_1 with FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/Relu6 [10/07/2020-14:47:24] [V] [TRT] Fusing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul_1 with FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/Relu6 [10/07/2020-14:47:24] [V] [TRT] Fusing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_1 with FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/Relu6 [10/07/2020-14:47:24] [V] [TRT] Fusing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul_1 with FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/Relu6 [10/07/2020-14:47:24] [V] [TRT] Fusing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_1 with FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/Relu6 [10/07/2020-14:47:24] [V] [TRT] Fusing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul_1 with FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/Relu6 [10/07/2020-14:47:24] [V] [TRT] Fusing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_1 with FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/Relu6 [10/07/2020-14:47:24] [V] [TRT] Fusing FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/mul_1 with FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/Relu6 [10/07/2020-14:47:24] [V] [TRT] After vertical fusions: 64 layers [10/07/2020-14:47:24] [V] [TRT] After final dead-layer removal: 64 layers [10/07/2020-14:47:24] [V] [TRT] Merging layers: BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D [10/07/2020-14:47:24] [V] [TRT] Merging layers: BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D [10/07/2020-14:47:24] [V] [TRT] Merging layers: BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D [10/07/2020-14:47:24] [V] [TRT] Merging layers: BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D [10/07/2020-14:47:24] [V] [TRT] Merging layers: BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D [10/07/2020-14:47:24] [V] [TRT] Merging layers: BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D [10/07/2020-14:47:24] [V] [TRT] After tensor merging: 58 layers [10/07/2020-14:47:24] [V] [TRT] Eliminating concatenation concat_priorbox [10/07/2020-14:47:24] [V] [TRT] Generating copy for GridAnchor to concat_priorbox [10/07/2020-14:47:24] [V] [TRT] Generating copy for GridAnchor_1 to concat_priorbox [10/07/2020-14:47:24] [V] [TRT] Generating copy for GridAnchor_2 to concat_priorbox [10/07/2020-14:47:24] [V] [TRT] Generating copy for GridAnchor_3 to concat_priorbox [10/07/2020-14:47:24] [V] [TRT] Generating copy for GridAnchor_4 to concat_priorbox [10/07/2020-14:47:24] [V] [TRT] Generating copy for GridAnchor_5 to concat_priorbox [10/07/2020-14:47:24] [V] [TRT] After concat removal: 63 layers [10/07/2020-14:47:24] [V] [TRT] Graph construction and optimization completed in 0.108932 seconds. [10/07/2020-14:47:24] [I] [TRT] [10/07/2020-14:47:24] [I] [TRT] --------------- Layers running on DLA: [10/07/2020-14:47:24] [I] [TRT] [10/07/2020-14:47:24] [I] [TRT] --------------- Layers running on GPU: [10/07/2020-14:47:24] [I] [TRT] GridAnchor, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/Relu6, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/Relu6, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/Relu6, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/Relu6, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/Relu6, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/Relu6, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/Relu6, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/Relu6, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_pointwise/Relu6, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/Relu6, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_pointwise/Relu6, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/Relu6, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_pointwise/Relu6, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/Relu6, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_pointwise/Relu6, BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/Relu6, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/Relu6, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6, BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D, FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/Relu6, FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/Relu6, BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D, FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/Relu6, FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/Relu6, BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D, FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/Relu6, FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/Relu6, BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D, FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/Relu6, FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/Relu6, BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D, (Unnamed Layer* 288) [Shuffle] + BoxPredictor_0/Reshape_1, (Unnamed Layer* 296) [Shuffle] + BoxPredictor_1/Reshape_1, (Unnamed Layer* 304) [Shuffle] + BoxPredictor_2/Reshape_1, (Unnamed Layer* 312) [Shuffle] + BoxPredictor_3/Reshape_1, (Unnamed Layer* 320) [Shuffle] + BoxPredictor_4/Reshape_1, (Unnamed Layer* 328) [Shuffle] + BoxPredictor_5/Reshape_1, (Unnamed Layer* 147) [Shuffle] + BoxPredictor_0/Reshape, (Unnamed Layer* 183) [Shuffle] + BoxPredictor_1/Reshape, (Unnamed Layer* 205) [Shuffle] + BoxPredictor_2/Reshape, (Unnamed Layer* 227) [Shuffle] + BoxPredictor_3/Reshape, (Unnamed Layer* 249) [Shuffle] + BoxPredictor_4/Reshape, (Unnamed Layer* 271) [Shuffle] + BoxPredictor_5/Reshape, Squeeze, concat_box_conf, GridAnchor copy, GridAnchor_1 copy, GridAnchor_2 copy, GridAnchor_3 copy, GridAnchor_4 copy, GridAnchor_5 copy, NMS, [10/07/2020-14:47:27] [V] [TRT] Constructing optimization profile number 0 [1/1]. [10/07/2020-14:47:27] [V] [TRT] *************** Autotuning format combination: -> Float(1,1,4332,8664), Float(1,1,2400,4800), Float(1,1,600,1200), Float(1,1,216,432), Float(1,1,96,192), Float(1,1,24,48) *************** [10/07/2020-14:47:27] [V] [TRT] *************** Autotuning format combination: Float(1,300,90000,270000) -> Float(1,150,22500,720000) *************** [10/07/2020-14:47:27] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:47:27] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [10/07/2020-14:47:27] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:47:27] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [10/07/2020-14:47:27] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:47:27] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:47:27] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:47:27] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:47:27] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6 (FusedConvActConvolution) [10/07/2020-14:47:27] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [10/07/2020-14:47:27] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6 (CaskConvolution) [10/07/2020-14:47:27] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:47:27] [V] [TRT] Tactic: 1825138533642645384 time 0.842756 [10/07/2020-14:47:27] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [10/07/2020-14:47:27] [V] [TRT] Tactic: 2842488832350522458 time 0.486392 [10/07/2020-14:47:27] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:47:27] [V] [TRT] Tactic: 3915320020053085238 time 0.834552 [10/07/2020-14:47:27] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [10/07/2020-14:47:27] [V] [TRT] Tactic: 6448355332020552203 time 1.21037 [10/07/2020-14:47:27] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:47:27] [V] [TRT] Tactic: 6808617066150061604 time 0.425984 [10/07/2020-14:47:27] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:47:27] [V] [TRT] Tactic: -8060443123034038864 time 0.433784 [10/07/2020-14:47:27] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:47:27] [V] [TRT] Tactic: -4420849921117327522 time 0.311052 [10/07/2020-14:47:27] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:47:27] [V] [TRT] Tactic: -3946921629105938337 time 0.260096 [10/07/2020-14:47:27] [V] [TRT] Fastest Tactic: -3946921629105938337 Time: 0.260096 [10/07/2020-14:47:27] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6 (CudaConvolution) [10/07/2020-14:47:28] [V] [TRT] Tactic: 0 time 1.1045 [10/07/2020-14:47:28] [V] [TRT] Tactic: 2 time 1.29614 [10/07/2020-14:47:29] [V] [TRT] Tactic: 5 time 9.40015 [10/07/2020-14:47:29] [V] [TRT] Tactic: 57 time 0.32098 [10/07/2020-14:47:29] [V] [TRT] Fastest Tactic: 57 Time: 0.32098 [10/07/2020-14:47:29] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6 (CudaDepthwiseConvolution) [10/07/2020-14:47:29] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [10/07/2020-14:47:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3946921629105938337 [10/07/2020-14:47:29] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:47:29] [V] [TRT] [10/07/2020-14:47:29] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:47:29] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [10/07/2020-14:47:29] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:47:29] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [10/07/2020-14:47:29] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:47:29] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:47:29] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:47:29] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:47:29] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:47:29] [V] [TRT] *************** Autotuning format combination: Float(1,150,22500,720000) -> Float(1,150,22500,720000) *************** [10/07/2020-14:47:29] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:47:29] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [10/07/2020-14:47:29] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:47:29] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [10/07/2020-14:47:29] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:47:29] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:47:29] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:47:29] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:47:29] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/Relu6 (FusedConvActConvolution) [10/07/2020-14:47:29] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [10/07/2020-14:47:29] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/Relu6 (CaskConvolution) [10/07/2020-14:47:29] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:47:29] [V] [TRT] Tactic: 1825138533642645384 time 6.95903 [10/07/2020-14:47:29] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [10/07/2020-14:47:29] [V] [TRT] Tactic: 2842488832350522458 time 4.1513 [10/07/2020-14:47:29] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:47:29] [V] [TRT] Tactic: 3915320020053085238 time 6.95888 [10/07/2020-14:47:29] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [10/07/2020-14:47:29] [V] [TRT] Tactic: 6448355332020552203 time 10.4411 [10/07/2020-14:47:29] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:47:29] [V] [TRT] Tactic: 6808617066150061604 time 3.44228 [10/07/2020-14:47:29] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:47:29] [V] [TRT] Tactic: -8060443123034038864 time 3.52167 [10/07/2020-14:47:29] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:47:29] [V] [TRT] Tactic: -4420849921117327522 time 2.12738 [10/07/2020-14:47:29] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:47:29] [V] [TRT] Tactic: -3946921629105938337 time 1.89177 [10/07/2020-14:47:29] [V] [TRT] Fastest Tactic: -3946921629105938337 Time: 1.89177 [10/07/2020-14:47:29] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/Relu6 (CudaConvolution) [10/07/2020-14:47:29] [V] [TRT] Tactic: 0 time 0.358212 [10/07/2020-14:47:30] [V] [TRT] Tactic: 2 time 0.35862 [10/07/2020-14:47:30] [V] [TRT] Tactic: 5 time 30.1874 [10/07/2020-14:47:30] [V] [TRT] Tactic: 6 time 4.4648 [10/07/2020-14:47:30] [V] [TRT] Tactic: 57 time 0.35792 [10/07/2020-14:47:30] [V] [TRT] Fastest Tactic: 57 Time: 0.35792 [10/07/2020-14:47:30] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/Relu6 (CudaDepthwiseConvolution) [10/07/2020-14:47:30] [V] [TRT] Tactic: -1 time 0.14206 [10/07/2020-14:47:30] [V] [TRT] Fastest Tactic: -1 Time: 0.14206 [10/07/2020-14:47:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [10/07/2020-14:47:30] [V] [TRT] [10/07/2020-14:47:30] [V] [TRT] *************** Autotuning format combination: Float(1,150,22500,720000) -> Float(1,150,22500,1440000) *************** [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:47:30] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6 (FusedConvActConvolution) [10/07/2020-14:47:30] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [10/07/2020-14:47:30] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6 (CaskConvolution) [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:47:30] [V] [TRT] Tactic: 1754569683116234317 time 0.299484 [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:47:30] [V] [TRT] Tactic: 1825138533642645384 time 0.303664 [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:47:30] [V] [TRT] Tactic: 2733356012094739613 time 0.199272 [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:47:30] [V] [TRT] Tactic: 3915320020053085238 time 0.301844 [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:47:30] [V] [TRT] Tactic: 6808617066150061604 time 0.160068 [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:47:30] [V] [TRT] Tactic: 9091006216302412844 time 0.160104 [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:47:30] [V] [TRT] Tactic: -8060443123034038864 time 0.163504 [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:47:30] [V] [TRT] Tactic: -4420849921117327522 time 0.24438 [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:47:30] [V] [TRT] Tactic: -3946921629105938337 time 0.193932 [10/07/2020-14:47:30] [V] [TRT] Fastest Tactic: 6808617066150061604 Time: 0.160068 [10/07/2020-14:47:30] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6 (CudaConvolution) [10/07/2020-14:47:30] [V] [TRT] Tactic: 0 time 0.72084 [10/07/2020-14:47:30] [V] [TRT] Tactic: 2 time 0.82884 [10/07/2020-14:47:30] [V] [TRT] Tactic: 5 time 0.979228 [10/07/2020-14:47:30] [V] [TRT] Tactic: 57 time 0.723876 [10/07/2020-14:47:30] [V] [TRT] Fastest Tactic: 0 Time: 0.72084 [10/07/2020-14:47:30] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6 (CudaDepthwiseConvolution) [10/07/2020-14:47:30] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [10/07/2020-14:47:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6808617066150061604 [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:47:30] [V] [TRT] [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:47:30] [V] [TRT] *************** Autotuning format combination: Float(1,150,22500,1440000) -> Float(1,75,5625,360000) *************** [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:47:30] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/Relu6 (FusedConvActConvolution) [10/07/2020-14:47:30] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [10/07/2020-14:47:30] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/Relu6 (CaskConvolution) [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:47:30] [V] [TRT] Tactic: 1825138533642645384 time 4.18061 [10/07/2020-14:47:30] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [10/07/2020-14:47:31] [V] [TRT] Tactic: 2842488832350522458 time 2.58884 [10/07/2020-14:47:31] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:47:31] [V] [TRT] Tactic: 3915320020053085238 time 4.16769 [10/07/2020-14:47:31] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [10/07/2020-14:47:31] [V] [TRT] Tactic: 6448355332020552203 time 5.94909 [10/07/2020-14:47:31] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:47:31] [V] [TRT] Tactic: 6808617066150061604 time 2.42287 [10/07/2020-14:47:31] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:47:31] [V] [TRT] Tactic: -8060443123034038864 time 2.46213 [10/07/2020-14:47:31] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:47:31] [V] [TRT] Tactic: -4420849921117327522 time 1.56697 [10/07/2020-14:47:31] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:47:31] [V] [TRT] Tactic: -3946921629105938337 time 1.60686 [10/07/2020-14:47:31] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 1.56697 [10/07/2020-14:47:31] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/Relu6 (CudaConvolution) [10/07/2020-14:47:31] [V] [TRT] Tactic: 0 time 0.362376 [10/07/2020-14:47:31] [V] [TRT] Tactic: 2 time 0.632164 [10/07/2020-14:47:32] [V] [TRT] Tactic: 5 time 61.7728 [10/07/2020-14:47:32] [V] [TRT] Tactic: 57 time 0.356792 [10/07/2020-14:47:32] [V] [TRT] Fastest Tactic: 57 Time: 0.356792 [10/07/2020-14:47:32] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/Relu6 (CudaDepthwiseConvolution) [10/07/2020-14:47:32] [V] [TRT] Tactic: -1 time 0.179264 [10/07/2020-14:47:32] [V] [TRT] Fastest Tactic: -1 Time: 0.179264 [10/07/2020-14:47:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [10/07/2020-14:47:32] [V] [TRT] [10/07/2020-14:47:32] [V] [TRT] *************** Autotuning format combination: Float(1,75,5625,360000) -> Float(1,75,5625,720000) *************** [10/07/2020-14:47:32] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:47:32] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:47:32] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:47:32] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:47:32] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:47:32] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:47:32] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:47:32] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:47:32] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:47:32] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6 (FusedConvActConvolution) [10/07/2020-14:47:32] [V] [TRT] Tactic: 589823 time 0.708288 [10/07/2020-14:47:32] [V] [TRT] Tactic: 655359 time 0.79018 [10/07/2020-14:47:32] [V] [TRT] Tactic: 786431 time 0.626516 [10/07/2020-14:47:32] [V] [TRT] Tactic: 851967 time 0.79734 [10/07/2020-14:47:32] [V] [TRT] Tactic: 1179647 time 0.813552 [10/07/2020-14:47:32] [V] [TRT] Tactic: 1310719 time 0.9357 [10/07/2020-14:47:32] [V] [TRT] Tactic: 1376255 time 0.783356 [10/07/2020-14:47:32] [V] [TRT] Tactic: 1441791 time 0.883108 [10/07/2020-14:47:32] [V] [TRT] Tactic: 1507327 time 0.775684 [10/07/2020-14:47:33] [V] [TRT] Tactic: 1638399 time 0.648144 [10/07/2020-14:47:33] [V] [TRT] Tactic: 1835007 time 0.642052 [10/07/2020-14:47:33] [V] [TRT] Tactic: 1900543 time 0.806552 [10/07/2020-14:47:33] [V] [TRT] Tactic: 2097151 time 0.65048 [10/07/2020-14:47:33] [V] [TRT] Tactic: 2162687 time 0.775304 [10/07/2020-14:47:33] [V] [TRT] Tactic: 2293759 time 0.790568 [10/07/2020-14:47:33] [V] [TRT] Tactic: 2359295 time 0.761368 [10/07/2020-14:47:33] [V] [TRT] Tactic: 2686975 time 0.76878 [10/07/2020-14:47:33] [V] [TRT] Tactic: 3080191 time 0.782084 [10/07/2020-14:47:33] [V] [TRT] Tactic: 3342335 time 0.789552 [10/07/2020-14:47:33] [V] [TRT] Tactic: 3407871 time 0.78756 [10/07/2020-14:47:33] [V] [TRT] Tactic: 3538943 time 0.794048 [10/07/2020-14:47:33] [V] [TRT] Tactic: 3670015 time 0.857892 [10/07/2020-14:47:33] [V] [TRT] Tactic: 3932159 time 0.80312 [10/07/2020-14:47:33] [V] [TRT] Tactic: 3997695 time 0.641092 [10/07/2020-14:47:33] [V] [TRT] Tactic: 4063231 time 0.787708 [10/07/2020-14:47:33] [V] [TRT] Tactic: 4194303 time 0.612592 [10/07/2020-14:47:33] [V] [TRT] Tactic: 4259839 time 0.649112 [10/07/2020-14:47:33] [V] [TRT] Tactic: 4325375 time 0.626604 [10/07/2020-14:47:33] [V] [TRT] Tactic: 4521983 time 0.629936 [10/07/2020-14:47:33] [V] [TRT] Tactic: 4587519 time 0.623752 [10/07/2020-14:47:33] [V] [TRT] Tactic: 4653055 time 0.78238 [10/07/2020-14:47:33] [V] [TRT] Tactic: 4915199 time 0.626024 [10/07/2020-14:47:34] [V] [TRT] Tactic: 4980735 time 0.61586 [10/07/2020-14:47:34] [V] [TRT] Tactic: 5177343 time 0.826336 [10/07/2020-14:47:34] [V] [TRT] Tactic: 5242879 time 0.793696 [10/07/2020-14:47:34] [V] [TRT] Tactic: 5373951 time 0.857848 [10/07/2020-14:47:34] [V] [TRT] Tactic: 5439487 time 0.759896 [10/07/2020-14:47:34] [V] [TRT] Tactic: 5570559 time 0.780052 [10/07/2020-14:47:34] [V] [TRT] Tactic: 5636095 time 0.785968 [10/07/2020-14:47:34] [V] [TRT] Tactic: 5701631 time 0.78606 [10/07/2020-14:47:34] [V] [TRT] Tactic: 5767167 time 1.48979 [10/07/2020-14:47:34] [V] [TRT] Tactic: 5832703 time 0.786824 [10/07/2020-14:47:34] [V] [TRT] Tactic: 5898239 time 0.790008 [10/07/2020-14:47:34] [V] [TRT] Tactic: 6029311 time 0.787768 [10/07/2020-14:47:34] [V] [TRT] Tactic: 6225919 time 0.806788 [10/07/2020-14:47:34] [V] [TRT] Tactic: 6291455 time 0.81244 [10/07/2020-14:47:34] [V] [TRT] Tactic: 6422527 time 0.793908 [10/07/2020-14:47:34] [V] [TRT] Tactic: 6750207 time 0.6823 [10/07/2020-14:47:34] [V] [TRT] Tactic: 6815743 time 0.836764 [10/07/2020-14:47:34] [V] [TRT] Tactic: 6946815 time 0.735884 [10/07/2020-14:47:34] [V] [TRT] Tactic: 7012351 time 0.652092 [10/07/2020-14:47:34] [V] [TRT] Tactic: 7077887 time 0.798612 [10/07/2020-14:47:34] [V] [TRT] Tactic: 7143423 time 0.742636 [10/07/2020-14:47:34] [V] [TRT] Tactic: 7208959 time 0.799704 [10/07/2020-14:47:35] [V] [TRT] Tactic: 7340031 time 0.802448 [10/07/2020-14:47:35] [V] [TRT] Tactic: 7405567 time 0.801556 [10/07/2020-14:47:35] [V] [TRT] Tactic: 7536639 time 0.839748 [10/07/2020-14:47:35] [V] [TRT] Tactic: 7602175 time 0.643376 [10/07/2020-14:47:35] [V] [TRT] Tactic: 7733247 time 0.787796 [10/07/2020-14:47:35] [V] [TRT] Tactic: 7798783 time 0.6263 [10/07/2020-14:47:35] [V] [TRT] Tactic: 8191999 time 0.737684 [10/07/2020-14:47:35] [V] [TRT] Tactic: 8257535 time 0.641544 [10/07/2020-14:47:35] [V] [TRT] Tactic: 8323071 time 0.663844 [10/07/2020-14:47:35] [V] [TRT] Tactic: 8650751 time 0.665952 [10/07/2020-14:47:35] [V] [TRT] Tactic: 8716287 time 0.85108 [10/07/2020-14:47:35] [V] [TRT] Tactic: 9109503 time 0.671396 [10/07/2020-14:47:35] [V] [TRT] Tactic: 9568255 time 0.626392 [10/07/2020-14:47:35] [V] [TRT] Tactic: 9895935 time 0.612052 [10/07/2020-14:47:35] [V] [TRT] Tactic: 10223615 time 0.770144 [10/07/2020-14:47:35] [V] [TRT] Tactic: 10354687 time 0.63978 [10/07/2020-14:47:35] [V] [TRT] Tactic: 10551295 time 0.652964 [10/07/2020-14:47:35] [V] [TRT] Tactic: 10747903 time 0.774476 [10/07/2020-14:47:35] [V] [TRT] Tactic: 10944511 time 0.616288 [10/07/2020-14:47:35] [V] [TRT] Fastest Tactic: 9895935 Time: 0.612052 [10/07/2020-14:47:35] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6 (CaskConvolution) [10/07/2020-14:47:35] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:47:35] [V] [TRT] Tactic: 1754569683116234317 time 0.150912 [10/07/2020-14:47:35] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:47:35] [V] [TRT] Tactic: 1825138533642645384 time 0.151776 [10/07/2020-14:47:35] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:47:35] [V] [TRT] Tactic: 2733356012094739613 time 0.165092 [10/07/2020-14:47:35] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:47:35] [V] [TRT] Tactic: 3915320020053085238 time 0.15596 [10/07/2020-14:47:35] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:47:35] [V] [TRT] Tactic: 6808617066150061604 time 0.136284 [10/07/2020-14:47:35] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:47:35] [V] [TRT] Tactic: 9091006216302412844 time 0.132408 [10/07/2020-14:47:35] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:47:35] [V] [TRT] Tactic: -8060443123034038864 time 0.13798 [10/07/2020-14:47:35] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:47:35] [V] [TRT] Tactic: -4420849921117327522 time 0.19554 [10/07/2020-14:47:35] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:47:35] [V] [TRT] Tactic: -3946921629105938337 time 0.166884 [10/07/2020-14:47:35] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.132408 [10/07/2020-14:47:35] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6 (CudaConvolution) [10/07/2020-14:47:35] [V] [TRT] Tactic: 0 time 0.420096 [10/07/2020-14:47:35] [V] [TRT] Tactic: 2 time 0.495228 [10/07/2020-14:47:35] [V] [TRT] Tactic: 5 time 0.77084 [10/07/2020-14:47:35] [V] [TRT] Tactic: 57 time 0.422188 [10/07/2020-14:47:35] [V] [TRT] Fastest Tactic: 0 Time: 0.420096 [10/07/2020-14:47:35] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6 (CudaDepthwiseConvolution) [10/07/2020-14:47:35] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [10/07/2020-14:47:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [10/07/2020-14:47:35] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:47:35] [V] [TRT] [10/07/2020-14:47:35] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:47:35] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:47:35] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:47:35] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:47:35] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:47:35] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:47:35] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:47:35] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:47:35] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:47:35] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:47:35] [V] [TRT] *************** Autotuning format combination: Float(1,75,5625,720000) -> Float(1,75,5625,720000) *************** [10/07/2020-14:47:35] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:47:35] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [10/07/2020-14:47:35] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:47:35] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [10/07/2020-14:47:35] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:47:35] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:47:35] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:47:35] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:47:35] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/Relu6 (FusedConvActConvolution) [10/07/2020-14:47:35] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [10/07/2020-14:47:35] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/Relu6 (CaskConvolution) [10/07/2020-14:47:35] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:47:36] [V] [TRT] Tactic: 1825138533642645384 time 8.34496 [10/07/2020-14:47:36] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [10/07/2020-14:47:36] [V] [TRT] Tactic: 2842488832350522458 time 5.13558 [10/07/2020-14:47:36] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:47:36] [V] [TRT] Tactic: 3915320020053085238 time 8.2854 [10/07/2020-14:47:36] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [10/07/2020-14:47:36] [V] [TRT] Tactic: 6448355332020552203 time 11.8165 [10/07/2020-14:47:36] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:47:36] [V] [TRT] Tactic: 6808617066150061604 time 4.80726 [10/07/2020-14:47:36] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:47:36] [V] [TRT] Tactic: -8060443123034038864 time 4.8722 [10/07/2020-14:47:36] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:47:36] [V] [TRT] Tactic: -4420849921117327522 time 3.06704 [10/07/2020-14:47:36] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:47:37] [V] [TRT] Tactic: -3946921629105938337 time 3.14668 [10/07/2020-14:47:37] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 3.06704 [10/07/2020-14:47:37] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/Relu6 (CudaConvolution) [10/07/2020-14:47:37] [V] [TRT] Tactic: 0 time 0.357456 [10/07/2020-14:47:37] [V] [TRT] Tactic: 2 time 0.358008 [10/07/2020-14:47:37] [V] [TRT] Tactic: 5 time 46.2499 [10/07/2020-14:47:37] [V] [TRT] Tactic: 6 time 4.73775 [10/07/2020-14:47:37] [V] [TRT] Tactic: 57 time 0.358624 [10/07/2020-14:47:37] [V] [TRT] Fastest Tactic: 0 Time: 0.357456 [10/07/2020-14:47:37] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/Relu6 (CudaDepthwiseConvolution) [10/07/2020-14:47:37] [V] [TRT] Tactic: -1 time 0.148428 [10/07/2020-14:47:37] [V] [TRT] Fastest Tactic: -1 Time: 0.148428 [10/07/2020-14:47:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [10/07/2020-14:47:37] [V] [TRT] [10/07/2020-14:47:37] [V] [TRT] *************** Autotuning format combination: Float(1,75,5625,720000) -> Float(1,75,5625,720000) *************** [10/07/2020-14:47:37] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:47:37] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:47:37] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:47:37] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:47:37] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:47:37] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:47:37] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:47:37] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:47:37] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:47:37] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6 (FusedConvActConvolution) [10/07/2020-14:47:38] [V] [TRT] Tactic: 589823 time 0.91596 [10/07/2020-14:47:38] [V] [TRT] Tactic: 655359 time 0.892372 [10/07/2020-14:47:38] [V] [TRT] Tactic: 786431 time 0.742912 [10/07/2020-14:47:38] [V] [TRT] Tactic: 851967 time 0.877692 [10/07/2020-14:47:38] [V] [TRT] Tactic: 1179647 time 0.909868 [10/07/2020-14:47:38] [V] [TRT] Tactic: 1310719 time 1.40475 [10/07/2020-14:47:38] [V] [TRT] Tactic: 1376255 time 0.904292 [10/07/2020-14:47:38] [V] [TRT] Tactic: 1441791 time 1.06781 [10/07/2020-14:47:38] [V] [TRT] Tactic: 1507327 time 0.8452 [10/07/2020-14:47:38] [V] [TRT] Tactic: 1638399 time 0.798404 [10/07/2020-14:47:38] [V] [TRT] Tactic: 1835007 time 0.786948 [10/07/2020-14:47:38] [V] [TRT] Tactic: 1900543 time 0.961136 [10/07/2020-14:47:38] [V] [TRT] Tactic: 2097151 time 0.795276 [10/07/2020-14:47:38] [V] [TRT] Tactic: 2162687 time 0.87832 [10/07/2020-14:47:38] [V] [TRT] Tactic: 2293759 time 0.910148 [10/07/2020-14:47:38] [V] [TRT] Tactic: 2359295 time 0.82552 [10/07/2020-14:47:38] [V] [TRT] Tactic: 2686975 time 0.854704 [10/07/2020-14:47:38] [V] [TRT] Tactic: 3080191 time 0.871212 [10/07/2020-14:47:38] [V] [TRT] Tactic: 3342335 time 0.899264 [10/07/2020-14:47:38] [V] [TRT] Tactic: 3407871 time 0.874904 [10/07/2020-14:47:39] [V] [TRT] Tactic: 3538943 time 0.879844 [10/07/2020-14:47:39] [V] [TRT] Tactic: 3670015 time 0.988692 [10/07/2020-14:47:39] [V] [TRT] Tactic: 3932159 time 0.898732 [10/07/2020-14:47:39] [V] [TRT] Tactic: 3997695 time 0.775276 [10/07/2020-14:47:39] [V] [TRT] Tactic: 4063231 time 0.862004 [10/07/2020-14:47:39] [V] [TRT] Tactic: 4194303 time 0.712504 [10/07/2020-14:47:39] [V] [TRT] Tactic: 4259839 time 0.790656 [10/07/2020-14:47:39] [V] [TRT] Tactic: 4325375 time 0.734744 [10/07/2020-14:47:39] [V] [TRT] Tactic: 4521983 time 0.763016 [10/07/2020-14:47:39] [V] [TRT] Tactic: 4587519 time 0.72428 [10/07/2020-14:47:39] [V] [TRT] Tactic: 4653055 time 0.848296 [10/07/2020-14:47:39] [V] [TRT] Tactic: 4915199 time 0.725916 [10/07/2020-14:47:39] [V] [TRT] Tactic: 4980735 time 0.73054 [10/07/2020-14:47:39] [V] [TRT] Tactic: 5177343 time 0.945744 [10/07/2020-14:47:39] [V] [TRT] Tactic: 5242879 time 0.892204 [10/07/2020-14:47:39] [V] [TRT] Tactic: 5373951 time 1.08954 [10/07/2020-14:47:39] [V] [TRT] Tactic: 5439487 time 1.21776 [10/07/2020-14:47:39] [V] [TRT] Tactic: 5570559 time 0.878292 [10/07/2020-14:47:39] [V] [TRT] Tactic: 5636095 time 0.862472 [10/07/2020-14:47:39] [V] [TRT] Tactic: 5701631 time 0.903304 [10/07/2020-14:47:40] [V] [TRT] Tactic: 5767167 time 3.78601 [10/07/2020-14:47:40] [V] [TRT] Tactic: 5832703 time 0.880436 [10/07/2020-14:47:40] [V] [TRT] Tactic: 5898239 time 0.86382 [10/07/2020-14:47:40] [V] [TRT] Tactic: 6029311 time 0.895548 [10/07/2020-14:47:40] [V] [TRT] Tactic: 6225919 time 0.909712 [10/07/2020-14:47:40] [V] [TRT] Tactic: 6291455 time 0.907292 [10/07/2020-14:47:40] [V] [TRT] Tactic: 6422527 time 0.882888 [10/07/2020-14:47:40] [V] [TRT] Tactic: 6750207 time 0.8753 [10/07/2020-14:47:40] [V] [TRT] Tactic: 6815743 time 1.05616 [10/07/2020-14:47:40] [V] [TRT] Tactic: 6946815 time 1.1492 [10/07/2020-14:47:40] [V] [TRT] Tactic: 7012351 time 0.794376 [10/07/2020-14:47:40] [V] [TRT] Tactic: 7077887 time 0.890576 [10/07/2020-14:47:40] [V] [TRT] Tactic: 7143423 time 1.10151 [10/07/2020-14:47:40] [V] [TRT] Tactic: 7208959 time 0.921208 [10/07/2020-14:47:40] [V] [TRT] Tactic: 7340031 time 0.885256 [10/07/2020-14:47:40] [V] [TRT] Tactic: 7405567 time 0.884924 [10/07/2020-14:47:40] [V] [TRT] Tactic: 7536639 time 1.03045 [10/07/2020-14:47:41] [V] [TRT] Tactic: 7602175 time 0.789632 [10/07/2020-14:47:41] [V] [TRT] Tactic: 7733247 time 0.861324 [10/07/2020-14:47:41] [V] [TRT] Tactic: 7798783 time 0.749292 [10/07/2020-14:47:41] [V] [TRT] Tactic: 8191999 time 1.08097 [10/07/2020-14:47:41] [V] [TRT] Tactic: 8257535 time 0.784524 [10/07/2020-14:47:41] [V] [TRT] Tactic: 8323071 time 0.837956 [10/07/2020-14:47:41] [V] [TRT] Tactic: 8650751 time 0.865744 [10/07/2020-14:47:41] [V] [TRT] Tactic: 8716287 time 1.07042 [10/07/2020-14:47:41] [V] [TRT] Tactic: 9109503 time 0.852744 [10/07/2020-14:47:41] [V] [TRT] Tactic: 9568255 time 0.725752 [10/07/2020-14:47:41] [V] [TRT] Tactic: 9895935 time 0.709684 [10/07/2020-14:47:41] [V] [TRT] Tactic: 10223615 time 0.854108 [10/07/2020-14:47:41] [V] [TRT] Tactic: 10354687 time 0.77148 [10/07/2020-14:47:41] [V] [TRT] Tactic: 10551295 time 0.822888 [10/07/2020-14:47:41] [V] [TRT] Tactic: 10747903 time 0.844044 [10/07/2020-14:47:41] [V] [TRT] Tactic: 10944511 time 0.730676 [10/07/2020-14:47:41] [V] [TRT] Fastest Tactic: 9895935 Time: 0.709684 [10/07/2020-14:47:41] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6 (CaskConvolution) [10/07/2020-14:47:41] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:47:41] [V] [TRT] Tactic: 1754569683116234317 time 0.257508 [10/07/2020-14:47:41] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:47:41] [V] [TRT] Tactic: 1825138533642645384 time 0.255876 [10/07/2020-14:47:41] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:47:41] [V] [TRT] Tactic: 2733356012094739613 time 0.279624 [10/07/2020-14:47:41] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:47:41] [V] [TRT] Tactic: 3915320020053085238 time 0.25452 [10/07/2020-14:47:41] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:47:41] [V] [TRT] Tactic: 6808617066150061604 time 0.242384 [10/07/2020-14:47:41] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:47:41] [V] [TRT] Tactic: 9091006216302412844 time 0.234656 [10/07/2020-14:47:41] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:47:41] [V] [TRT] Tactic: -8060443123034038864 time 0.24282 [10/07/2020-14:47:41] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:47:41] [V] [TRT] Tactic: -4420849921117327522 time 0.319676 [10/07/2020-14:47:41] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:47:41] [V] [TRT] Tactic: -3946921629105938337 time 0.2879 [10/07/2020-14:47:41] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.234656 [10/07/2020-14:47:41] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6 (CudaConvolution) [10/07/2020-14:47:41] [V] [TRT] Tactic: 0 time 0.542588 [10/07/2020-14:47:41] [V] [TRT] Tactic: 2 time 0.666456 [10/07/2020-14:47:41] [V] [TRT] Tactic: 5 time 1.16048 [10/07/2020-14:47:41] [V] [TRT] Tactic: 57 time 0.543004 [10/07/2020-14:47:41] [V] [TRT] Fastest Tactic: 0 Time: 0.542588 [10/07/2020-14:47:41] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6 (CudaDepthwiseConvolution) [10/07/2020-14:47:41] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [10/07/2020-14:47:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [10/07/2020-14:47:41] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:47:41] [V] [TRT] [10/07/2020-14:47:41] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:47:41] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:47:41] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:47:41] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:47:41] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:47:41] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:47:41] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:47:41] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:47:41] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:47:41] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:47:41] [V] [TRT] *************** Autotuning format combination: Float(1,75,5625,720000) -> Float(1,38,1444,184832) *************** [10/07/2020-14:47:41] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:47:41] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [10/07/2020-14:47:41] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:47:41] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [10/07/2020-14:47:41] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:47:41] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:47:41] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:47:41] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:47:41] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/Relu6 (FusedConvActConvolution) [10/07/2020-14:47:41] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [10/07/2020-14:47:41] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/Relu6 (CaskConvolution) [10/07/2020-14:47:41] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:47:42] [V] [TRT] Tactic: 1825138533642645384 time 3.41483 [10/07/2020-14:47:42] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [10/07/2020-14:47:42] [V] [TRT] Tactic: 2842488832350522458 time 2.45407 [10/07/2020-14:47:42] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:47:42] [V] [TRT] Tactic: 3915320020053085238 time 3.38658 [10/07/2020-14:47:42] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [10/07/2020-14:47:42] [V] [TRT] Tactic: 6448355332020552203 time 4.34538 [10/07/2020-14:47:42] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:47:42] [V] [TRT] Tactic: 6808617066150061604 time 2.56531 [10/07/2020-14:47:42] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:47:42] [V] [TRT] Tactic: -8060443123034038864 time 2.59617 [10/07/2020-14:47:42] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:47:42] [V] [TRT] Tactic: -4420849921117327522 time 1.73433 [10/07/2020-14:47:42] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:47:42] [V] [TRT] Tactic: -3946921629105938337 time 2.27456 [10/07/2020-14:47:42] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 1.73433 [10/07/2020-14:47:42] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/Relu6 (CudaConvolution) [10/07/2020-14:47:42] [V] [TRT] Tactic: 0 time 0.112784 [10/07/2020-14:47:42] [V] [TRT] Tactic: 2 time 0.112888 [10/07/2020-14:47:43] [V] [TRT] Tactic: 5 time 46.1439 [10/07/2020-14:47:43] [V] [TRT] Tactic: 57 time 0.112808 [10/07/2020-14:47:43] [V] [TRT] Fastest Tactic: 0 Time: 0.112784 [10/07/2020-14:47:43] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/Relu6 (CudaDepthwiseConvolution) [10/07/2020-14:47:43] [V] [TRT] Tactic: -1 time 0.103696 [10/07/2020-14:47:43] [V] [TRT] Fastest Tactic: -1 Time: 0.103696 [10/07/2020-14:47:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [10/07/2020-14:47:43] [V] [TRT] [10/07/2020-14:47:43] [V] [TRT] *************** Autotuning format combination: Float(1,38,1444,184832) -> Float(1,38,1444,369664) *************** [10/07/2020-14:47:43] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:47:43] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:47:43] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:47:43] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:47:43] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:47:43] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:47:43] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:47:43] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:47:43] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:47:43] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6 (FusedConvActConvolution) [10/07/2020-14:47:43] [V] [TRT] Tactic: 589823 time 0.45206 [10/07/2020-14:47:43] [V] [TRT] Tactic: 655359 time 0.398804 [10/07/2020-14:47:43] [V] [TRT] Tactic: 786431 time 0.36206 [10/07/2020-14:47:43] [V] [TRT] Tactic: 851967 time 0.40342 [10/07/2020-14:47:43] [V] [TRT] Tactic: 1179647 time 0.370416 [10/07/2020-14:47:43] [V] [TRT] Tactic: 1310719 time 0.659496 [10/07/2020-14:47:43] [V] [TRT] Tactic: 1376255 time 0.416216 [10/07/2020-14:47:43] [V] [TRT] Tactic: 1441791 time 0.54208 [10/07/2020-14:47:43] [V] [TRT] Tactic: 1507327 time 0.384144 [10/07/2020-14:47:43] [V] [TRT] Tactic: 1638399 time 0.387824 [10/07/2020-14:47:43] [V] [TRT] Tactic: 1835007 time 0.374128 [10/07/2020-14:47:43] [V] [TRT] Tactic: 1900543 time 0.424728 [10/07/2020-14:47:43] [V] [TRT] Tactic: 2097151 time 0.420476 [10/07/2020-14:47:43] [V] [TRT] Tactic: 2162687 time 0.370808 [10/07/2020-14:47:43] [V] [TRT] Tactic: 2293759 time 0.406848 [10/07/2020-14:47:43] [V] [TRT] Tactic: 2359295 time 0.335912 [10/07/2020-14:47:43] [V] [TRT] Tactic: 2686975 time 0.367268 [10/07/2020-14:47:43] [V] [TRT] Tactic: 3080191 time 0.380292 [10/07/2020-14:47:43] [V] [TRT] Tactic: 3342335 time 0.396276 [10/07/2020-14:47:43] [V] [TRT] Tactic: 3407871 time 0.35514 [10/07/2020-14:47:44] [V] [TRT] Tactic: 3538943 time 0.354832 [10/07/2020-14:47:44] [V] [TRT] Tactic: 3670015 time 0.388168 [10/07/2020-14:47:44] [V] [TRT] Tactic: 3932159 time 0.378564 [10/07/2020-14:47:44] [V] [TRT] Tactic: 3997695 time 0.378352 [10/07/2020-14:47:44] [V] [TRT] Tactic: 4063231 time 0.384896 [10/07/2020-14:47:44] [V] [TRT] Tactic: 4194303 time 0.341792 [10/07/2020-14:47:44] [V] [TRT] Tactic: 4259839 time 0.387912 [10/07/2020-14:47:44] [V] [TRT] Tactic: 4325375 time 0.346976 [10/07/2020-14:47:44] [V] [TRT] Tactic: 4521983 time 0.405472 [10/07/2020-14:47:44] [V] [TRT] Tactic: 4587519 time 0.344952 [10/07/2020-14:47:44] [V] [TRT] Tactic: 4653055 time 0.338784 [10/07/2020-14:47:44] [V] [TRT] Tactic: 4915199 time 0.348988 [10/07/2020-14:47:44] [V] [TRT] Tactic: 4980735 time 0.358628 [10/07/2020-14:47:44] [V] [TRT] Tactic: 5177343 time 0.410808 [10/07/2020-14:47:44] [V] [TRT] Tactic: 5242879 time 0.348536 [10/07/2020-14:47:44] [V] [TRT] Tactic: 5373951 time 0.490868 [10/07/2020-14:47:44] [V] [TRT] Tactic: 5439487 time 0.553752 [10/07/2020-14:47:44] [V] [TRT] Tactic: 5570559 time 0.391748 [10/07/2020-14:47:44] [V] [TRT] Tactic: 5636095 time 0.383492 [10/07/2020-14:47:44] [V] [TRT] Tactic: 5701631 time 0.380788 [10/07/2020-14:47:44] [V] [TRT] Tactic: 5767167 time 1.3486 [10/07/2020-14:47:44] [V] [TRT] Tactic: 5832703 time 0.346916 [10/07/2020-14:47:44] [V] [TRT] Tactic: 5898239 time 0.375764 [10/07/2020-14:47:44] [V] [TRT] Tactic: 6029311 time 0.370476 [10/07/2020-14:47:44] [V] [TRT] Tactic: 6225919 time 0.361428 [10/07/2020-14:47:44] [V] [TRT] Tactic: 6291455 time 0.366436 [10/07/2020-14:47:44] [V] [TRT] Tactic: 6422527 time 0.375284 [10/07/2020-14:47:44] [V] [TRT] Tactic: 6750207 time 0.419948 [10/07/2020-14:47:44] [V] [TRT] Tactic: 6815743 time 0.426404 [10/07/2020-14:47:44] [V] [TRT] Tactic: 6946815 time 0.507832 [10/07/2020-14:47:44] [V] [TRT] Tactic: 7012351 time 0.41618 [10/07/2020-14:47:44] [V] [TRT] Tactic: 7077887 time 0.34902 [10/07/2020-14:47:45] [V] [TRT] Tactic: 7143423 time 0.543156 [10/07/2020-14:47:45] [V] [TRT] Tactic: 7208959 time 0.373008 [10/07/2020-14:47:45] [V] [TRT] Tactic: 7340031 time 0.386392 [10/07/2020-14:47:45] [V] [TRT] Tactic: 7405567 time 0.365364 [10/07/2020-14:47:45] [V] [TRT] Tactic: 7536639 time 0.428596 [10/07/2020-14:47:45] [V] [TRT] Tactic: 7602175 time 0.360964 [10/07/2020-14:47:45] [V] [TRT] Tactic: 7733247 time 0.358168 [10/07/2020-14:47:45] [V] [TRT] Tactic: 7798783 time 0.360212 [10/07/2020-14:47:45] [V] [TRT] Tactic: 8191999 time 0.488344 [10/07/2020-14:47:45] [V] [TRT] Tactic: 8257535 time 0.394316 [10/07/2020-14:47:45] [V] [TRT] Tactic: 8323071 time 0.402084 [10/07/2020-14:47:45] [V] [TRT] Tactic: 8650751 time 0.408152 [10/07/2020-14:47:45] [V] [TRT] Tactic: 8716287 time 0.473528 [10/07/2020-14:47:45] [V] [TRT] Tactic: 9109503 time 0.436368 [10/07/2020-14:47:45] [V] [TRT] Tactic: 9568255 time 0.350508 [10/07/2020-14:47:45] [V] [TRT] Tactic: 9895935 time 0.342204 [10/07/2020-14:47:45] [V] [TRT] Tactic: 10223615 time 0.36862 [10/07/2020-14:47:45] [V] [TRT] Tactic: 10354687 time 0.373808 [10/07/2020-14:47:45] [V] [TRT] Tactic: 10551295 time 0.407256 [10/07/2020-14:47:45] [V] [TRT] Tactic: 10747903 time 0.337548 [10/07/2020-14:47:45] [V] [TRT] Tactic: 10944511 time 0.358632 [10/07/2020-14:47:45] [V] [TRT] Fastest Tactic: 2359295 Time: 0.335912 [10/07/2020-14:47:45] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6 (CaskConvolution) [10/07/2020-14:47:45] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:47:45] [V] [TRT] Tactic: 1754569683116234317 time 0.145388 [10/07/2020-14:47:45] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:47:45] [V] [TRT] Tactic: 1825138533642645384 time 0.136644 [10/07/2020-14:47:45] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:47:45] [V] [TRT] Tactic: 2733356012094739613 time 0.152224 [10/07/2020-14:47:45] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:47:45] [V] [TRT] Tactic: 3915320020053085238 time 0.135764 [10/07/2020-14:47:45] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:47:45] [V] [TRT] Tactic: 6808617066150061604 time 0.138576 [10/07/2020-14:47:45] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:47:45] [V] [TRT] Tactic: 9091006216302412844 time 0.133684 [10/07/2020-14:47:45] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:47:45] [V] [TRT] Tactic: -8060443123034038864 time 0.139176 [10/07/2020-14:47:45] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:47:45] [V] [TRT] Tactic: -4420849921117327522 time 0.161676 [10/07/2020-14:47:45] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:47:45] [V] [TRT] Tactic: -3946921629105938337 time 0.160732 [10/07/2020-14:47:45] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.133684 [10/07/2020-14:47:45] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6 (CudaConvolution) [10/07/2020-14:47:45] [V] [TRT] Tactic: 0 time 0.303944 [10/07/2020-14:47:45] [V] [TRT] Tactic: 2 time 0.408776 [10/07/2020-14:47:45] [V] [TRT] Tactic: 5 time 0.92358 [10/07/2020-14:47:45] [V] [TRT] Tactic: 57 time 0.30822 [10/07/2020-14:47:45] [V] [TRT] Fastest Tactic: 0 Time: 0.303944 [10/07/2020-14:47:45] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6 (CudaDepthwiseConvolution) [10/07/2020-14:47:45] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [10/07/2020-14:47:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [10/07/2020-14:47:45] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:47:45] [V] [TRT] [10/07/2020-14:47:45] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:47:45] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:47:45] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:47:45] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:47:45] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:47:45] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:47:45] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:47:45] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:47:45] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:47:45] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:47:45] [V] [TRT] *************** Autotuning format combination: Float(1,38,1444,369664) -> Float(1,38,1444,369664) *************** [10/07/2020-14:47:45] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:47:45] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [10/07/2020-14:47:45] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:47:45] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [10/07/2020-14:47:45] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:47:45] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:47:45] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:47:45] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:47:45] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/Relu6 (FusedConvActConvolution) [10/07/2020-14:47:45] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [10/07/2020-14:47:45] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/Relu6 (CaskConvolution) [10/07/2020-14:47:45] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:47:45] [V] [TRT] Tactic: 1825138533642645384 time 6.78189 [10/07/2020-14:47:45] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [10/07/2020-14:47:46] [V] [TRT] Tactic: 2842488832350522458 time 4.85072 [10/07/2020-14:47:46] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:47:46] [V] [TRT] Tactic: 3915320020053085238 time 6.72705 [10/07/2020-14:47:46] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [10/07/2020-14:47:46] [V] [TRT] Tactic: 6448355332020552203 time 8.65816 [10/07/2020-14:47:46] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:47:46] [V] [TRT] Tactic: 6808617066150061604 time 5.02773 [10/07/2020-14:47:46] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:47:46] [V] [TRT] Tactic: -8060443123034038864 time 5.11743 [10/07/2020-14:47:46] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:47:46] [V] [TRT] Tactic: -4420849921117327522 time 3.40663 [10/07/2020-14:47:46] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:47:46] [V] [TRT] Tactic: -3946921629105938337 time 4.44882 [10/07/2020-14:47:46] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 3.40663 [10/07/2020-14:47:46] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/Relu6 (CudaConvolution) [10/07/2020-14:47:46] [V] [TRT] Tactic: 0 time 0.198556 [10/07/2020-14:47:46] [V] [TRT] Tactic: 2 time 0.198532 [10/07/2020-14:47:47] [V] [TRT] Tactic: 5 time 39.9352 [10/07/2020-14:47:47] [V] [TRT] Tactic: 6 time 3.42868 [10/07/2020-14:47:47] [V] [TRT] Tactic: 57 time 0.198832 [10/07/2020-14:47:47] [V] [TRT] Fastest Tactic: 2 Time: 0.198532 [10/07/2020-14:47:47] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/Relu6 (CudaDepthwiseConvolution) [10/07/2020-14:47:47] [V] [TRT] Tactic: -1 time 0.081964 [10/07/2020-14:47:47] [V] [TRT] Fastest Tactic: -1 Time: 0.081964 [10/07/2020-14:47:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [10/07/2020-14:47:47] [V] [TRT] [10/07/2020-14:47:47] [V] [TRT] *************** Autotuning format combination: Float(1,38,1444,369664) -> Float(1,38,1444,369664) *************** [10/07/2020-14:47:47] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:47:47] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:47:47] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:47:47] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:47:47] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:47:47] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:47:47] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:47:47] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:47:47] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:47:47] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6 (FusedConvActConvolution) [10/07/2020-14:47:47] [V] [TRT] Tactic: 589823 time 0.654 [10/07/2020-14:47:47] [V] [TRT] Tactic: 655359 time 0.616296 [10/07/2020-14:47:47] [V] [TRT] Tactic: 786431 time 0.567752 [10/07/2020-14:47:47] [V] [TRT] Tactic: 851967 time 0.614752 [10/07/2020-14:47:47] [V] [TRT] Tactic: 1179647 time 0.570544 [10/07/2020-14:47:48] [V] [TRT] Tactic: 1310719 time 1.12981 [10/07/2020-14:47:48] [V] [TRT] Tactic: 1376255 time 0.626832 [10/07/2020-14:47:48] [V] [TRT] Tactic: 1441791 time 0.795268 [10/07/2020-14:47:48] [V] [TRT] Tactic: 1507327 time 0.57724 [10/07/2020-14:47:48] [V] [TRT] Tactic: 1638399 time 0.57632 [10/07/2020-14:47:48] [V] [TRT] Tactic: 1835007 time 0.636948 [10/07/2020-14:47:48] [V] [TRT] Tactic: 1900543 time 0.637728 [10/07/2020-14:47:48] [V] [TRT] Tactic: 2097151 time 0.641524 [10/07/2020-14:47:48] [V] [TRT] Tactic: 2162687 time 0.52192 [10/07/2020-14:47:48] [V] [TRT] Tactic: 2293759 time 0.59208 [10/07/2020-14:47:48] [V] [TRT] Tactic: 2359295 time 0.4764 [10/07/2020-14:47:48] [V] [TRT] Tactic: 2686975 time 0.509892 [10/07/2020-14:47:48] [V] [TRT] Tactic: 3080191 time 0.552784 [10/07/2020-14:47:48] [V] [TRT] Tactic: 3342335 time 0.577388 [10/07/2020-14:47:48] [V] [TRT] Tactic: 3407871 time 0.535216 [10/07/2020-14:47:48] [V] [TRT] Tactic: 3538943 time 0.542588 [10/07/2020-14:47:48] [V] [TRT] Tactic: 3670015 time 0.522948 [10/07/2020-14:47:48] [V] [TRT] Tactic: 3932159 time 0.563216 [10/07/2020-14:47:48] [V] [TRT] Tactic: 3997695 time 0.640616 [10/07/2020-14:47:48] [V] [TRT] Tactic: 4063231 time 0.57358 [10/07/2020-14:47:48] [V] [TRT] Tactic: 4194303 time 0.491352 [10/07/2020-14:47:48] [V] [TRT] Tactic: 4259839 time 0.56068 [10/07/2020-14:47:48] [V] [TRT] Tactic: 4325375 time 0.506172 [10/07/2020-14:47:48] [V] [TRT] Tactic: 4521983 time 0.590928 [10/07/2020-14:47:48] [V] [TRT] Tactic: 4587519 time 0.515772 [10/07/2020-14:47:48] [V] [TRT] Tactic: 4653055 time 0.486564 [10/07/2020-14:47:49] [V] [TRT] Tactic: 4915199 time 0.538404 [10/07/2020-14:47:49] [V] [TRT] Tactic: 4980735 time 0.51 [10/07/2020-14:47:49] [V] [TRT] Tactic: 5177343 time 0.682832 [10/07/2020-14:47:49] [V] [TRT] Tactic: 5242879 time 0.548268 [10/07/2020-14:47:49] [V] [TRT] Tactic: 5373951 time 0.875108 [10/07/2020-14:47:49] [V] [TRT] Tactic: 5439487 time 1.21995 [10/07/2020-14:47:49] [V] [TRT] Tactic: 5570559 time 0.578344 [10/07/2020-14:47:49] [V] [TRT] Tactic: 5636095 time 0.57424 [10/07/2020-14:47:49] [V] [TRT] Tactic: 5701631 time 0.537024 [10/07/2020-14:47:49] [V] [TRT] Tactic: 5767167 time 3.58852 [10/07/2020-14:47:49] [V] [TRT] Tactic: 5832703 time 0.509808 [10/07/2020-14:47:49] [V] [TRT] Tactic: 5898239 time 0.552948 [10/07/2020-14:47:49] [V] [TRT] Tactic: 6029311 time 0.563988 [10/07/2020-14:47:49] [V] [TRT] Tactic: 6225919 time 0.59282 [10/07/2020-14:47:49] [V] [TRT] Tactic: 6291455 time 0.563332 [10/07/2020-14:47:49] [V] [TRT] Tactic: 6422527 time 0.562948 [10/07/2020-14:47:49] [V] [TRT] Tactic: 6750207 time 0.806356 [10/07/2020-14:47:49] [V] [TRT] Tactic: 6815743 time 0.683344 [10/07/2020-14:47:49] [V] [TRT] Tactic: 6946815 time 1.09198 [10/07/2020-14:47:49] [V] [TRT] Tactic: 7012351 time 0.636872 [10/07/2020-14:47:49] [V] [TRT] Tactic: 7077887 time 0.527108 [10/07/2020-14:47:50] [V] [TRT] Tactic: 7143423 time 1.05064 [10/07/2020-14:47:50] [V] [TRT] Tactic: 7208959 time 0.571204 [10/07/2020-14:47:50] [V] [TRT] Tactic: 7340031 time 0.578656 [10/07/2020-14:47:50] [V] [TRT] Tactic: 7405567 time 0.556892 [10/07/2020-14:47:50] [V] [TRT] Tactic: 7536639 time 0.66102 [10/07/2020-14:47:50] [V] [TRT] Tactic: 7602175 time 0.564264 [10/07/2020-14:47:50] [V] [TRT] Tactic: 7733247 time 0.53526 [10/07/2020-14:47:50] [V] [TRT] Tactic: 7798783 time 0.569948 [10/07/2020-14:47:50] [V] [TRT] Tactic: 8191999 time 1.06058 [10/07/2020-14:47:50] [V] [TRT] Tactic: 8257535 time 0.644688 [10/07/2020-14:47:50] [V] [TRT] Tactic: 8323071 time 0.672664 [10/07/2020-14:47:50] [V] [TRT] Tactic: 8650751 time 0.75142 [10/07/2020-14:47:50] [V] [TRT] Tactic: 8716287 time 0.889624 [10/07/2020-14:47:50] [V] [TRT] Tactic: 9109503 time 0.71762 [10/07/2020-14:47:50] [V] [TRT] Tactic: 9568255 time 0.54016 [10/07/2020-14:47:50] [V] [TRT] Tactic: 9895935 time 0.492656 [10/07/2020-14:47:50] [V] [TRT] Tactic: 10223615 time 0.509812 [10/07/2020-14:47:50] [V] [TRT] Tactic: 10354687 time 0.549512 [10/07/2020-14:47:50] [V] [TRT] Tactic: 10551295 time 0.644748 [10/07/2020-14:47:50] [V] [TRT] Tactic: 10747903 time 0.493248 [10/07/2020-14:47:50] [V] [TRT] Tactic: 10944511 time 0.509212 [10/07/2020-14:47:50] [V] [TRT] Fastest Tactic: 2359295 Time: 0.4764 [10/07/2020-14:47:50] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6 (CaskConvolution) [10/07/2020-14:47:50] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:47:50] [V] [TRT] Tactic: 1754569683116234317 time 0.318332 [10/07/2020-14:47:50] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:47:50] [V] [TRT] Tactic: 1825138533642645384 time 0.320396 [10/07/2020-14:47:50] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:47:50] [V] [TRT] Tactic: 2733356012094739613 time 0.279156 [10/07/2020-14:47:50] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:47:50] [V] [TRT] Tactic: 3915320020053085238 time 0.328188 [10/07/2020-14:47:50] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:47:50] [V] [TRT] Tactic: 6808617066150061604 time 0.251748 [10/07/2020-14:47:50] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:47:50] [V] [TRT] Tactic: 9091006216302412844 time 0.248692 [10/07/2020-14:47:50] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:47:50] [V] [TRT] Tactic: -8060443123034038864 time 0.25324 [10/07/2020-14:47:50] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:47:50] [V] [TRT] Tactic: -4420849921117327522 time 0.284716 [10/07/2020-14:47:50] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:47:50] [V] [TRT] Tactic: -3946921629105938337 time 0.28458 [10/07/2020-14:47:50] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.248692 [10/07/2020-14:47:50] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6 (CudaConvolution) [10/07/2020-14:47:50] [V] [TRT] Tactic: 0 time 0.465932 [10/07/2020-14:47:50] [V] [TRT] Tactic: 2 time 0.65406 [10/07/2020-14:47:50] [V] [TRT] Tactic: 5 time 1.65138 [10/07/2020-14:47:51] [V] [TRT] Tactic: 57 time 0.473496 [10/07/2020-14:47:51] [V] [TRT] Fastest Tactic: 0 Time: 0.465932 [10/07/2020-14:47:51] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6 (CudaDepthwiseConvolution) [10/07/2020-14:47:51] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [10/07/2020-14:47:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [10/07/2020-14:47:51] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:47:51] [V] [TRT] [10/07/2020-14:47:51] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:47:51] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:47:51] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:47:51] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:47:51] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:47:51] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:47:51] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:47:51] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:47:51] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:47:51] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:47:51] [V] [TRT] *************** Autotuning format combination: Float(1,38,1444,369664) -> Float(1,19,361,92416) *************** [10/07/2020-14:47:51] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:47:51] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [10/07/2020-14:47:51] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:47:51] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [10/07/2020-14:47:51] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:47:51] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:47:51] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:47:51] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:47:51] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/Relu6 (FusedConvActConvolution) [10/07/2020-14:47:51] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [10/07/2020-14:47:51] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/Relu6 (CaskConvolution) [10/07/2020-14:47:51] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:47:51] [V] [TRT] Tactic: 1825138533642645384 time 4.7843 [10/07/2020-14:47:51] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [10/07/2020-14:47:51] [V] [TRT] Tactic: 2842488832350522458 time 4.25071 [10/07/2020-14:47:51] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:47:51] [V] [TRT] Tactic: 3915320020053085238 time 4.75596 [10/07/2020-14:47:51] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [10/07/2020-14:47:51] [V] [TRT] Tactic: 6448355332020552203 time 4.80884 [10/07/2020-14:47:51] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:47:51] [V] [TRT] Tactic: 6808617066150061604 time 4.16193 [10/07/2020-14:47:51] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:47:51] [V] [TRT] Tactic: -8060443123034038864 time 4.21427 [10/07/2020-14:47:51] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:47:51] [V] [TRT] Tactic: -4420849921117327522 time 3.14582 [10/07/2020-14:47:51] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:47:51] [V] [TRT] Tactic: -3946921629105938337 time 4.07423 [10/07/2020-14:47:51] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 3.14582 [10/07/2020-14:47:51] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/Relu6 (CudaConvolution) [10/07/2020-14:47:51] [V] [TRT] Tactic: 0 time 0.11398 [10/07/2020-14:47:51] [V] [TRT] Tactic: 2 time 0.113136 [10/07/2020-14:47:52] [V] [TRT] Tactic: 5 time 39.0114 [10/07/2020-14:47:52] [V] [TRT] Tactic: 57 time 0.113988 [10/07/2020-14:47:52] [V] [TRT] Fastest Tactic: 2 Time: 0.113136 [10/07/2020-14:47:52] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/Relu6 (CudaDepthwiseConvolution) [10/07/2020-14:47:52] [V] [TRT] Tactic: -1 time 0.056804 [10/07/2020-14:47:52] [V] [TRT] Fastest Tactic: -1 Time: 0.056804 [10/07/2020-14:47:52] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [10/07/2020-14:47:52] [V] [TRT] [10/07/2020-14:47:52] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,92416) -> Float(1,19,361,184832) *************** [10/07/2020-14:47:52] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:47:52] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:47:52] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:47:52] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:47:52] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:47:52] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:47:52] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:47:52] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:47:52] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:47:52] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6 (FusedConvActConvolution) [10/07/2020-14:47:52] [V] [TRT] Tactic: 589823 time 0.335064 [10/07/2020-14:47:52] [V] [TRT] Tactic: 655359 time 0.37184 [10/07/2020-14:47:52] [V] [TRT] Tactic: 786431 time 0.272808 [10/07/2020-14:47:52] [V] [TRT] Tactic: 851967 time 0.299772 [10/07/2020-14:47:52] [V] [TRT] Tactic: 1179647 time 0.344724 [10/07/2020-14:47:52] [V] [TRT] Tactic: 1310719 time 0.648084 [10/07/2020-14:47:52] [V] [TRT] Tactic: 1376255 time 0.385848 [10/07/2020-14:47:52] [V] [TRT] Tactic: 1441791 time 0.436828 [10/07/2020-14:47:52] [V] [TRT] Tactic: 1507327 time 0.32134 [10/07/2020-14:47:52] [V] [TRT] Tactic: 1638399 time 0.308896 [10/07/2020-14:47:53] [V] [TRT] Tactic: 1835007 time 0.289576 [10/07/2020-14:47:53] [V] [TRT] Tactic: 1900543 time 0.381288 [10/07/2020-14:47:53] [V] [TRT] Tactic: 2097151 time 0.33392 [10/07/2020-14:47:53] [V] [TRT] Tactic: 2162687 time 0.266004 [10/07/2020-14:47:53] [V] [TRT] Tactic: 2293759 time 0.37346 [10/07/2020-14:47:53] [V] [TRT] Tactic: 2359295 time 0.278392 [10/07/2020-14:47:53] [V] [TRT] Tactic: 2686975 time 0.275256 [10/07/2020-14:47:53] [V] [TRT] Tactic: 3080191 time 0.306944 [10/07/2020-14:47:53] [V] [TRT] Tactic: 3342335 time 0.326812 [10/07/2020-14:47:53] [V] [TRT] Tactic: 3407871 time 0.342304 [10/07/2020-14:47:53] [V] [TRT] Tactic: 3538943 time 0.324768 [10/07/2020-14:47:53] [V] [TRT] Tactic: 3670015 time 0.38442 [10/07/2020-14:47:53] [V] [TRT] Tactic: 3932159 time 0.33228 [10/07/2020-14:47:53] [V] [TRT] Tactic: 3997695 time 0.297468 [10/07/2020-14:47:53] [V] [TRT] Tactic: 4063231 time 0.32422 [10/07/2020-14:47:53] [V] [TRT] Tactic: 4194303 time 0.254596 [10/07/2020-14:47:53] [V] [TRT] Tactic: 4259839 time 0.336036 [10/07/2020-14:47:53] [V] [TRT] Tactic: 4325375 time 0.273384 [10/07/2020-14:47:53] [V] [TRT] Tactic: 4521983 time 0.361368 [10/07/2020-14:47:53] [V] [TRT] Tactic: 4587519 time 0.330244 [10/07/2020-14:47:53] [V] [TRT] Tactic: 4653055 time 0.312516 [10/07/2020-14:47:53] [V] [TRT] Tactic: 4915199 time 0.267536 [10/07/2020-14:47:53] [V] [TRT] Tactic: 4980735 time 0.290596 [10/07/2020-14:47:53] [V] [TRT] Tactic: 5177343 time 0.34102 [10/07/2020-14:47:53] [V] [TRT] Tactic: 5242879 time 0.287248 [10/07/2020-14:47:53] [V] [TRT] Tactic: 5373951 time 0.414612 [10/07/2020-14:47:53] [V] [TRT] Tactic: 5439487 time 0.3705 [10/07/2020-14:47:53] [V] [TRT] Tactic: 5570559 time 0.322256 [10/07/2020-14:47:53] [V] [TRT] Tactic: 5636095 time 0.32454 [10/07/2020-14:47:53] [V] [TRT] Tactic: 5701631 time 0.30088 [10/07/2020-14:47:53] [V] [TRT] Tactic: 5767167 time 0.656196 [10/07/2020-14:47:53] [V] [TRT] Tactic: 5832703 time 0.305516 [10/07/2020-14:47:53] [V] [TRT] Tactic: 5898239 time 0.2899 [10/07/2020-14:47:54] [V] [TRT] Tactic: 6029311 time 0.353004 [10/07/2020-14:47:54] [V] [TRT] Tactic: 6225919 time 0.296416 [10/07/2020-14:47:54] [V] [TRT] Tactic: 6291455 time 0.343972 [10/07/2020-14:47:54] [V] [TRT] Tactic: 6422527 time 0.29536 [10/07/2020-14:47:54] [V] [TRT] Tactic: 6750207 time 0.354804 [10/07/2020-14:47:54] [V] [TRT] Tactic: 6815743 time 0.306624 [10/07/2020-14:47:54] [V] [TRT] Tactic: 6946815 time 0.411616 [10/07/2020-14:47:54] [V] [TRT] Tactic: 7012351 time 0.332036 [10/07/2020-14:47:54] [V] [TRT] Tactic: 7077887 time 0.30758 [10/07/2020-14:47:54] [V] [TRT] Tactic: 7143423 time 0.477224 [10/07/2020-14:47:54] [V] [TRT] Tactic: 7208959 time 0.299136 [10/07/2020-14:47:54] [V] [TRT] Tactic: 7340031 time 0.29818 [10/07/2020-14:47:54] [V] [TRT] Tactic: 7405567 time 0.300548 [10/07/2020-14:47:54] [V] [TRT] Tactic: 7536639 time 0.343104 [10/07/2020-14:47:54] [V] [TRT] Tactic: 7602175 time 0.31574 [10/07/2020-14:47:54] [V] [TRT] Tactic: 7733247 time 0.27152 [10/07/2020-14:47:54] [V] [TRT] Tactic: 7798783 time 0.274092 [10/07/2020-14:47:54] [V] [TRT] Tactic: 8191999 time 0.583556 [10/07/2020-14:47:54] [V] [TRT] Tactic: 8257535 time 0.309732 [10/07/2020-14:47:54] [V] [TRT] Tactic: 8323071 time 0.319464 [10/07/2020-14:47:54] [V] [TRT] Tactic: 8650751 time 0.326476 [10/07/2020-14:47:54] [V] [TRT] Tactic: 8716287 time 0.346668 [10/07/2020-14:47:54] [V] [TRT] Tactic: 9109503 time 0.36544 [10/07/2020-14:47:54] [V] [TRT] Tactic: 9568255 time 0.267544 [10/07/2020-14:47:54] [V] [TRT] Tactic: 9895935 time 0.25716 [10/07/2020-14:47:54] [V] [TRT] Tactic: 10223615 time 0.274544 [10/07/2020-14:47:54] [V] [TRT] Tactic: 10354687 time 0.331608 [10/07/2020-14:47:54] [V] [TRT] Tactic: 10551295 time 0.327424 [10/07/2020-14:47:54] [V] [TRT] Tactic: 10747903 time 0.261796 [10/07/2020-14:47:54] [V] [TRT] Tactic: 10944511 time 0.292264 [10/07/2020-14:47:54] [V] [TRT] Fastest Tactic: 4194303 Time: 0.254596 [10/07/2020-14:47:54] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6 (CaskConvolution) [10/07/2020-14:47:54] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:47:54] [V] [TRT] Tactic: 1754569683116234317 time 0.166016 [10/07/2020-14:47:54] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:47:54] [V] [TRT] Tactic: 1825138533642645384 time 0.167088 [10/07/2020-14:47:54] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:47:54] [V] [TRT] Tactic: 2733356012094739613 time 0.174896 [10/07/2020-14:47:54] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:47:54] [V] [TRT] Tactic: 3915320020053085238 time 0.166288 [10/07/2020-14:47:54] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:47:54] [V] [TRT] Tactic: 6808617066150061604 time 0.134008 [10/07/2020-14:47:54] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:47:54] [V] [TRT] Tactic: 9091006216302412844 time 0.131324 [10/07/2020-14:47:54] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:47:54] [V] [TRT] Tactic: -8060443123034038864 time 0.136424 [10/07/2020-14:47:54] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:47:54] [V] [TRT] Tactic: -4420849921117327522 time 0.173908 [10/07/2020-14:47:54] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:47:54] [V] [TRT] Tactic: -3946921629105938337 time 0.183976 [10/07/2020-14:47:54] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.131324 [10/07/2020-14:47:54] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6 (CudaConvolution) [10/07/2020-14:47:54] [V] [TRT] Tactic: 0 time 0.256008 [10/07/2020-14:47:54] [V] [TRT] Tactic: 2 time 0.454648 [10/07/2020-14:47:54] [V] [TRT] Tactic: 5 skipped. Scratch requested: 19810304, available: 16777216 [10/07/2020-14:47:54] [V] [TRT] Tactic: 57 time 0.255428 [10/07/2020-14:47:55] [I] [TRT] Some tactics do not have sufficient workspace memory to run. Increasing workspace size may increase performance, please check verbose output. [10/07/2020-14:47:55] [V] [TRT] Fastest Tactic: 57 Time: 0.255428 [10/07/2020-14:47:55] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6 (CudaDepthwiseConvolution) [10/07/2020-14:47:55] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [10/07/2020-14:47:55] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [10/07/2020-14:47:55] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:47:55] [V] [TRT] [10/07/2020-14:47:55] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:47:55] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:47:55] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:47:55] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:47:55] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:47:55] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:47:55] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:47:55] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:47:55] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:47:55] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:47:55] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,184832) -> Float(1,19,361,184832) *************** [10/07/2020-14:47:55] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:47:55] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [10/07/2020-14:47:55] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:47:55] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [10/07/2020-14:47:55] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:47:55] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:47:55] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:47:55] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:47:55] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/Relu6 (FusedConvActConvolution) [10/07/2020-14:47:55] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [10/07/2020-14:47:55] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/Relu6 (CaskConvolution) [10/07/2020-14:47:55] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:47:55] [V] [TRT] Tactic: 1825138533642645384 time 9.62799 [10/07/2020-14:47:55] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [10/07/2020-14:47:55] [V] [TRT] Tactic: 2842488832350522458 time 8.52473 [10/07/2020-14:47:55] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:47:55] [V] [TRT] Tactic: 3915320020053085238 time 9.46992 [10/07/2020-14:47:55] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [10/07/2020-14:47:55] [V] [TRT] Tactic: 6448355332020552203 time 9.58705 [10/07/2020-14:47:55] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:47:56] [V] [TRT] Tactic: 6808617066150061604 time 8.30696 [10/07/2020-14:47:56] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:47:56] [V] [TRT] Tactic: -8060443123034038864 time 8.87778 [10/07/2020-14:47:56] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:47:56] [V] [TRT] Tactic: -4420849921117327522 time 6.34202 [10/07/2020-14:47:56] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:47:56] [V] [TRT] Tactic: -3946921629105938337 time 8.10319 [10/07/2020-14:47:56] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 6.34202 [10/07/2020-14:47:56] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/Relu6 (CudaConvolution) [10/07/2020-14:47:56] [V] [TRT] Tactic: 0 time 0.110348 [10/07/2020-14:47:56] [V] [TRT] Tactic: 2 time 0.110328 [10/07/2020-14:47:57] [V] [TRT] Tactic: 5 time 36.7372 [10/07/2020-14:47:57] [V] [TRT] Tactic: 6 time 7.1359 [10/07/2020-14:47:57] [V] [TRT] Tactic: 57 time 0.111352 [10/07/2020-14:47:57] [V] [TRT] Fastest Tactic: 2 Time: 0.110328 [10/07/2020-14:47:57] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/Relu6 (CudaDepthwiseConvolution) [10/07/2020-14:47:57] [V] [TRT] Tactic: -1 time 0.06298 [10/07/2020-14:47:57] [V] [TRT] Fastest Tactic: -1 Time: 0.06298 [10/07/2020-14:47:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [10/07/2020-14:47:57] [V] [TRT] [10/07/2020-14:47:57] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,184832) -> Float(1,19,361,184832) *************** [10/07/2020-14:47:57] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:47:57] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:47:57] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:47:57] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:47:57] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:47:57] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:47:57] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:47:57] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:47:57] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:47:57] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6 (FusedConvActConvolution) [10/07/2020-14:47:57] [V] [TRT] Tactic: 589823 time 0.544608 [10/07/2020-14:47:57] [V] [TRT] Tactic: 655359 time 0.638396 [10/07/2020-14:47:57] [V] [TRT] Tactic: 786431 time 0.504524 [10/07/2020-14:47:57] [V] [TRT] Tactic: 851967 time 0.474984 [10/07/2020-14:47:57] [V] [TRT] Tactic: 1179647 time 0.622464 [10/07/2020-14:47:57] [V] [TRT] Tactic: 1310719 time 1.26247 [10/07/2020-14:47:57] [V] [TRT] Tactic: 1376255 time 0.679852 [10/07/2020-14:47:58] [V] [TRT] Tactic: 1441791 time 0.71416 [10/07/2020-14:47:58] [V] [TRT] Tactic: 1507327 time 0.527024 [10/07/2020-14:47:58] [V] [TRT] Tactic: 1638399 time 0.527608 [10/07/2020-14:47:58] [V] [TRT] Tactic: 1835007 time 0.548268 [10/07/2020-14:47:58] [V] [TRT] Tactic: 1900543 time 0.65788 [10/07/2020-14:47:58] [V] [TRT] Tactic: 2097151 time 0.59112 [10/07/2020-14:47:58] [V] [TRT] Tactic: 2162687 time 0.410396 [10/07/2020-14:47:58] [V] [TRT] Tactic: 2293759 time 0.63078 [10/07/2020-14:47:58] [V] [TRT] Tactic: 2359295 time 0.449908 [10/07/2020-14:47:58] [V] [TRT] Tactic: 2686975 time 0.408964 [10/07/2020-14:47:58] [V] [TRT] Tactic: 3080191 time 0.493428 [10/07/2020-14:47:58] [V] [TRT] Tactic: 3342335 time 0.530948 [10/07/2020-14:47:58] [V] [TRT] Tactic: 3407871 time 0.604704 [10/07/2020-14:47:58] [V] [TRT] Tactic: 3538943 time 0.580148 [10/07/2020-14:47:58] [V] [TRT] Tactic: 3670015 time 0.643028 [10/07/2020-14:47:58] [V] [TRT] Tactic: 3932159 time 0.553316 [10/07/2020-14:47:58] [V] [TRT] Tactic: 3997695 time 0.547196 [10/07/2020-14:47:58] [V] [TRT] Tactic: 4063231 time 0.530584 [10/07/2020-14:47:58] [V] [TRT] Tactic: 4194303 time 0.450352 [10/07/2020-14:47:58] [V] [TRT] Tactic: 4259839 time 0.585908 [10/07/2020-14:47:58] [V] [TRT] Tactic: 4325375 time 0.471208 [10/07/2020-14:47:58] [V] [TRT] Tactic: 4521983 time 0.61182 [10/07/2020-14:47:58] [V] [TRT] Tactic: 4587519 time 0.627704 [10/07/2020-14:47:58] [V] [TRT] Tactic: 4653055 time 0.523132 [10/07/2020-14:47:58] [V] [TRT] Tactic: 4915199 time 0.49694 [10/07/2020-14:47:59] [V] [TRT] Tactic: 4980735 time 0.482044 [10/07/2020-14:47:59] [V] [TRT] Tactic: 5177343 time 0.596444 [10/07/2020-14:47:59] [V] [TRT] Tactic: 5242879 time 0.512956 [10/07/2020-14:47:59] [V] [TRT] Tactic: 5373951 time 0.775236 [10/07/2020-14:47:59] [V] [TRT] Tactic: 5439487 time 0.81538 [10/07/2020-14:47:59] [V] [TRT] Tactic: 5570559 time 0.522344 [10/07/2020-14:47:59] [V] [TRT] Tactic: 5636095 time 0.532432 [10/07/2020-14:47:59] [V] [TRT] Tactic: 5701631 time 0.453712 [10/07/2020-14:47:59] [V] [TRT] Tactic: 5767167 time 1.70995 [10/07/2020-14:47:59] [V] [TRT] Tactic: 5832703 time 0.541724 [10/07/2020-14:47:59] [V] [TRT] Tactic: 5898239 time 0.472488 [10/07/2020-14:47:59] [V] [TRT] Tactic: 6029311 time 0.59378 [10/07/2020-14:47:59] [V] [TRT] Tactic: 6225919 time 0.5494 [10/07/2020-14:47:59] [V] [TRT] Tactic: 6291455 time 0.619632 [10/07/2020-14:47:59] [V] [TRT] Tactic: 6422527 time 0.483628 [10/07/2020-14:47:59] [V] [TRT] Tactic: 6750207 time 0.6991 [10/07/2020-14:47:59] [V] [TRT] Tactic: 6815743 time 0.54828 [10/07/2020-14:47:59] [V] [TRT] Tactic: 6946815 time 0.986128 [10/07/2020-14:47:59] [V] [TRT] Tactic: 7012351 time 0.590568 [10/07/2020-14:47:59] [V] [TRT] Tactic: 7077887 time 0.568944 [10/07/2020-14:47:59] [V] [TRT] Tactic: 7143423 time 1.11567 [10/07/2020-14:47:59] [V] [TRT] Tactic: 7208959 time 0.530948 [10/07/2020-14:48:00] [V] [TRT] Tactic: 7340031 time 0.48724 [10/07/2020-14:48:00] [V] [TRT] Tactic: 7405567 time 0.512968 [10/07/2020-14:48:00] [V] [TRT] Tactic: 7536639 time 0.565896 [10/07/2020-14:48:00] [V] [TRT] Tactic: 7602175 time 0.648236 [10/07/2020-14:48:00] [V] [TRT] Tactic: 7733247 time 0.447652 [10/07/2020-14:48:00] [V] [TRT] Tactic: 7798783 time 0.504064 [10/07/2020-14:48:00] [V] [TRT] Tactic: 8191999 time 1.43318 [10/07/2020-14:48:00] [V] [TRT] Tactic: 8257535 time 0.539224 [10/07/2020-14:48:00] [V] [TRT] Tactic: 8323071 time 0.63346 [10/07/2020-14:48:00] [V] [TRT] Tactic: 8650751 time 0.703624 [10/07/2020-14:48:00] [V] [TRT] Tactic: 8716287 time 0.619204 [10/07/2020-14:48:00] [V] [TRT] Tactic: 9109503 time 0.6538 [10/07/2020-14:48:00] [V] [TRT] Tactic: 9568255 time 0.498832 [10/07/2020-14:48:00] [V] [TRT] Tactic: 9895935 time 0.449772 [10/07/2020-14:48:00] [V] [TRT] Tactic: 10223615 time 0.4089 [10/07/2020-14:48:00] [V] [TRT] Tactic: 10354687 time 0.582048 [10/07/2020-14:48:00] [V] [TRT] Tactic: 10551295 time 0.595456 [10/07/2020-14:48:00] [V] [TRT] Tactic: 10747903 time 0.431652 [10/07/2020-14:48:00] [V] [TRT] Tactic: 10944511 time 0.484172 [10/07/2020-14:48:00] [V] [TRT] Fastest Tactic: 10223615 Time: 0.4089 [10/07/2020-14:48:00] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6 (CaskConvolution) [10/07/2020-14:48:00] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:48:00] [V] [TRT] Tactic: 1754569683116234317 time 0.311688 [10/07/2020-14:48:00] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:00] [V] [TRT] Tactic: 1825138533642645384 time 0.313072 [10/07/2020-14:48:00] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:48:00] [V] [TRT] Tactic: 2733356012094739613 time 0.319532 [10/07/2020-14:48:00] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:00] [V] [TRT] Tactic: 3915320020053085238 time 0.311436 [10/07/2020-14:48:00] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:00] [V] [TRT] Tactic: 6808617066150061604 time 0.246132 [10/07/2020-14:48:00] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:00] [V] [TRT] Tactic: 9091006216302412844 time 0.239904 [10/07/2020-14:48:00] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:00] [V] [TRT] Tactic: -8060443123034038864 time 0.248404 [10/07/2020-14:48:00] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:00] [V] [TRT] Tactic: -4420849921117327522 time 0.32328 [10/07/2020-14:48:00] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:00] [V] [TRT] Tactic: -3946921629105938337 time 0.333012 [10/07/2020-14:48:00] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.239904 [10/07/2020-14:48:00] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6 (CudaConvolution) [10/07/2020-14:48:00] [V] [TRT] Tactic: 0 time 0.427668 [10/07/2020-14:48:00] [V] [TRT] Tactic: 2 time 0.603184 [10/07/2020-14:48:00] [V] [TRT] Tactic: 5 skipped. Scratch requested: 38297600, available: 16777216 [10/07/2020-14:48:00] [V] [TRT] Tactic: 57 time 0.413252 [10/07/2020-14:48:00] [V] [TRT] Fastest Tactic: 57 Time: 0.413252 [10/07/2020-14:48:00] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6 (CudaDepthwiseConvolution) [10/07/2020-14:48:00] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [10/07/2020-14:48:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [10/07/2020-14:48:00] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:00] [V] [TRT] [10/07/2020-14:48:00] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:48:00] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:00] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:48:00] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:00] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:00] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:00] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:00] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:00] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:00] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:00] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,184832) -> Float(1,19,361,184832) *************** [10/07/2020-14:48:00] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,184832) -> Float(1,19,361,184832) *************** [10/07/2020-14:48:00] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,184832) -> Float(1,19,361,184832) *************** [10/07/2020-14:48:00] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,184832) -> Float(1,19,361,184832) *************** [10/07/2020-14:48:00] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,184832) -> Float(1,19,361,184832) *************** [10/07/2020-14:48:00] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,184832) -> Float(1,19,361,184832) *************** [10/07/2020-14:48:00] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,184832) -> Float(1,19,361,184832) *************** [10/07/2020-14:48:00] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,184832) -> Float(1,19,361,184832) *************** [10/07/2020-14:48:00] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,184832) -> Float(1,19,361,102885) *************** [10/07/2020-14:48:00] [V] [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:48:00] [V] [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:00] [V] [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:48:00] [V] [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:00] [V] [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:00] [V] [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:00] [V] [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:00] [V] [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:00] [V] [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:00] [V] [TRT] --------------- Timing Runner: BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (FusedConvActConvolution) [10/07/2020-14:48:01] [V] [TRT] Tactic: 589823 time 0.47594 [10/07/2020-14:48:01] [V] [TRT] Tactic: 786431 time 0.267724 [10/07/2020-14:48:01] [V] [TRT] Tactic: 1310719 time 0.637924 [10/07/2020-14:48:01] [V] [TRT] Tactic: 1638399 time 0.297664 [10/07/2020-14:48:01] [V] [TRT] Tactic: 1835007 time 0.29872 [10/07/2020-14:48:01] [V] [TRT] Tactic: 2097151 time 0.338536 [10/07/2020-14:48:01] [V] [TRT] Tactic: 3997695 time 0.295024 [10/07/2020-14:48:01] [V] [TRT] Tactic: 4194303 time 0.273404 [10/07/2020-14:48:01] [V] [TRT] Tactic: 4259839 time 0.334432 [10/07/2020-14:48:01] [V] [TRT] Tactic: 4325375 time 0.268788 [10/07/2020-14:48:01] [V] [TRT] Tactic: 4521983 time 0.315628 [10/07/2020-14:48:01] [V] [TRT] Tactic: 4587519 time 0.331724 [10/07/2020-14:48:01] [V] [TRT] Tactic: 4915199 time 0.265344 [10/07/2020-14:48:01] [V] [TRT] Tactic: 4980735 time 0.310608 [10/07/2020-14:48:01] [V] [TRT] Tactic: 5439487 time 0.378536 [10/07/2020-14:48:01] [V] [TRT] Tactic: 5767167 time 0.758172 [10/07/2020-14:48:01] [V] [TRT] Tactic: 6750207 time 0.368164 [10/07/2020-14:48:01] [V] [TRT] Tactic: 6946815 time 0.544696 [10/07/2020-14:48:01] [V] [TRT] Tactic: 7012351 time 0.337744 [10/07/2020-14:48:01] [V] [TRT] Tactic: 7143423 time 0.57336 [10/07/2020-14:48:01] [V] [TRT] Tactic: 7602175 time 0.368528 [10/07/2020-14:48:01] [V] [TRT] Tactic: 7798783 time 0.26782 [10/07/2020-14:48:01] [V] [TRT] Tactic: 8191999 time 0.731188 [10/07/2020-14:48:01] [V] [TRT] Tactic: 8257535 time 0.32312 [10/07/2020-14:48:01] [V] [TRT] Tactic: 8323071 time 0.344764 [10/07/2020-14:48:01] [V] [TRT] Tactic: 8650751 time 0.352252 [10/07/2020-14:48:01] [V] [TRT] Tactic: 9109503 time 0.372484 [10/07/2020-14:48:01] [V] [TRT] Tactic: 9568255 time 0.264168 [10/07/2020-14:48:01] [V] [TRT] Tactic: 9895935 time 0.273616 [10/07/2020-14:48:01] [V] [TRT] Tactic: 10354687 time 0.313704 [10/07/2020-14:48:01] [V] [TRT] Tactic: 10551295 time 0.38452 [10/07/2020-14:48:01] [V] [TRT] Tactic: 10944511 time 0.309948 [10/07/2020-14:48:01] [V] [TRT] Fastest Tactic: 9568255 Time: 0.264168 [10/07/2020-14:48:01] [V] [TRT] --------------- Timing Runner: BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (CaskConvolution) [10/07/2020-14:48:01] [V] [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:48:01] [V] [TRT] Tactic: 1754569683116234317 time 0.310788 [10/07/2020-14:48:01] [V] [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:01] [V] [TRT] Tactic: 1825138533642645384 time 0.311872 [10/07/2020-14:48:01] [V] [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:48:01] [V] [TRT] Tactic: 2733356012094739613 time 0.18854 [10/07/2020-14:48:01] [V] [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:01] [V] [TRT] Tactic: 3915320020053085238 time 0.31066 [10/07/2020-14:48:01] [V] [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:01] [V] [TRT] Tactic: 6808617066150061604 time 0.1692 [10/07/2020-14:48:01] [V] [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:02] [V] [TRT] Tactic: 9091006216302412844 time 0.16322 [10/07/2020-14:48:02] [V] [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:02] [V] [TRT] Tactic: -8060443123034038864 time 0.17164 [10/07/2020-14:48:02] [V] [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:02] [V] [TRT] Tactic: -4420849921117327522 time 0.183352 [10/07/2020-14:48:02] [V] [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:02] [V] [TRT] Tactic: -3946921629105938337 time 0.206088 [10/07/2020-14:48:02] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.16322 [10/07/2020-14:48:02] [V] [TRT] --------------- Timing Runner: BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (CudaConvolution) [10/07/2020-14:48:02] [V] [TRT] Tactic: 0 time 0.256024 [10/07/2020-14:48:02] [V] [TRT] Tactic: 2 time 0.447188 [10/07/2020-14:48:02] [V] [TRT] Tactic: 5 skipped. Scratch requested: 21904896, available: 16777216 [10/07/2020-14:48:02] [V] [TRT] Tactic: 57 time 0.280332 [10/07/2020-14:48:02] [V] [TRT] Fastest Tactic: 0 Time: 0.256024 [10/07/2020-14:48:02] [V] [TRT] --------------- Timing Runner: BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (CudaDepthwiseConvolution) [10/07/2020-14:48:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [10/07/2020-14:48:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [10/07/2020-14:48:02] [V] [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:02] [V] [TRT] [10/07/2020-14:48:02] [V] [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:48:02] [V] [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:02] [V] [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:48:02] [V] [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:02] [V] [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:02] [V] [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:02] [V] [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:02] [V] [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:02] [V] [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:02] [V] [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:02] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:02] [V] [TRT] Tactic: 1002 time 0.036336 [10/07/2020-14:48:02] [V] [TRT] Tactic: 0 time 0.07524 [10/07/2020-14:48:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.036336 [10/07/2020-14:48:02] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,184832) -> Float(1,10,100,51200) *************** [10/07/2020-14:48:02] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:02] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [10/07/2020-14:48:02] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:02] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [10/07/2020-14:48:02] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:02] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:02] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:02] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:02] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/Relu6 (FusedConvActConvolution) [10/07/2020-14:48:02] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [10/07/2020-14:48:02] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/Relu6 (CaskConvolution) [10/07/2020-14:48:02] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:02] [V] [TRT] Tactic: 1825138533642645384 time 9.47256 [10/07/2020-14:48:02] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [10/07/2020-14:48:02] [V] [TRT] Tactic: 2842488832350522458 time 8.40596 [10/07/2020-14:48:02] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:02] [V] [TRT] Tactic: 3915320020053085238 time 9.34931 [10/07/2020-14:48:02] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [10/07/2020-14:48:03] [V] [TRT] Tactic: 6448355332020552203 time 9.53212 [10/07/2020-14:48:03] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:03] [V] [TRT] Tactic: 6808617066150061604 time 8.15419 [10/07/2020-14:48:03] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:03] [V] [TRT] Tactic: -8060443123034038864 time 8.35216 [10/07/2020-14:48:03] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:03] [V] [TRT] Tactic: -4420849921117327522 time 6.19619 [10/07/2020-14:48:03] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:03] [V] [TRT] Tactic: -3946921629105938337 time 7.92132 [10/07/2020-14:48:03] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 6.19619 [10/07/2020-14:48:03] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/Relu6 (CudaConvolution) [10/07/2020-14:48:03] [V] [TRT] Tactic: 0 time 0.045892 [10/07/2020-14:48:03] [V] [TRT] Tactic: 2 time 0.046148 [10/07/2020-14:48:04] [V] [TRT] Tactic: 5 time 39.5418 [10/07/2020-14:48:04] [V] [TRT] Tactic: 57 time 0.046012 [10/07/2020-14:48:04] [V] [TRT] Fastest Tactic: 0 Time: 0.045892 [10/07/2020-14:48:04] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/Relu6 (CudaDepthwiseConvolution) [10/07/2020-14:48:04] [V] [TRT] Tactic: -1 time 0.046712 [10/07/2020-14:48:04] [V] [TRT] Fastest Tactic: -1 Time: 0.046712 [10/07/2020-14:48:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 0 [10/07/2020-14:48:04] [V] [TRT] [10/07/2020-14:48:04] [V] [TRT] *************** Autotuning format combination: Float(1,10,100,51200) -> Float(1,10,100,102400) *************** [10/07/2020-14:48:04] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:48:04] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:04] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:48:04] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:04] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:04] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:04] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:04] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:04] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:04] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6 (FusedConvActConvolution) [10/07/2020-14:48:04] [V] [TRT] Tactic: 589823 time 0.476312 [10/07/2020-14:48:04] [V] [TRT] Tactic: 655359 time 0.34072 [10/07/2020-14:48:04] [V] [TRT] Tactic: 786431 time 0.241104 [10/07/2020-14:48:04] [V] [TRT] Tactic: 851967 time 0.287644 [10/07/2020-14:48:04] [V] [TRT] Tactic: 1179647 time 0.397088 [10/07/2020-14:48:04] [V] [TRT] Tactic: 1310719 time 0.792588 [10/07/2020-14:48:04] [V] [TRT] Tactic: 1376255 time 0.369104 [10/07/2020-14:48:04] [V] [TRT] Tactic: 1441791 time 0.408644 [10/07/2020-14:48:04] [V] [TRT] Tactic: 1507327 time 0.341552 [10/07/2020-14:48:05] [V] [TRT] Tactic: 1638399 time 0.301128 [10/07/2020-14:48:05] [V] [TRT] Tactic: 1835007 time 0.281868 [10/07/2020-14:48:05] [V] [TRT] Tactic: 1900543 time 0.348408 [10/07/2020-14:48:05] [V] [TRT] Tactic: 2097151 time 0.406612 [10/07/2020-14:48:05] [V] [TRT] Tactic: 2162687 time 0.339016 [10/07/2020-14:48:05] [V] [TRT] Tactic: 2293759 time 0.337772 [10/07/2020-14:48:05] [V] [TRT] Tactic: 2359295 time 0.240848 [10/07/2020-14:48:05] [V] [TRT] Tactic: 2686975 time 0.321772 [10/07/2020-14:48:05] [V] [TRT] Tactic: 3080191 time 0.324824 [10/07/2020-14:48:05] [V] [TRT] Tactic: 3342335 time 0.33954 [10/07/2020-14:48:05] [V] [TRT] Tactic: 3407871 time 0.435528 [10/07/2020-14:48:05] [V] [TRT] Tactic: 3538943 time 0.388892 [10/07/2020-14:48:05] [V] [TRT] Tactic: 3670015 time 0.582088 [10/07/2020-14:48:05] [V] [TRT] Tactic: 3932159 time 0.294228 [10/07/2020-14:48:05] [V] [TRT] Tactic: 3997695 time 0.26872 [10/07/2020-14:48:05] [V] [TRT] Tactic: 4063231 time 0.368628 [10/07/2020-14:48:05] [V] [TRT] Tactic: 4194303 time 0.324708 [10/07/2020-14:48:05] [V] [TRT] Tactic: 4259839 time 0.423336 [10/07/2020-14:48:05] [V] [TRT] Tactic: 4325375 time 0.275824 [10/07/2020-14:48:05] [V] [TRT] Tactic: 4521983 time 0.310648 [10/07/2020-14:48:05] [V] [TRT] Tactic: 4587519 time 0.433672 [10/07/2020-14:48:05] [V] [TRT] Tactic: 4653055 time 0.395068 [10/07/2020-14:48:05] [V] [TRT] Tactic: 4915199 time 0.341508 [10/07/2020-14:48:05] [V] [TRT] Tactic: 4980735 time 0.308532 [10/07/2020-14:48:05] [V] [TRT] Tactic: 5177343 time 0.381444 [10/07/2020-14:48:05] [V] [TRT] Tactic: 5242879 time 0.317328 [10/07/2020-14:48:06] [V] [TRT] Tactic: 5373951 time 0.419216 [10/07/2020-14:48:06] [V] [TRT] Tactic: 5439487 time 0.383824 [10/07/2020-14:48:06] [V] [TRT] Tactic: 5570559 time 0.341012 [10/07/2020-14:48:06] [V] [TRT] Tactic: 5636095 time 0.366104 [10/07/2020-14:48:06] [V] [TRT] Tactic: 5701631 time 0.319688 [10/07/2020-14:48:06] [V] [TRT] Tactic: 5767167 time 0.755552 [10/07/2020-14:48:06] [V] [TRT] Tactic: 5832703 time 0.376988 [10/07/2020-14:48:06] [V] [TRT] Tactic: 5898239 time 0.35382 [10/07/2020-14:48:06] [V] [TRT] Tactic: 6029311 time 0.311844 [10/07/2020-14:48:06] [V] [TRT] Tactic: 6225919 time 0.328764 [10/07/2020-14:48:06] [V] [TRT] Tactic: 6291455 time 0.398984 [10/07/2020-14:48:06] [V] [TRT] Tactic: 6422527 time 0.304176 [10/07/2020-14:48:06] [V] [TRT] Tactic: 6750207 time 0.430092 [10/07/2020-14:48:06] [V] [TRT] Tactic: 6815743 time 0.318972 [10/07/2020-14:48:06] [V] [TRT] Tactic: 6946815 time 0.406532 [10/07/2020-14:48:06] [V] [TRT] Tactic: 7012351 time 0.409972 [10/07/2020-14:48:06] [V] [TRT] Tactic: 7077887 time 0.380044 [10/07/2020-14:48:06] [V] [TRT] Tactic: 7143423 time 0.66668 [10/07/2020-14:48:06] [V] [TRT] Tactic: 7208959 time 0.351024 [10/07/2020-14:48:06] [V] [TRT] Tactic: 7340031 time 0.363724 [10/07/2020-14:48:06] [V] [TRT] Tactic: 7405567 time 0.355148 [10/07/2020-14:48:06] [V] [TRT] Tactic: 7536639 time 0.497984 [10/07/2020-14:48:06] [V] [TRT] Tactic: 7602175 time 0.41014 [10/07/2020-14:48:06] [V] [TRT] Tactic: 7733247 time 0.339412 [10/07/2020-14:48:06] [V] [TRT] Tactic: 7798783 time 0.239368 [10/07/2020-14:48:06] [V] [TRT] Tactic: 8191999 time 0.885788 [10/07/2020-14:48:07] [V] [TRT] Tactic: 8257535 time 0.38068 [10/07/2020-14:48:07] [V] [TRT] Tactic: 8323071 time 0.388724 [10/07/2020-14:48:07] [V] [TRT] Tactic: 8650751 time 0.382376 [10/07/2020-14:48:07] [V] [TRT] Tactic: 8716287 time 0.346576 [10/07/2020-14:48:07] [V] [TRT] Tactic: 9109503 time 0.438336 [10/07/2020-14:48:07] [V] [TRT] Tactic: 9568255 time 0.342024 [10/07/2020-14:48:07] [V] [TRT] Tactic: 9895935 time 0.324676 [10/07/2020-14:48:07] [V] [TRT] Tactic: 10223615 time 0.32188 [10/07/2020-14:48:07] [V] [TRT] Tactic: 10354687 time 0.421924 [10/07/2020-14:48:07] [V] [TRT] Tactic: 10551295 time 0.374704 [10/07/2020-14:48:07] [V] [TRT] Tactic: 10747903 time 0.329812 [10/07/2020-14:48:07] [V] [TRT] Tactic: 10944511 time 0.30834 [10/07/2020-14:48:07] [V] [TRT] Fastest Tactic: 7798783 Time: 0.239368 [10/07/2020-14:48:07] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6 (CaskConvolution) [10/07/2020-14:48:07] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:48:07] [V] [TRT] Tactic: 1754569683116234317 time 0.163252 [10/07/2020-14:48:07] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:07] [V] [TRT] Tactic: 1825138533642645384 time 0.165916 [10/07/2020-14:48:07] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:48:07] [V] [TRT] Tactic: 2733356012094739613 time 0.193048 [10/07/2020-14:48:07] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:07] [V] [TRT] Tactic: 3915320020053085238 time 0.164444 [10/07/2020-14:48:07] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:07] [V] [TRT] Tactic: 6808617066150061604 time 0.169736 [10/07/2020-14:48:07] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:07] [V] [TRT] Tactic: 9091006216302412844 time 0.163584 [10/07/2020-14:48:07] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:07] [V] [TRT] Tactic: -8060443123034038864 time 0.173004 [10/07/2020-14:48:07] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:07] [V] [TRT] Tactic: -4420849921117327522 time 0.181528 [10/07/2020-14:48:07] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:07] [V] [TRT] Tactic: -3946921629105938337 time 0.204852 [10/07/2020-14:48:07] [V] [TRT] Fastest Tactic: 1754569683116234317 Time: 0.163252 [10/07/2020-14:48:07] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6 (CudaConvolution) [10/07/2020-14:48:07] [V] [TRT] Tactic: 0 time 0.284948 [10/07/2020-14:48:07] [V] [TRT] Tactic: 2 time 0.468724 [10/07/2020-14:48:07] [V] [TRT] Tactic: 5 skipped. Scratch requested: 73392128, available: 16777216 [10/07/2020-14:48:07] [V] [TRT] Tactic: 57 time 0.238532 [10/07/2020-14:48:07] [V] [TRT] Fastest Tactic: 57 Time: 0.238532 [10/07/2020-14:48:07] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6 (CudaDepthwiseConvolution) [10/07/2020-14:48:07] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [10/07/2020-14:48:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1754569683116234317 [10/07/2020-14:48:07] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:48:07] [V] [TRT] [10/07/2020-14:48:07] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:48:07] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:07] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:48:07] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:07] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:07] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:07] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:07] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:07] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:07] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:48:07] [V] [TRT] *************** Autotuning format combination: Float(1,10,100,102400) -> Float(1,10,100,102400) *************** [10/07/2020-14:48:07] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:07] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [10/07/2020-14:48:07] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:07] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [10/07/2020-14:48:07] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:07] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:07] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:07] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:07] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/Relu6 (FusedConvActConvolution) [10/07/2020-14:48:07] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [10/07/2020-14:48:07] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/Relu6 (CaskConvolution) [10/07/2020-14:48:07] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:08] [V] [TRT] Tactic: 1825138533642645384 time 18.8504 [10/07/2020-14:48:08] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [10/07/2020-14:48:08] [V] [TRT] Tactic: 2842488832350522458 time 16.6507 [10/07/2020-14:48:08] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:09] [V] [TRT] Tactic: 3915320020053085238 time 18.6578 [10/07/2020-14:48:09] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [10/07/2020-14:48:09] [V] [TRT] Tactic: 6448355332020552203 time 18.7762 [10/07/2020-14:48:09] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:09] [V] [TRT] Tactic: 6808617066150061604 time 16.2814 [10/07/2020-14:48:09] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:10] [V] [TRT] Tactic: -8060443123034038864 time 16.6105 [10/07/2020-14:48:10] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:10] [V] [TRT] Tactic: -4420849921117327522 time 12.2841 [10/07/2020-14:48:10] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:11] [V] [TRT] Tactic: -3946921629105938337 time 15.7796 [10/07/2020-14:48:11] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 12.2841 [10/07/2020-14:48:11] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/Relu6 (CudaConvolution) [10/07/2020-14:48:11] [V] [TRT] Tactic: 0 time 0.06448 [10/07/2020-14:48:11] [V] [TRT] Tactic: 2 time 0.064328 [10/07/2020-14:48:12] [V] [TRT] Tactic: 5 time 79.0289 [10/07/2020-14:48:12] [V] [TRT] Tactic: 6 time 14.9221 [10/07/2020-14:48:12] [V] [TRT] Tactic: 57 time 0.064604 [10/07/2020-14:48:12] [V] [TRT] Fastest Tactic: 2 Time: 0.064328 [10/07/2020-14:48:12] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/Relu6 (CudaDepthwiseConvolution) [10/07/2020-14:48:12] [V] [TRT] Tactic: -1 time 0.069284 [10/07/2020-14:48:12] [V] [TRT] Fastest Tactic: -1 Time: 0.069284 [10/07/2020-14:48:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 2 [10/07/2020-14:48:12] [V] [TRT] [10/07/2020-14:48:12] [V] [TRT] *************** Autotuning format combination: Float(1,10,100,102400) -> Float(1,10,100,102400) *************** [10/07/2020-14:48:12] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:48:12] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:12] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:48:12] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:12] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:12] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:12] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:12] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:12] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:12] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 (FusedConvActConvolution) [10/07/2020-14:48:12] [V] [TRT] Tactic: 589823 time 0.880856 [10/07/2020-14:48:12] [V] [TRT] Tactic: 655359 time 0.614544 [10/07/2020-14:48:12] [V] [TRT] Tactic: 786431 time 0.43392 [10/07/2020-14:48:12] [V] [TRT] Tactic: 851967 time 0.499956 [10/07/2020-14:48:12] [V] [TRT] Tactic: 1179647 time 0.738516 [10/07/2020-14:48:13] [V] [TRT] Tactic: 1310719 time 1.613 [10/07/2020-14:48:13] [V] [TRT] Tactic: 1376255 time 0.669404 [10/07/2020-14:48:13] [V] [TRT] Tactic: 1441791 time 0.726956 [10/07/2020-14:48:13] [V] [TRT] Tactic: 1507327 time 0.606816 [10/07/2020-14:48:13] [V] [TRT] Tactic: 1638399 time 0.531204 [10/07/2020-14:48:13] [V] [TRT] Tactic: 1835007 time 0.520016 [10/07/2020-14:48:13] [V] [TRT] Tactic: 1900543 time 0.61306 [10/07/2020-14:48:13] [V] [TRT] Tactic: 2097151 time 0.753928 [10/07/2020-14:48:13] [V] [TRT] Tactic: 2162687 time 0.60324 [10/07/2020-14:48:13] [V] [TRT] Tactic: 2293759 time 0.607668 [10/07/2020-14:48:13] [V] [TRT] Tactic: 2359295 time 0.409268 [10/07/2020-14:48:13] [V] [TRT] Tactic: 2686975 time 0.569412 [10/07/2020-14:48:13] [V] [TRT] Tactic: 3080191 time 0.578368 [10/07/2020-14:48:13] [V] [TRT] Tactic: 3342335 time 0.611172 [10/07/2020-14:48:13] [V] [TRT] Tactic: 3407871 time 0.856788 [10/07/2020-14:48:13] [V] [TRT] Tactic: 3538943 time 0.72466 [10/07/2020-14:48:14] [V] [TRT] Tactic: 3670015 time 1.08694 [10/07/2020-14:48:14] [V] [TRT] Tactic: 3932159 time 0.513852 [10/07/2020-14:48:14] [V] [TRT] Tactic: 3997695 time 0.500728 [10/07/2020-14:48:14] [V] [TRT] Tactic: 4063231 time 0.646872 [10/07/2020-14:48:14] [V] [TRT] Tactic: 4194303 time 0.591076 [10/07/2020-14:48:14] [V] [TRT] Tactic: 4259839 time 0.77382 [10/07/2020-14:48:14] [V] [TRT] Tactic: 4325375 time 0.494712 [10/07/2020-14:48:14] [V] [TRT] Tactic: 4521983 time 0.546596 [10/07/2020-14:48:14] [V] [TRT] Tactic: 4587519 time 0.837764 [10/07/2020-14:48:14] [V] [TRT] Tactic: 4653055 time 0.722704 [10/07/2020-14:48:14] [V] [TRT] Tactic: 4915199 time 0.651748 [10/07/2020-14:48:14] [V] [TRT] Tactic: 4980735 time 0.571496 [10/07/2020-14:48:14] [V] [TRT] Tactic: 5177343 time 0.696108 [10/07/2020-14:48:14] [V] [TRT] Tactic: 5242879 time 0.622204 [10/07/2020-14:48:14] [V] [TRT] Tactic: 5373951 time 0.783088 [10/07/2020-14:48:14] [V] [TRT] Tactic: 5439487 time 0.743692 [10/07/2020-14:48:14] [V] [TRT] Tactic: 5570559 time 0.603304 [10/07/2020-14:48:15] [V] [TRT] Tactic: 5636095 time 0.646336 [10/07/2020-14:48:15] [V] [TRT] Tactic: 5701631 time 0.570012 [10/07/2020-14:48:15] [V] [TRT] Tactic: 5767167 time 1.40262 [10/07/2020-14:48:15] [V] [TRT] Tactic: 5832703 time 0.670196 [10/07/2020-14:48:15] [V] [TRT] Tactic: 5898239 time 0.626576 [10/07/2020-14:48:15] [V] [TRT] Tactic: 6029311 time 0.551088 [10/07/2020-14:48:15] [V] [TRT] Tactic: 6225919 time 0.62158 [10/07/2020-14:48:15] [V] [TRT] Tactic: 6291455 time 0.736364 [10/07/2020-14:48:15] [V] [TRT] Tactic: 6422527 time 0.541932 [10/07/2020-14:48:15] [V] [TRT] Tactic: 6750207 time 0.84022 [10/07/2020-14:48:15] [V] [TRT] Tactic: 6815743 time 0.618448 [10/07/2020-14:48:15] [V] [TRT] Tactic: 6946815 time 0.79942 [10/07/2020-14:48:15] [V] [TRT] Tactic: 7012351 time 0.750184 [10/07/2020-14:48:15] [V] [TRT] Tactic: 7077887 time 0.723588 [10/07/2020-14:48:15] [V] [TRT] Tactic: 7143423 time 1.32346 [10/07/2020-14:48:15] [V] [TRT] Tactic: 7208959 time 0.656836 [10/07/2020-14:48:16] [V] [TRT] Tactic: 7340031 time 0.646592 [10/07/2020-14:48:16] [V] [TRT] Tactic: 7405567 time 0.638452 [10/07/2020-14:48:16] [V] [TRT] Tactic: 7536639 time 0.927108 [10/07/2020-14:48:16] [V] [TRT] Tactic: 7602175 time 0.786732 [10/07/2020-14:48:16] [V] [TRT] Tactic: 7733247 time 0.596328 [10/07/2020-14:48:16] [V] [TRT] Tactic: 7798783 time 0.432336 [10/07/2020-14:48:16] [V] [TRT] Tactic: 8191999 time 1.94716 [10/07/2020-14:48:16] [V] [TRT] Tactic: 8257535 time 0.715912 [10/07/2020-14:48:16] [V] [TRT] Tactic: 8323071 time 0.761308 [10/07/2020-14:48:16] [V] [TRT] Tactic: 8650751 time 0.756344 [10/07/2020-14:48:16] [V] [TRT] Tactic: 8716287 time 0.64996 [10/07/2020-14:48:16] [V] [TRT] Tactic: 9109503 time 0.814508 [10/07/2020-14:48:16] [V] [TRT] Tactic: 9568255 time 0.64582 [10/07/2020-14:48:16] [V] [TRT] Tactic: 9895935 time 0.591848 [10/07/2020-14:48:16] [V] [TRT] Tactic: 10223615 time 0.569292 [10/07/2020-14:48:17] [V] [TRT] Tactic: 10354687 time 0.771696 [10/07/2020-14:48:17] [V] [TRT] Tactic: 10551295 time 0.700296 [10/07/2020-14:48:17] [V] [TRT] Tactic: 10747903 time 0.57934 [10/07/2020-14:48:17] [V] [TRT] Tactic: 10944511 time 0.571476 [10/07/2020-14:48:17] [V] [TRT] Fastest Tactic: 2359295 Time: 0.409268 [10/07/2020-14:48:17] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 (CaskConvolution) [10/07/2020-14:48:17] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:48:17] [V] [TRT] Tactic: 1754569683116234317 time 0.30966 [10/07/2020-14:48:17] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:17] [V] [TRT] Tactic: 1825138533642645384 time 0.31372 [10/07/2020-14:48:17] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:48:17] [V] [TRT] Tactic: 2733356012094739613 time 0.367052 [10/07/2020-14:48:17] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:17] [V] [TRT] Tactic: 3915320020053085238 time 0.31122 [10/07/2020-14:48:17] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:17] [V] [TRT] Tactic: 6808617066150061604 time 0.32148 [10/07/2020-14:48:17] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:17] [V] [TRT] Tactic: 9091006216302412844 time 0.3095 [10/07/2020-14:48:17] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:17] [V] [TRT] Tactic: -8060443123034038864 time 0.326864 [10/07/2020-14:48:17] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:17] [V] [TRT] Tactic: -4420849921117327522 time 0.342932 [10/07/2020-14:48:17] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:17] [V] [TRT] Tactic: -3946921629105938337 time 0.396104 [10/07/2020-14:48:17] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.3095 [10/07/2020-14:48:17] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 (CudaConvolution) [10/07/2020-14:48:17] [V] [TRT] Tactic: 0 time 0.532692 [10/07/2020-14:48:17] [V] [TRT] Tactic: 2 time 0.659928 [10/07/2020-14:48:17] [V] [TRT] Tactic: 5 skipped. Scratch requested: 145391616, available: 16777216 [10/07/2020-14:48:17] [V] [TRT] Tactic: 57 time 0.394824 [10/07/2020-14:48:17] [V] [TRT] Fastest Tactic: 57 Time: 0.394824 [10/07/2020-14:48:17] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 (CudaDepthwiseConvolution) [10/07/2020-14:48:17] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [10/07/2020-14:48:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [10/07/2020-14:48:17] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:17] [V] [TRT] [10/07/2020-14:48:17] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:48:17] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:17] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:48:17] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:17] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:17] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:17] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:17] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:17] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:17] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:17] [V] [TRT] *************** Autotuning format combination: Float(1,10,100,102400) -> Float(1,10,100,57000) *************** [10/07/2020-14:48:17] [V] [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:48:17] [V] [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:17] [V] [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:48:17] [V] [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:17] [V] [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:17] [V] [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:17] [V] [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:17] [V] [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:17] [V] [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:17] [V] [TRT] --------------- Timing Runner: BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D (FusedConvActConvolution) [10/07/2020-14:48:17] [V] [TRT] Tactic: 589823 time 0.842024 [10/07/2020-14:48:17] [V] [TRT] Tactic: 786431 time 0.258488 [10/07/2020-14:48:17] [V] [TRT] Tactic: 1179647 time 0.422976 [10/07/2020-14:48:17] [V] [TRT] Tactic: 1310719 time 0.924328 [10/07/2020-14:48:17] [V] [TRT] Tactic: 1376255 time 0.573104 [10/07/2020-14:48:17] [V] [TRT] Tactic: 1441791 time 0.44836 [10/07/2020-14:48:17] [V] [TRT] Tactic: 1638399 time 0.361352 [10/07/2020-14:48:17] [V] [TRT] Tactic: 1835007 time 0.30884 [10/07/2020-14:48:17] [V] [TRT] Tactic: 2097151 time 0.460428 [10/07/2020-14:48:17] [V] [TRT] Tactic: 2162687 time 0.560868 [10/07/2020-14:48:17] [V] [TRT] Tactic: 2293759 time 0.54178 [10/07/2020-14:48:17] [V] [TRT] Tactic: 2359295 time 0.325964 [10/07/2020-14:48:17] [V] [TRT] Tactic: 2686975 time 0.53258 [10/07/2020-14:48:17] [V] [TRT] Tactic: 3407871 time 0.542664 [10/07/2020-14:48:18] [V] [TRT] Tactic: 3538943 time 0.452556 [10/07/2020-14:48:18] [V] [TRT] Tactic: 3997695 time 0.263044 [10/07/2020-14:48:18] [V] [TRT] Tactic: 4194303 time 0.441504 [10/07/2020-14:48:18] [V] [TRT] Tactic: 4259839 time 0.462348 [10/07/2020-14:48:18] [V] [TRT] Tactic: 4325375 time 0.301488 [10/07/2020-14:48:18] [V] [TRT] Tactic: 4521983 time 0.500688 [10/07/2020-14:48:18] [V] [TRT] Tactic: 4587519 time 0.482988 [10/07/2020-14:48:18] [V] [TRT] Tactic: 4653055 time 0.4062 [10/07/2020-14:48:18] [V] [TRT] Tactic: 4915199 time 0.414412 [10/07/2020-14:48:18] [V] [TRT] Tactic: 4980735 time 0.293872 [10/07/2020-14:48:18] [V] [TRT] Tactic: 5177343 time 0.423076 [10/07/2020-14:48:18] [V] [TRT] Tactic: 5242879 time 0.320664 [10/07/2020-14:48:18] [V] [TRT] Tactic: 5373951 time 0.44838 [10/07/2020-14:48:18] [V] [TRT] Tactic: 5439487 time 0.410508 [10/07/2020-14:48:18] [V] [TRT] Tactic: 5701631 time 0.525104 [10/07/2020-14:48:18] [V] [TRT] Tactic: 5767167 time 0.775092 [10/07/2020-14:48:18] [V] [TRT] Tactic: 5832703 time 0.364876 [10/07/2020-14:48:18] [V] [TRT] Tactic: 5898239 time 0.392228 [10/07/2020-14:48:18] [V] [TRT] Tactic: 6029311 time 0.510768 [10/07/2020-14:48:18] [V] [TRT] Tactic: 6225919 time 0.343988 [10/07/2020-14:48:18] [V] [TRT] Tactic: 6291455 time 0.424984 [10/07/2020-14:48:18] [V] [TRT] Tactic: 6750207 time 0.473584 [10/07/2020-14:48:18] [V] [TRT] Tactic: 6815743 time 0.322384 [10/07/2020-14:48:18] [V] [TRT] Tactic: 6946815 time 0.448488 [10/07/2020-14:48:18] [V] [TRT] Tactic: 7012351 time 0.456492 [10/07/2020-14:48:18] [V] [TRT] Tactic: 7077887 time 0.393764 [10/07/2020-14:48:18] [V] [TRT] Tactic: 7143423 time 0.732548 [10/07/2020-14:48:18] [V] [TRT] Tactic: 7208959 time 0.36658 [10/07/2020-14:48:19] [V] [TRT] Tactic: 7340031 time 0.40562 [10/07/2020-14:48:19] [V] [TRT] Tactic: 7405567 time 0.418304 [10/07/2020-14:48:19] [V] [TRT] Tactic: 7536639 time 0.477436 [10/07/2020-14:48:19] [V] [TRT] Tactic: 7602175 time 0.43856 [10/07/2020-14:48:19] [V] [TRT] Tactic: 7733247 time 0.361864 [10/07/2020-14:48:19] [V] [TRT] Tactic: 7798783 time 0.253924 [10/07/2020-14:48:19] [V] [TRT] Tactic: 8191999 time 1.13756 [10/07/2020-14:48:19] [V] [TRT] Tactic: 8257535 time 0.439956 [10/07/2020-14:48:19] [V] [TRT] Tactic: 8323071 time 0.415012 [10/07/2020-14:48:19] [V] [TRT] Tactic: 8650751 time 0.444396 [10/07/2020-14:48:19] [V] [TRT] Tactic: 8716287 time 0.370784 [10/07/2020-14:48:19] [V] [TRT] Tactic: 9109503 time 0.486272 [10/07/2020-14:48:19] [V] [TRT] Tactic: 9568255 time 0.412628 [10/07/2020-14:48:19] [V] [TRT] Tactic: 9895935 time 0.441624 [10/07/2020-14:48:19] [V] [TRT] Tactic: 10223615 time 0.531544 [10/07/2020-14:48:19] [V] [TRT] Tactic: 10354687 time 0.464052 [10/07/2020-14:48:19] [V] [TRT] Tactic: 10551295 time 0.363928 [10/07/2020-14:48:19] [V] [TRT] Tactic: 10747903 time 0.350228 [10/07/2020-14:48:19] [V] [TRT] Tactic: 10944511 time 0.294408 [10/07/2020-14:48:19] [V] [TRT] Fastest Tactic: 7798783 Time: 0.253924 [10/07/2020-14:48:19] [V] [TRT] --------------- Timing Runner: BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D (CaskConvolution) [10/07/2020-14:48:19] [V] [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:48:19] [V] [TRT] Tactic: 1754569683116234317 time 0.308984 [10/07/2020-14:48:19] [V] [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:19] [V] [TRT] Tactic: 1825138533642645384 time 0.31272 [10/07/2020-14:48:19] [V] [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:48:19] [V] [TRT] Tactic: 2733356012094739613 time 0.3593 [10/07/2020-14:48:19] [V] [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:19] [V] [TRT] Tactic: 3915320020053085238 time 0.310224 [10/07/2020-14:48:19] [V] [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:19] [V] [TRT] Tactic: 6808617066150061604 time 0.319788 [10/07/2020-14:48:19] [V] [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:19] [V] [TRT] Tactic: 9091006216302412844 time 0.309176 [10/07/2020-14:48:19] [V] [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:19] [V] [TRT] Tactic: -8060443123034038864 time 0.325652 [10/07/2020-14:48:19] [V] [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:19] [V] [TRT] Tactic: -4420849921117327522 time 0.306536 [10/07/2020-14:48:19] [V] [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:19] [V] [TRT] Tactic: -3946921629105938337 time 0.394264 [10/07/2020-14:48:19] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.306536 [10/07/2020-14:48:19] [V] [TRT] --------------- Timing Runner: BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D (CudaConvolution) [10/07/2020-14:48:19] [V] [TRT] Tactic: 0 time 0.31344 [10/07/2020-14:48:19] [V] [TRT] Tactic: 2 time 0.487892 [10/07/2020-14:48:19] [V] [TRT] Tactic: 5 skipped. Scratch requested: 81548800, available: 16777216 [10/07/2020-14:48:19] [V] [TRT] Tactic: 57 time 0.313764 [10/07/2020-14:48:19] [V] [TRT] Fastest Tactic: 0 Time: 0.31344 [10/07/2020-14:48:19] [V] [TRT] --------------- Timing Runner: BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D (CudaDepthwiseConvolution) [10/07/2020-14:48:19] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [10/07/2020-14:48:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 7798783 [10/07/2020-14:48:19] [V] [TRT] [10/07/2020-14:48:19] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:19] [V] [TRT] Tactic: 1002 time 0.024952 [10/07/2020-14:48:19] [V] [TRT] Tactic: 0 time 0.042932 [10/07/2020-14:48:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.024952 [10/07/2020-14:48:19] [V] [TRT] *************** Autotuning format combination: Float(1,10,100,102400) -> Float(1,10,100,25600) *************** [10/07/2020-14:48:19] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:48:19] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:19] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:48:19] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:19] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:19] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:19] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:19] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:19] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:19] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/Relu6 (FusedConvActConvolution) [10/07/2020-14:48:19] [V] [TRT] Tactic: 589823 time 0.803816 [10/07/2020-14:48:19] [V] [TRT] Tactic: 655359 time 0.54388 [10/07/2020-14:48:19] [V] [TRT] Tactic: 786431 time 0.1674 [10/07/2020-14:48:20] [V] [TRT] Tactic: 851967 time 0.155888 [10/07/2020-14:48:20] [V] [TRT] Tactic: 1179647 time 0.17522 [10/07/2020-14:48:20] [V] [TRT] Tactic: 1310719 time 0.567072 [10/07/2020-14:48:20] [V] [TRT] Tactic: 1376255 time 0.539028 [10/07/2020-14:48:20] [V] [TRT] Tactic: 1441791 time 0.185136 [10/07/2020-14:48:20] [V] [TRT] Tactic: 1507327 time 0.29482 [10/07/2020-14:48:20] [V] [TRT] Tactic: 1638399 time 0.136424 [10/07/2020-14:48:20] [V] [TRT] Tactic: 1835007 time 0.164044 [10/07/2020-14:48:20] [V] [TRT] Tactic: 1900543 time 0.567644 [10/07/2020-14:48:20] [V] [TRT] Tactic: 2097151 time 0.178752 [10/07/2020-14:48:20] [V] [TRT] Tactic: 2162687 time 0.547156 [10/07/2020-14:48:20] [V] [TRT] Tactic: 2293759 time 0.512104 [10/07/2020-14:48:20] [V] [TRT] Tactic: 2359295 time 0.296936 [10/07/2020-14:48:20] [V] [TRT] Tactic: 2686975 time 0.515876 [10/07/2020-14:48:20] [V] [TRT] Tactic: 3080191 time 0.276856 [10/07/2020-14:48:20] [V] [TRT] Tactic: 3342335 time 0.293368 [10/07/2020-14:48:20] [V] [TRT] Tactic: 3407871 time 0.27276 [10/07/2020-14:48:20] [V] [TRT] Tactic: 3538943 time 0.16578 [10/07/2020-14:48:20] [V] [TRT] Tactic: 3670015 time 1.04705 [10/07/2020-14:48:20] [V] [TRT] Tactic: 3932159 time 0.467256 [10/07/2020-14:48:20] [V] [TRT] Tactic: 3997695 time 0.111244 [10/07/2020-14:48:20] [V] [TRT] Tactic: 4063231 time 0.164336 [10/07/2020-14:48:20] [V] [TRT] Tactic: 4194303 time 0.192864 [10/07/2020-14:48:20] [V] [TRT] Tactic: 4259839 time 0.191528 [10/07/2020-14:48:20] [V] [TRT] Tactic: 4325375 time 0.146668 [10/07/2020-14:48:20] [V] [TRT] Tactic: 4521983 time 0.481644 [10/07/2020-14:48:20] [V] [TRT] Tactic: 4587519 time 0.218848 [10/07/2020-14:48:20] [V] [TRT] Tactic: 4653055 time 0.201336 [10/07/2020-14:48:20] [V] [TRT] Tactic: 4915199 time 0.160252 [10/07/2020-14:48:20] [V] [TRT] Tactic: 4980735 time 0.255624 [10/07/2020-14:48:20] [V] [TRT] Tactic: 5177343 time 0.183888 [10/07/2020-14:48:20] [V] [TRT] Tactic: 5242879 time 0.257488 [10/07/2020-14:48:21] [V] [TRT] Tactic: 5373951 time 0.18988 [10/07/2020-14:48:21] [V] [TRT] Tactic: 5439487 time 0.189896 [10/07/2020-14:48:21] [V] [TRT] Tactic: 5570559 time 0.292052 [10/07/2020-14:48:21] [V] [TRT] Tactic: 5636095 time 0.165052 [10/07/2020-14:48:21] [V] [TRT] Tactic: 5701631 time 0.505976 [10/07/2020-14:48:21] [V] [TRT] Tactic: 5767167 time 0.266228 [10/07/2020-14:48:21] [V] [TRT] Tactic: 5832703 time 0.275508 [10/07/2020-14:48:21] [V] [TRT] Tactic: 5898239 time 0.183792 [10/07/2020-14:48:21] [V] [TRT] Tactic: 6029311 time 0.488848 [10/07/2020-14:48:21] [V] [TRT] Tactic: 6225919 time 0.147192 [10/07/2020-14:48:21] [V] [TRT] Tactic: 6291455 time 0.176856 [10/07/2020-14:48:21] [V] [TRT] Tactic: 6422527 time 0.261592 [10/07/2020-14:48:21] [V] [TRT] Tactic: 6750207 time 0.187488 [10/07/2020-14:48:21] [V] [TRT] Tactic: 6815743 time 0.259444 [10/07/2020-14:48:21] [V] [TRT] Tactic: 6946815 time 0.185804 [10/07/2020-14:48:21] [V] [TRT] Tactic: 7012351 time 0.178892 [10/07/2020-14:48:21] [V] [TRT] Tactic: 7077887 time 0.16614 [10/07/2020-14:48:21] [V] [TRT] Tactic: 7143423 time 0.264264 [10/07/2020-14:48:21] [V] [TRT] Tactic: 7208959 time 0.277496 [10/07/2020-14:48:21] [V] [TRT] Tactic: 7340031 time 0.187796 [10/07/2020-14:48:21] [V] [TRT] Tactic: 7405567 time 0.153716 [10/07/2020-14:48:21] [V] [TRT] Tactic: 7536639 time 0.441984 [10/07/2020-14:48:21] [V] [TRT] Tactic: 7602175 time 0.183104 [10/07/2020-14:48:21] [V] [TRT] Tactic: 7733247 time 0.167744 [10/07/2020-14:48:21] [V] [TRT] Tactic: 7798783 time 0.16842 [10/07/2020-14:48:21] [V] [TRT] Tactic: 8191999 time 0.290708 [10/07/2020-14:48:21] [V] [TRT] Tactic: 8257535 time 0.187344 [10/07/2020-14:48:21] [V] [TRT] Tactic: 8323071 time 0.19056 [10/07/2020-14:48:21] [V] [TRT] Tactic: 8650751 time 0.172572 [10/07/2020-14:48:21] [V] [TRT] Tactic: 8716287 time 0.15662 [10/07/2020-14:48:21] [V] [TRT] Tactic: 9109503 time 0.188988 [10/07/2020-14:48:21] [V] [TRT] Tactic: 9568255 time 0.158636 [10/07/2020-14:48:21] [V] [TRT] Tactic: 9895935 time 0.193072 [10/07/2020-14:48:21] [V] [TRT] Tactic: 10223615 time 0.515856 [10/07/2020-14:48:21] [V] [TRT] Tactic: 10354687 time 0.190164 [10/07/2020-14:48:21] [V] [TRT] Tactic: 10551295 time 0.280544 [10/07/2020-14:48:22] [V] [TRT] Tactic: 10747903 time 0.16274 [10/07/2020-14:48:22] [V] [TRT] Tactic: 10944511 time 0.254828 [10/07/2020-14:48:22] [V] [TRT] Fastest Tactic: 3997695 Time: 0.111244 [10/07/2020-14:48:22] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/Relu6 (CaskConvolution) [10/07/2020-14:48:22] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:48:22] [V] [TRT] Tactic: 1754569683116234317 time 0.307976 [10/07/2020-14:48:22] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:22] [V] [TRT] Tactic: 1825138533642645384 time 0.31288 [10/07/2020-14:48:22] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:48:22] [V] [TRT] Tactic: 2733356012094739613 time 0.322708 [10/07/2020-14:48:22] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:22] [V] [TRT] Tactic: 3915320020053085238 time 0.309908 [10/07/2020-14:48:22] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:22] [V] [TRT] Tactic: 6808617066150061604 time 0.201312 [10/07/2020-14:48:22] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:22] [V] [TRT] Tactic: 9091006216302412844 time 0.187744 [10/07/2020-14:48:22] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:22] [V] [TRT] Tactic: -8060443123034038864 time 0.214292 [10/07/2020-14:48:22] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:22] [V] [TRT] Tactic: -4420849921117327522 time 0.280392 [10/07/2020-14:48:22] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:22] [V] [TRT] Tactic: -3946921629105938337 time 0.333616 [10/07/2020-14:48:22] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.187744 [10/07/2020-14:48:22] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/Relu6 (CudaConvolution) [10/07/2020-14:48:22] [V] [TRT] Tactic: 0 time 0.168508 [10/07/2020-14:48:22] [V] [TRT] Tactic: 2 time 0.37804 [10/07/2020-14:48:22] [V] [TRT] Tactic: 5 skipped. Scratch requested: 37392384, available: 16777216 [10/07/2020-14:48:22] [V] [TRT] Tactic: 57 time 0.17626 [10/07/2020-14:48:22] [V] [TRT] Fastest Tactic: 0 Time: 0.168508 [10/07/2020-14:48:22] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/Relu6 (CudaDepthwiseConvolution) [10/07/2020-14:48:22] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [10/07/2020-14:48:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 3997695 [10/07/2020-14:48:22] [V] [TRT] [10/07/2020-14:48:22] [V] [TRT] *************** Autotuning format combination: Float(1,10,100,25600) -> Float(1,5,25,12800) *************** [10/07/2020-14:48:22] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:22] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [10/07/2020-14:48:22] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:22] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [10/07/2020-14:48:22] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:22] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:22] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:22] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:22] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/Relu6 (FusedConvActConvolution) [10/07/2020-14:48:22] [V] [TRT] Tactic: 458751 time 0.46382 [10/07/2020-14:48:22] [V] [TRT] Fastest Tactic: 458751 Time: 0.46382 [10/07/2020-14:48:22] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/Relu6 (CaskConvolution) [10/07/2020-14:48:22] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:22] [V] [TRT] Tactic: 1825138533642645384 time 0.68914 [10/07/2020-14:48:22] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [10/07/2020-14:48:22] [V] [TRT] Tactic: 2842488832350522458 time 0.488308 [10/07/2020-14:48:22] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:22] [V] [TRT] Tactic: 3915320020053085238 time 0.676356 [10/07/2020-14:48:22] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [10/07/2020-14:48:22] [V] [TRT] Tactic: 6448355332020552203 time 0.688076 [10/07/2020-14:48:22] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:22] [V] [TRT] Tactic: 6808617066150061604 time 0.435396 [10/07/2020-14:48:22] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:22] [V] [TRT] Tactic: -8060443123034038864 time 0.4801 [10/07/2020-14:48:22] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:22] [V] [TRT] Tactic: -4420849921117327522 time 0.623232 [10/07/2020-14:48:22] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:22] [V] [TRT] Tactic: -3946921629105938337 time 0.781224 [10/07/2020-14:48:22] [V] [TRT] Fastest Tactic: 6808617066150061604 Time: 0.435396 [10/07/2020-14:48:22] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/Relu6 (CudaConvolution) [10/07/2020-14:48:22] [V] [TRT] Tactic: 0 time 0.336244 [10/07/2020-14:48:22] [V] [TRT] Tactic: 2 time 0.368064 [10/07/2020-14:48:22] [V] [TRT] Tactic: 5 skipped. Scratch requested: 573891584, available: 16777216 [10/07/2020-14:48:22] [V] [TRT] Tactic: 57 time 0.853072 [10/07/2020-14:48:22] [V] [TRT] Fastest Tactic: 0 Time: 0.336244 [10/07/2020-14:48:22] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/Relu6 (CudaDepthwiseConvolution) [10/07/2020-14:48:22] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [10/07/2020-14:48:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 0 [10/07/2020-14:48:22] [V] [TRT] [10/07/2020-14:48:22] [V] [TRT] *************** Autotuning format combination: Float(1,5,25,12800) -> Float(1,5,25,14250) *************** [10/07/2020-14:48:22] [V] [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:48:22] [V] [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:22] [V] [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:48:22] [V] [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:22] [V] [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:22] [V] [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:22] [V] [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:22] [V] [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:22] [V] [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:22] [V] [TRT] --------------- Timing Runner: BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D (FusedConvActConvolution) [10/07/2020-14:48:22] [V] [TRT] Tactic: 589823 time 0.401812 [10/07/2020-14:48:22] [V] [TRT] Tactic: 786431 time 0.085572 [10/07/2020-14:48:22] [V] [TRT] Tactic: 1179647 time 0.089144 [10/07/2020-14:48:22] [V] [TRT] Tactic: 1310719 time 0.231072 [10/07/2020-14:48:22] [V] [TRT] Tactic: 1376255 time 0.273852 [10/07/2020-14:48:22] [V] [TRT] Tactic: 1441791 time 0.13982 [10/07/2020-14:48:22] [V] [TRT] Tactic: 1638399 time 0.120048 [10/07/2020-14:48:22] [V] [TRT] Tactic: 1835007 time 0.085504 [10/07/2020-14:48:22] [V] [TRT] Tactic: 2097151 time 0.089704 [10/07/2020-14:48:22] [V] [TRT] Tactic: 2162687 time 0.269364 [10/07/2020-14:48:22] [V] [TRT] Tactic: 2293759 time 0.258472 [10/07/2020-14:48:22] [V] [TRT] Tactic: 2359295 time 0.153872 [10/07/2020-14:48:22] [V] [TRT] Tactic: 2686975 time 0.258112 [10/07/2020-14:48:22] [V] [TRT] Tactic: 3407871 time 0.139672 [10/07/2020-14:48:22] [V] [TRT] Tactic: 3538943 time 0.082044 [10/07/2020-14:48:22] [V] [TRT] Tactic: 3997695 time 0.05562 [10/07/2020-14:48:22] [V] [TRT] Tactic: 4194303 time 0.093192 [10/07/2020-14:48:22] [V] [TRT] Tactic: 4259839 time 0.096416 [10/07/2020-14:48:22] [V] [TRT] Tactic: 4325375 time 0.080708 [10/07/2020-14:48:22] [V] [TRT] Tactic: 4521983 time 0.239288 [10/07/2020-14:48:22] [V] [TRT] Tactic: 4587519 time 0.071324 [10/07/2020-14:48:23] [V] [TRT] Tactic: 4653055 time 0.077588 [10/07/2020-14:48:23] [V] [TRT] Tactic: 4915199 time 0.07226 [10/07/2020-14:48:23] [V] [TRT] Tactic: 4980735 time 0.130536 [10/07/2020-14:48:23] [V] [TRT] Tactic: 5177343 time 0.095448 [10/07/2020-14:48:23] [V] [TRT] Tactic: 5242879 time 0.133032 [10/07/2020-14:48:23] [V] [TRT] Tactic: 5373951 time 0.090084 [10/07/2020-14:48:23] [V] [TRT] Tactic: 5439487 time 0.089328 [10/07/2020-14:48:23] [V] [TRT] Tactic: 5701631 time 0.250112 [10/07/2020-14:48:23] [V] [TRT] Tactic: 5767167 time 0.130952 [10/07/2020-14:48:23] [V] [TRT] Tactic: 5832703 time 0.140348 [10/07/2020-14:48:23] [V] [TRT] Tactic: 5898239 time 0.097568 [10/07/2020-14:48:23] [V] [TRT] Tactic: 6029311 time 0.243252 [10/07/2020-14:48:23] [V] [TRT] Tactic: 6225919 time 0.07778 [10/07/2020-14:48:23] [V] [TRT] Tactic: 6291455 time 0.089496 [10/07/2020-14:48:23] [V] [TRT] Tactic: 6750207 time 0.067884 [10/07/2020-14:48:23] [V] [TRT] Tactic: 6815743 time 0.132008 [10/07/2020-14:48:23] [V] [TRT] Tactic: 6946815 time 0.085212 [10/07/2020-14:48:23] [V] [TRT] Tactic: 7012351 time 0.088724 [10/07/2020-14:48:23] [V] [TRT] Tactic: 7077887 time 0.083656 [10/07/2020-14:48:23] [V] [TRT] Tactic: 7143423 time 0.129376 [10/07/2020-14:48:23] [V] [TRT] Tactic: 7208959 time 0.143628 [10/07/2020-14:48:23] [V] [TRT] Tactic: 7340031 time 0.098708 [10/07/2020-14:48:23] [V] [TRT] Tactic: 7405567 time 0.076196 [10/07/2020-14:48:23] [V] [TRT] Tactic: 7536639 time 0.221004 [10/07/2020-14:48:23] [V] [TRT] Tactic: 7602175 time 0.08518 [10/07/2020-14:48:23] [V] [TRT] Tactic: 7733247 time 0.08992 [10/07/2020-14:48:23] [V] [TRT] Tactic: 7798783 time 0.085212 [10/07/2020-14:48:23] [V] [TRT] Tactic: 8191999 time 0.085292 [10/07/2020-14:48:23] [V] [TRT] Tactic: 8257535 time 0.095732 [10/07/2020-14:48:23] [V] [TRT] Tactic: 8323071 time 0.090524 [10/07/2020-14:48:23] [V] [TRT] Tactic: 8650751 time 0.092544 [10/07/2020-14:48:23] [V] [TRT] Tactic: 8716287 time 0.080824 [10/07/2020-14:48:23] [V] [TRT] Tactic: 9109503 time 0.092496 [10/07/2020-14:48:23] [V] [TRT] Tactic: 9568255 time 0.072852 [10/07/2020-14:48:23] [V] [TRT] Tactic: 9895935 time 0.093124 [10/07/2020-14:48:23] [V] [TRT] Tactic: 10223615 time 0.257924 [10/07/2020-14:48:23] [V] [TRT] Tactic: 10354687 time 0.09322 [10/07/2020-14:48:23] [V] [TRT] Tactic: 10551295 time 0.13806 [10/07/2020-14:48:23] [V] [TRT] Tactic: 10747903 time 0.088216 [10/07/2020-14:48:23] [V] [TRT] Tactic: 10944511 time 0.13052 [10/07/2020-14:48:23] [V] [TRT] Fastest Tactic: 3997695 Time: 0.05562 [10/07/2020-14:48:23] [V] [TRT] --------------- Timing Runner: BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D (CaskConvolution) [10/07/2020-14:48:23] [V] [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:48:23] [V] [TRT] Tactic: 1754569683116234317 time 0.1621 [10/07/2020-14:48:23] [V] [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:23] [V] [TRT] Tactic: 1825138533642645384 time 0.163736 [10/07/2020-14:48:23] [V] [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:48:23] [V] [TRT] Tactic: 2733356012094739613 time 0.180808 [10/07/2020-14:48:23] [V] [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:23] [V] [TRT] Tactic: 3915320020053085238 time 0.163576 [10/07/2020-14:48:23] [V] [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:23] [V] [TRT] Tactic: 6808617066150061604 time 0.167512 [10/07/2020-14:48:23] [V] [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:23] [V] [TRT] Tactic: 9091006216302412844 time 0.161992 [10/07/2020-14:48:23] [V] [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:23] [V] [TRT] Tactic: -8060443123034038864 time 0.170376 [10/07/2020-14:48:23] [V] [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:23] [V] [TRT] Tactic: -4420849921117327522 time 0.15082 [10/07/2020-14:48:23] [V] [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:23] [V] [TRT] Tactic: -3946921629105938337 time 0.200012 [10/07/2020-14:48:23] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.15082 [10/07/2020-14:48:23] [V] [TRT] --------------- Timing Runner: BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D (CudaConvolution) [10/07/2020-14:48:23] [V] [TRT] Tactic: 0 time 0.086576 [10/07/2020-14:48:23] [V] [TRT] Tactic: 2 time 0.295456 [10/07/2020-14:48:23] [V] [TRT] Tactic: 5 skipped. Scratch requested: 40426496, available: 16777216 [10/07/2020-14:48:23] [V] [TRT] Tactic: 57 time 0.458296 [10/07/2020-14:48:23] [V] [TRT] Fastest Tactic: 0 Time: 0.086576 [10/07/2020-14:48:23] [V] [TRT] --------------- Timing Runner: BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D (CudaDepthwiseConvolution) [10/07/2020-14:48:23] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [10/07/2020-14:48:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 3997695 [10/07/2020-14:48:23] [V] [TRT] [10/07/2020-14:48:23] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:23] [V] [TRT] Tactic: 1002 time 0.014772 [10/07/2020-14:48:23] [V] [TRT] Tactic: 0 time 0.012628 [10/07/2020-14:48:23] [V] [TRT] Fastest Tactic: 0 Time: 0.012628 [10/07/2020-14:48:23] [V] [TRT] *************** Autotuning format combination: Float(1,5,25,12800) -> Float(1,5,25,3200) *************** [10/07/2020-14:48:23] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:48:23] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:23] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:48:23] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:23] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:23] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:23] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:23] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:23] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:23] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/Relu6 (FusedConvActConvolution) [10/07/2020-14:48:23] [V] [TRT] Tactic: 589823 time 0.166808 [10/07/2020-14:48:23] [V] [TRT] Tactic: 655359 time 0.137396 [10/07/2020-14:48:23] [V] [TRT] Tactic: 786431 time 0.046468 [10/07/2020-14:48:24] [V] [TRT] Tactic: 851967 time 0.050772 [10/07/2020-14:48:24] [V] [TRT] Tactic: 1179647 time 0.029512 [10/07/2020-14:48:24] [V] [TRT] Tactic: 1310719 time 0.149852 [10/07/2020-14:48:24] [V] [TRT] Tactic: 1376255 time 0.147812 [10/07/2020-14:48:24] [V] [TRT] Tactic: 1441791 time 0.035872 [10/07/2020-14:48:24] [V] [TRT] Tactic: 1507327 time 0.080228 [10/07/2020-14:48:24] [V] [TRT] Tactic: 1638399 time 0.029744 [10/07/2020-14:48:24] [V] [TRT] Tactic: 1835007 time 0.04434 [10/07/2020-14:48:24] [V] [TRT] Tactic: 1900543 time 0.15384 [10/07/2020-14:48:24] [V] [TRT] Tactic: 2097151 time 0.02324 [10/07/2020-14:48:24] [V] [TRT] Tactic: 2162687 time 0.143592 [10/07/2020-14:48:24] [V] [TRT] Tactic: 2293759 time 0.130948 [10/07/2020-14:48:24] [V] [TRT] Tactic: 2359295 time 0.0846 [10/07/2020-14:48:24] [V] [TRT] Tactic: 2686975 time 0.131076 [10/07/2020-14:48:24] [V] [TRT] Tactic: 3080191 time 0.069704 [10/07/2020-14:48:24] [V] [TRT] Tactic: 3342335 time 0.082332 [10/07/2020-14:48:24] [V] [TRT] Tactic: 3407871 time 0.069892 [10/07/2020-14:48:24] [V] [TRT] Tactic: 3538943 time 0.039156 [10/07/2020-14:48:24] [V] [TRT] Tactic: 3670015 time 0.264088 [10/07/2020-14:48:24] [V] [TRT] Tactic: 3932159 time 0.100044 [10/07/2020-14:48:24] [V] [TRT] Tactic: 3997695 time 0.027416 [10/07/2020-14:48:24] [V] [TRT] Tactic: 4063231 time 0.046332 [10/07/2020-14:48:24] [V] [TRT] Tactic: 4194303 time 0.05052 [10/07/2020-14:48:24] [V] [TRT] Tactic: 4259839 time 0.025408 [10/07/2020-14:48:24] [V] [TRT] Tactic: 4325375 time 0.035864 [10/07/2020-14:48:24] [V] [TRT] Tactic: 4521983 time 0.119404 [10/07/2020-14:48:24] [V] [TRT] Tactic: 4587519 time 0.029512 [10/07/2020-14:48:24] [V] [TRT] Tactic: 4653055 time 0.035076 [10/07/2020-14:48:24] [V] [TRT] Tactic: 4915199 time 0.029588 [10/07/2020-14:48:24] [V] [TRT] Tactic: 4980735 time 0.063372 [10/07/2020-14:48:24] [V] [TRT] Tactic: 5177343 time 0.029848 [10/07/2020-14:48:24] [V] [TRT] Tactic: 5242879 time 0.0636 [10/07/2020-14:48:24] [V] [TRT] Tactic: 5373951 time 0.029496 [10/07/2020-14:48:24] [V] [TRT] Tactic: 5439487 time 0.048444 [10/07/2020-14:48:24] [V] [TRT] Tactic: 5570559 time 0.078092 [10/07/2020-14:48:24] [V] [TRT] Tactic: 5636095 time 0.046764 [10/07/2020-14:48:24] [V] [TRT] Tactic: 5701631 time 0.12246 [10/07/2020-14:48:24] [V] [TRT] Tactic: 5767167 time 0.05896 [10/07/2020-14:48:24] [V] [TRT] Tactic: 5832703 time 0.071792 [10/07/2020-14:48:24] [V] [TRT] Tactic: 5898239 time 0.035784 [10/07/2020-14:48:24] [V] [TRT] Tactic: 6029311 time 0.116188 [10/07/2020-14:48:24] [V] [TRT] Tactic: 6225919 time 0.035764 [10/07/2020-14:48:24] [V] [TRT] Tactic: 6291455 time 0.02948 [10/07/2020-14:48:24] [V] [TRT] Tactic: 6422527 time 0.059456 [10/07/2020-14:48:24] [V] [TRT] Tactic: 6750207 time 0.030544 [10/07/2020-14:48:24] [V] [TRT] Tactic: 6815743 time 0.063568 [10/07/2020-14:48:24] [V] [TRT] Tactic: 6946815 time 0.042204 [10/07/2020-14:48:24] [V] [TRT] Tactic: 7012351 time 0.023292 [10/07/2020-14:48:24] [V] [TRT] Tactic: 7077887 time 0.040208 [10/07/2020-14:48:24] [V] [TRT] Tactic: 7143423 time 0.059184 [10/07/2020-14:48:24] [V] [TRT] Tactic: 7208959 time 0.071832 [10/07/2020-14:48:24] [V] [TRT] Tactic: 7340031 time 0.035996 [10/07/2020-14:48:24] [V] [TRT] Tactic: 7405567 time 0.035916 [10/07/2020-14:48:24] [V] [TRT] Tactic: 7536639 time 0.092948 [10/07/2020-14:48:24] [V] [TRT] Tactic: 7602175 time 0.044812 [10/07/2020-14:48:24] [V] [TRT] Tactic: 7733247 time 0.046492 [10/07/2020-14:48:24] [V] [TRT] Tactic: 7798783 time 0.046364 [10/07/2020-14:48:24] [V] [TRT] Tactic: 8191999 time 0.03984 [10/07/2020-14:48:24] [V] [TRT] Tactic: 8257535 time 0.029524 [10/07/2020-14:48:25] [V] [TRT] Tactic: 8323071 time 0.051096 [10/07/2020-14:48:25] [V] [TRT] Tactic: 8650751 time 0.04604 [10/07/2020-14:48:25] [V] [TRT] Tactic: 8716287 time 0.03804 [10/07/2020-14:48:25] [V] [TRT] Tactic: 9109503 time 0.023212 [10/07/2020-14:48:25] [V] [TRT] Tactic: 9568255 time 0.029516 [10/07/2020-14:48:25] [V] [TRT] Tactic: 9895935 time 0.050576 [10/07/2020-14:48:25] [V] [TRT] Tactic: 10223615 time 0.131004 [10/07/2020-14:48:25] [V] [TRT] Tactic: 10354687 time 0.029304 [10/07/2020-14:48:25] [V] [TRT] Tactic: 10551295 time 0.071716 [10/07/2020-14:48:25] [V] [TRT] Tactic: 10747903 time 0.044236 [10/07/2020-14:48:25] [V] [TRT] Tactic: 10944511 time 0.063428 [10/07/2020-14:48:25] [V] [TRT] Fastest Tactic: 9109503 Time: 0.023212 [10/07/2020-14:48:25] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/Relu6 (CaskConvolution) [10/07/2020-14:48:25] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:48:25] [V] [TRT] Tactic: 1754569683116234317 time 0.16044 [10/07/2020-14:48:25] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:25] [V] [TRT] Tactic: 1825138533642645384 time 0.161556 [10/07/2020-14:48:25] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:48:25] [V] [TRT] Tactic: 2733356012094739613 time 0.103872 [10/07/2020-14:48:25] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:25] [V] [TRT] Tactic: 3915320020053085238 time 0.16066 [10/07/2020-14:48:25] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:25] [V] [TRT] Tactic: 6808617066150061604 time 0.097352 [10/07/2020-14:48:25] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:25] [V] [TRT] Tactic: 9091006216302412844 time 0.0937 [10/07/2020-14:48:25] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:25] [V] [TRT] Tactic: -8060443123034038864 time 0.101612 [10/07/2020-14:48:25] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:25] [V] [TRT] Tactic: -4420849921117327522 time 0.08028 [10/07/2020-14:48:25] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:25] [V] [TRT] Tactic: -3946921629105938337 time 0.105988 [10/07/2020-14:48:25] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.08028 [10/07/2020-14:48:25] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/Relu6 (CudaConvolution) [10/07/2020-14:48:25] [V] [TRT] Tactic: 0 time 0.062724 [10/07/2020-14:48:25] [V] [TRT] Tactic: 2 time 0.1602 [10/07/2020-14:48:25] [V] [TRT] Tactic: 5 time 0.706892 [10/07/2020-14:48:25] [V] [TRT] Tactic: 57 time 0.431956 [10/07/2020-14:48:25] [V] [TRT] Fastest Tactic: 0 Time: 0.062724 [10/07/2020-14:48:25] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/Relu6 (CudaDepthwiseConvolution) [10/07/2020-14:48:25] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [10/07/2020-14:48:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 9109503 [10/07/2020-14:48:25] [V] [TRT] [10/07/2020-14:48:25] [V] [TRT] *************** Autotuning format combination: Float(1,5,25,3200) -> Float(1,3,9,2304) *************** [10/07/2020-14:48:25] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:25] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [10/07/2020-14:48:25] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:25] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [10/07/2020-14:48:25] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:25] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:25] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:25] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:25] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/Relu6 (FusedConvActConvolution) [10/07/2020-14:48:25] [V] [TRT] Tactic: 458751 time 0.233276 [10/07/2020-14:48:25] [V] [TRT] Fastest Tactic: 458751 Time: 0.233276 [10/07/2020-14:48:25] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/Relu6 (CaskConvolution) [10/07/2020-14:48:25] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:25] [V] [TRT] Tactic: 1825138533642645384 time 0.353452 [10/07/2020-14:48:25] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [10/07/2020-14:48:25] [V] [TRT] Tactic: 2842488832350522458 time 0.261852 [10/07/2020-14:48:25] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:25] [V] [TRT] Tactic: 3915320020053085238 time 0.3465 [10/07/2020-14:48:25] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [10/07/2020-14:48:25] [V] [TRT] Tactic: 6448355332020552203 time 0.358084 [10/07/2020-14:48:25] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:25] [V] [TRT] Tactic: 6808617066150061604 time 0.220532 [10/07/2020-14:48:25] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:25] [V] [TRT] Tactic: -8060443123034038864 time 0.256932 [10/07/2020-14:48:25] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:25] [V] [TRT] Tactic: -4420849921117327522 time 0.300436 [10/07/2020-14:48:25] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:25] [V] [TRT] Tactic: -3946921629105938337 time 0.3419 [10/07/2020-14:48:25] [V] [TRT] Fastest Tactic: 6808617066150061604 Time: 0.220532 [10/07/2020-14:48:25] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/Relu6 (CudaConvolution) [10/07/2020-14:48:25] [V] [TRT] Tactic: 0 time 0.16336 [10/07/2020-14:48:25] [V] [TRT] Tactic: 2 time 0.214928 [10/07/2020-14:48:25] [V] [TRT] Tactic: 5 skipped. Scratch requested: 144277504, available: 16777216 [10/07/2020-14:48:25] [V] [TRT] Tactic: 57 time 0.762532 [10/07/2020-14:48:25] [V] [TRT] Fastest Tactic: 0 Time: 0.16336 [10/07/2020-14:48:25] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/Relu6 (CudaDepthwiseConvolution) [10/07/2020-14:48:25] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [10/07/2020-14:48:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 0 [10/07/2020-14:48:25] [V] [TRT] [10/07/2020-14:48:25] [V] [TRT] *************** Autotuning format combination: Float(1,3,9,2304) -> Float(1,3,9,5130) *************** [10/07/2020-14:48:25] [V] [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:48:25] [V] [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:25] [V] [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:48:25] [V] [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:25] [V] [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:25] [V] [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:25] [V] [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:25] [V] [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:25] [V] [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:25] [V] [TRT] --------------- Timing Runner: BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D (FusedConvActConvolution) [10/07/2020-14:48:25] [V] [TRT] Tactic: 589823 time 0.199716 [10/07/2020-14:48:25] [V] [TRT] Tactic: 786431 time 0.04524 [10/07/2020-14:48:25] [V] [TRT] Tactic: 1179647 time 0.030416 [10/07/2020-14:48:25] [V] [TRT] Tactic: 1310719 time 0.111284 [10/07/2020-14:48:25] [V] [TRT] Tactic: 1376255 time 0.139252 [10/07/2020-14:48:25] [V] [TRT] Tactic: 1441791 time 0.051788 [10/07/2020-14:48:25] [V] [TRT] Tactic: 1638399 time 0.036848 [10/07/2020-14:48:25] [V] [TRT] Tactic: 1835007 time 0.043132 [10/07/2020-14:48:25] [V] [TRT] Tactic: 2097151 time 0.034716 [10/07/2020-14:48:25] [V] [TRT] Tactic: 2162687 time 0.137568 [10/07/2020-14:48:25] [V] [TRT] Tactic: 2293759 time 0.130924 [10/07/2020-14:48:25] [V] [TRT] Tactic: 2359295 time 0.078704 [10/07/2020-14:48:25] [V] [TRT] Tactic: 2686975 time 0.130804 [10/07/2020-14:48:25] [V] [TRT] Tactic: 3407871 time 0.071044 [10/07/2020-14:48:25] [V] [TRT] Tactic: 3538943 time 0.041532 [10/07/2020-14:48:25] [V] [TRT] Tactic: 3997695 time 0.030484 [10/07/2020-14:48:25] [V] [TRT] Tactic: 4194303 time 0.0474 [10/07/2020-14:48:25] [V] [TRT] Tactic: 4259839 time 0.036856 [10/07/2020-14:48:25] [V] [TRT] Tactic: 4325375 time 0.04024 [10/07/2020-14:48:25] [V] [TRT] Tactic: 4521983 time 0.122096 [10/07/2020-14:48:25] [V] [TRT] Tactic: 4587519 time 0.0322 [10/07/2020-14:48:25] [V] [TRT] Tactic: 4653055 time 0.033652 [10/07/2020-14:48:25] [V] [TRT] Tactic: 4915199 time 0.032404 [10/07/2020-14:48:25] [V] [TRT] Tactic: 4980735 time 0.067984 [10/07/2020-14:48:25] [V] [TRT] Tactic: 5177343 time 0.028236 [10/07/2020-14:48:25] [V] [TRT] Tactic: 5242879 time 0.066756 [10/07/2020-14:48:25] [V] [TRT] Tactic: 5373951 time 0.030444 [10/07/2020-14:48:25] [V] [TRT] Tactic: 5439487 time 0.045312 [10/07/2020-14:48:25] [V] [TRT] Tactic: 5701631 time 0.126412 [10/07/2020-14:48:25] [V] [TRT] Tactic: 5767167 time 0.064404 [10/07/2020-14:48:26] [V] [TRT] Tactic: 5832703 time 0.07106 [10/07/2020-14:48:26] [V] [TRT] Tactic: 5898239 time 0.033824 [10/07/2020-14:48:26] [V] [TRT] Tactic: 6029311 time 0.122768 [10/07/2020-14:48:26] [V] [TRT] Tactic: 6225919 time 0.03932 [10/07/2020-14:48:26] [V] [TRT] Tactic: 6291455 time 0.030636 [10/07/2020-14:48:26] [V] [TRT] Tactic: 6750207 time 0.030488 [10/07/2020-14:48:26] [V] [TRT] Tactic: 6815743 time 0.06672 [10/07/2020-14:48:26] [V] [TRT] Tactic: 6946815 time 0.043604 [10/07/2020-14:48:26] [V] [TRT] Tactic: 7012351 time 0.034632 [10/07/2020-14:48:26] [V] [TRT] Tactic: 7077887 time 0.041652 [10/07/2020-14:48:26] [V] [TRT] Tactic: 7143423 time 0.06434 [10/07/2020-14:48:26] [V] [TRT] Tactic: 7208959 time 0.07108 [10/07/2020-14:48:26] [V] [TRT] Tactic: 7340031 time 0.033792 [10/07/2020-14:48:26] [V] [TRT] Tactic: 7405567 time 0.039128 [10/07/2020-14:48:26] [V] [TRT] Tactic: 7536639 time 0.110884 [10/07/2020-14:48:26] [V] [TRT] Tactic: 7602175 time 0.043464 [10/07/2020-14:48:26] [V] [TRT] Tactic: 7733247 time 0.044164 [10/07/2020-14:48:26] [V] [TRT] Tactic: 7798783 time 0.045336 [10/07/2020-14:48:26] [V] [TRT] Tactic: 8191999 time 0.040864 [10/07/2020-14:48:26] [V] [TRT] Tactic: 8257535 time 0.031812 [10/07/2020-14:48:26] [V] [TRT] Tactic: 8323071 time 0.045304 [10/07/2020-14:48:26] [V] [TRT] Tactic: 8650751 time 0.042176 [10/07/2020-14:48:26] [V] [TRT] Tactic: 8716287 time 0.041016 [10/07/2020-14:48:26] [V] [TRT] Tactic: 9109503 time 0.034612 [10/07/2020-14:48:26] [V] [TRT] Tactic: 9568255 time 0.032376 [10/07/2020-14:48:26] [V] [TRT] Tactic: 9895935 time 0.047524 [10/07/2020-14:48:26] [V] [TRT] Tactic: 10223615 time 0.130848 [10/07/2020-14:48:26] [V] [TRT] Tactic: 10354687 time 0.033344 [10/07/2020-14:48:26] [V] [TRT] Tactic: 10551295 time 0.06958 [10/07/2020-14:48:26] [V] [TRT] Tactic: 10747903 time 0.043328 [10/07/2020-14:48:26] [V] [TRT] Tactic: 10944511 time 0.06718 [10/07/2020-14:48:26] [V] [TRT] Fastest Tactic: 5177343 Time: 0.028236 [10/07/2020-14:48:26] [V] [TRT] --------------- Timing Runner: BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D (CaskConvolution) [10/07/2020-14:48:26] [V] [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:48:26] [V] [TRT] Tactic: 1754569683116234317 time 0.088932 [10/07/2020-14:48:26] [V] [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:26] [V] [TRT] Tactic: 1825138533642645384 time 0.090248 [10/07/2020-14:48:26] [V] [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:48:26] [V] [TRT] Tactic: 2733356012094739613 time 0.097732 [10/07/2020-14:48:26] [V] [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:26] [V] [TRT] Tactic: 3915320020053085238 time 0.090244 [10/07/2020-14:48:26] [V] [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:26] [V] [TRT] Tactic: 6808617066150061604 time 0.0948 [10/07/2020-14:48:26] [V] [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:26] [V] [TRT] Tactic: 9091006216302412844 time 0.090992 [10/07/2020-14:48:26] [V] [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:26] [V] [TRT] Tactic: -8060443123034038864 time 0.097508 [10/07/2020-14:48:26] [V] [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:26] [V] [TRT] Tactic: -4420849921117327522 time 0.081792 [10/07/2020-14:48:26] [V] [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:26] [V] [TRT] Tactic: -3946921629105938337 time 0.103204 [10/07/2020-14:48:26] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.081792 [10/07/2020-14:48:26] [V] [TRT] --------------- Timing Runner: BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D (CudaConvolution) [10/07/2020-14:48:26] [V] [TRT] Tactic: 0 time 0.050836 [10/07/2020-14:48:26] [V] [TRT] Tactic: 2 time 0.227644 [10/07/2020-14:48:26] [V] [TRT] Tactic: 5 skipped. Scratch requested: 20182528, available: 16777216 [10/07/2020-14:48:26] [V] [TRT] Tactic: 57 time 0.06078 [10/07/2020-14:48:26] [V] [TRT] Fastest Tactic: 0 Time: 0.050836 [10/07/2020-14:48:26] [V] [TRT] --------------- Timing Runner: BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D (CudaDepthwiseConvolution) [10/07/2020-14:48:26] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [10/07/2020-14:48:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 5177343 [10/07/2020-14:48:26] [V] [TRT] [10/07/2020-14:48:26] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:26] [V] [TRT] Tactic: 1002 time 0.014572 [10/07/2020-14:48:26] [V] [TRT] Tactic: 0 time 0.006828 [10/07/2020-14:48:26] [V] [TRT] Fastest Tactic: 0 Time: 0.006828 [10/07/2020-14:48:26] [V] [TRT] *************** Autotuning format combination: Float(1,3,9,2304) -> Float(1,3,9,1152) *************** [10/07/2020-14:48:26] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:48:26] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:26] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:48:26] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:26] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:26] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:26] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:26] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:26] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:26] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/Relu6 (FusedConvActConvolution) [10/07/2020-14:48:26] [V] [TRT] Tactic: 589823 time 0.086952 [10/07/2020-14:48:26] [V] [TRT] Tactic: 655359 time 0.071872 [10/07/2020-14:48:26] [V] [TRT] Tactic: 786431 time 0.027348 [10/07/2020-14:48:26] [V] [TRT] Tactic: 851967 time 0.02824 [10/07/2020-14:48:26] [V] [TRT] Tactic: 1179647 time 0.017192 [10/07/2020-14:48:26] [V] [TRT] Tactic: 1310719 time 0.080132 [10/07/2020-14:48:26] [V] [TRT] Tactic: 1376255 time 0.078148 [10/07/2020-14:48:26] [V] [TRT] Tactic: 1441791 time 0.0211 [10/07/2020-14:48:26] [V] [TRT] Tactic: 1507327 time 0.044452 [10/07/2020-14:48:26] [V] [TRT] Tactic: 1638399 time 0.01906 [10/07/2020-14:48:26] [V] [TRT] Tactic: 1835007 time 0.025336 [10/07/2020-14:48:26] [V] [TRT] Tactic: 1900543 time 0.07814 [10/07/2020-14:48:26] [V] [TRT] Tactic: 2097151 time 0.014696 [10/07/2020-14:48:26] [V] [TRT] Tactic: 2162687 time 0.076016 [10/07/2020-14:48:26] [V] [TRT] Tactic: 2293759 time 0.069788 [10/07/2020-14:48:26] [V] [TRT] Tactic: 2359295 time 0.046428 [10/07/2020-14:48:26] [V] [TRT] Tactic: 2686975 time 0.0698 [10/07/2020-14:48:26] [V] [TRT] Tactic: 3080191 time 0.038024 [10/07/2020-14:48:26] [V] [TRT] Tactic: 3342335 time 0.04438 [10/07/2020-14:48:26] [V] [TRT] Tactic: 3407871 time 0.038088 [10/07/2020-14:48:26] [V] [TRT] Tactic: 3538943 time 0.023236 [10/07/2020-14:48:26] [V] [TRT] Tactic: 3670015 time 0.13524 [10/07/2020-14:48:27] [V] [TRT] Tactic: 3932159 time 0.052708 [10/07/2020-14:48:27] [V] [TRT] Tactic: 3997695 time 0.016824 [10/07/2020-14:48:27] [V] [TRT] Tactic: 4063231 time 0.0275 [10/07/2020-14:48:27] [V] [TRT] Tactic: 4194303 time 0.029336 [10/07/2020-14:48:27] [V] [TRT] Tactic: 4259839 time 0.016848 [10/07/2020-14:48:27] [V] [TRT] Tactic: 4325375 time 0.021088 [10/07/2020-14:48:27] [V] [TRT] Tactic: 4521983 time 0.064592 [10/07/2020-14:48:27] [V] [TRT] Tactic: 4587519 time 0.018788 [10/07/2020-14:48:27] [V] [TRT] Tactic: 4653055 time 0.021232 [10/07/2020-14:48:27] [V] [TRT] Tactic: 4915199 time 0.018968 [10/07/2020-14:48:27] [V] [TRT] Tactic: 4980735 time 0.035932 [10/07/2020-14:48:27] [V] [TRT] Tactic: 5177343 time 0.017408 [10/07/2020-14:48:27] [V] [TRT] Tactic: 5242879 time 0.034032 [10/07/2020-14:48:27] [V] [TRT] Tactic: 5373951 time 0.017408 [10/07/2020-14:48:27] [V] [TRT] Tactic: 5439487 time 0.02752 [10/07/2020-14:48:27] [V] [TRT] Tactic: 5570559 time 0.042256 [10/07/2020-14:48:27] [V] [TRT] Tactic: 5636095 time 0.027572 [10/07/2020-14:48:27] [V] [TRT] Tactic: 5701631 time 0.065564 [10/07/2020-14:48:27] [V] [TRT] Tactic: 5767167 time 0.032788 [10/07/2020-14:48:27] [V] [TRT] Tactic: 5832703 time 0.040168 [10/07/2020-14:48:27] [V] [TRT] Tactic: 5898239 time 0.021208 [10/07/2020-14:48:27] [V] [TRT] Tactic: 6029311 time 0.062148 [10/07/2020-14:48:27] [V] [TRT] Tactic: 6225919 time 0.021116 [10/07/2020-14:48:27] [V] [TRT] Tactic: 6291455 time 0.017 [10/07/2020-14:48:27] [V] [TRT] Tactic: 6422527 time 0.033552 [10/07/2020-14:48:27] [V] [TRT] Tactic: 6750207 time 0.016952 [10/07/2020-14:48:27] [V] [TRT] Tactic: 6815743 time 0.033792 [10/07/2020-14:48:27] [V] [TRT] Tactic: 6946815 time 0.024164 [10/07/2020-14:48:27] [V] [TRT] Tactic: 7012351 time 0.0147 [10/07/2020-14:48:27] [V] [TRT] Tactic: 7077887 time 0.02318 [10/07/2020-14:48:27] [V] [TRT] Tactic: 7143423 time 0.033284 [10/07/2020-14:48:27] [V] [TRT] Tactic: 7208959 time 0.039984 [10/07/2020-14:48:27] [V] [TRT] Tactic: 7340031 time 0.02102 [10/07/2020-14:48:27] [V] [TRT] Tactic: 7405567 time 0.021036 [10/07/2020-14:48:27] [V] [TRT] Tactic: 7536639 time 0.048576 [10/07/2020-14:48:27] [V] [TRT] Tactic: 7602175 time 0.023908 [10/07/2020-14:48:27] [V] [TRT] Tactic: 7733247 time 0.025724 [10/07/2020-14:48:27] [V] [TRT] Tactic: 7798783 time 0.027436 [10/07/2020-14:48:27] [V] [TRT] Tactic: 8191999 time 0.022148 [10/07/2020-14:48:27] [V] [TRT] Tactic: 8257535 time 0.019064 [10/07/2020-14:48:27] [V] [TRT] Tactic: 8323071 time 0.0274 [10/07/2020-14:48:27] [V] [TRT] Tactic: 8650751 time 0.024108 [10/07/2020-14:48:27] [V] [TRT] Tactic: 8716287 time 0.023076 [10/07/2020-14:48:27] [V] [TRT] Tactic: 9109503 time 0.01458 [10/07/2020-14:48:27] [V] [TRT] Tactic: 9568255 time 0.019012 [10/07/2020-14:48:27] [V] [TRT] Tactic: 9895935 time 0.028972 [10/07/2020-14:48:27] [V] [TRT] Tactic: 10223615 time 0.069676 [10/07/2020-14:48:27] [V] [TRT] Tactic: 10354687 time 0.017872 [10/07/2020-14:48:27] [V] [TRT] Tactic: 10551295 time 0.04018 [10/07/2020-14:48:27] [V] [TRT] Tactic: 10747903 time 0.025308 [10/07/2020-14:48:27] [V] [TRT] Tactic: 10944511 time 0.035948 [10/07/2020-14:48:27] [V] [TRT] Fastest Tactic: 9109503 Time: 0.01458 [10/07/2020-14:48:27] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/Relu6 (CaskConvolution) [10/07/2020-14:48:27] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:48:27] [V] [TRT] Tactic: 1754569683116234317 time 0.086896 [10/07/2020-14:48:27] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:27] [V] [TRT] Tactic: 1825138533642645384 time 0.088916 [10/07/2020-14:48:27] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:48:27] [V] [TRT] Tactic: 2733356012094739613 time 0.059392 [10/07/2020-14:48:27] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:27] [V] [TRT] Tactic: 3915320020053085238 time 0.087768 [10/07/2020-14:48:27] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:27] [V] [TRT] Tactic: 6808617066150061604 time 0.054896 [10/07/2020-14:48:27] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:27] [V] [TRT] Tactic: 9091006216302412844 time 0.054844 [10/07/2020-14:48:27] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:27] [V] [TRT] Tactic: -8060443123034038864 time 0.058964 [10/07/2020-14:48:27] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:27] [V] [TRT] Tactic: -4420849921117327522 time 0.045184 [10/07/2020-14:48:27] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:27] [V] [TRT] Tactic: -3946921629105938337 time 0.05912 [10/07/2020-14:48:27] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.045184 [10/07/2020-14:48:27] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/Relu6 (CudaConvolution) [10/07/2020-14:48:27] [V] [TRT] Tactic: 0 time 0.042784 [10/07/2020-14:48:27] [V] [TRT] Tactic: 2 time 0.174508 [10/07/2020-14:48:27] [V] [TRT] Tactic: 5 time 0.376652 [10/07/2020-14:48:27] [V] [TRT] Tactic: 57 time 0.049848 [10/07/2020-14:48:27] [V] [TRT] Fastest Tactic: 0 Time: 0.042784 [10/07/2020-14:48:27] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/Relu6 (CudaDepthwiseConvolution) [10/07/2020-14:48:27] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [10/07/2020-14:48:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 9109503 [10/07/2020-14:48:27] [V] [TRT] [10/07/2020-14:48:27] [V] [TRT] *************** Autotuning format combination: Float(1,3,9,1152) -> Float(1,2,4,1024) *************** [10/07/2020-14:48:27] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:27] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [10/07/2020-14:48:27] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:27] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [10/07/2020-14:48:27] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:27] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:27] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:27] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:27] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/Relu6 (FusedConvActConvolution) [10/07/2020-14:48:27] [V] [TRT] Tactic: 458751 time 0.23266 [10/07/2020-14:48:27] [V] [TRT] Fastest Tactic: 458751 Time: 0.23266 [10/07/2020-14:48:27] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/Relu6 (CaskConvolution) [10/07/2020-14:48:27] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:27] [V] [TRT] Tactic: 1825138533642645384 time 0.352996 [10/07/2020-14:48:27] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [10/07/2020-14:48:27] [V] [TRT] Tactic: 2842488832350522458 time 0.244328 [10/07/2020-14:48:27] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:27] [V] [TRT] Tactic: 3915320020053085238 time 0.346592 [10/07/2020-14:48:27] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [10/07/2020-14:48:27] [V] [TRT] Tactic: 6448355332020552203 time 0.351924 [10/07/2020-14:48:27] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:27] [V] [TRT] Tactic: 6808617066150061604 time 0.220104 [10/07/2020-14:48:27] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:27] [V] [TRT] Tactic: -8060443123034038864 time 0.238564 [10/07/2020-14:48:27] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:27] [V] [TRT] Tactic: -4420849921117327522 time 0.286868 [10/07/2020-14:48:27] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:27] [V] [TRT] Tactic: -3946921629105938337 time 0.333432 [10/07/2020-14:48:27] [V] [TRT] Fastest Tactic: 6808617066150061604 Time: 0.220104 [10/07/2020-14:48:27] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/Relu6 (CudaConvolution) [10/07/2020-14:48:28] [V] [TRT] Tactic: 0 time 0.162972 [10/07/2020-14:48:28] [V] [TRT] Tactic: 2 time 0.204632 [10/07/2020-14:48:28] [V] [TRT] Tactic: 5 skipped. Scratch requested: 144277504, available: 16777216 [10/07/2020-14:48:28] [V] [TRT] Tactic: 57 time 0.746912 [10/07/2020-14:48:28] [V] [TRT] Fastest Tactic: 0 Time: 0.162972 [10/07/2020-14:48:28] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/Relu6 (CudaDepthwiseConvolution) [10/07/2020-14:48:28] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [10/07/2020-14:48:28] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 0 [10/07/2020-14:48:28] [V] [TRT] [10/07/2020-14:48:28] [V] [TRT] *************** Autotuning format combination: Float(1,2,4,1024) -> Float(1,2,4,2280) *************** [10/07/2020-14:48:28] [V] [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:48:28] [V] [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:28] [V] [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:48:28] [V] [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:28] [V] [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:28] [V] [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:28] [V] [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:28] [V] [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:28] [V] [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:28] [V] [TRT] --------------- Timing Runner: BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D (FusedConvActConvolution) [10/07/2020-14:48:28] [V] [TRT] Tactic: 589823 time 0.198472 [10/07/2020-14:48:28] [V] [TRT] Tactic: 786431 time 0.04514 [10/07/2020-14:48:28] [V] [TRT] Tactic: 1179647 time 0.028336 [10/07/2020-14:48:28] [V] [TRT] Tactic: 1310719 time 0.111448 [10/07/2020-14:48:28] [V] [TRT] Tactic: 1376255 time 0.138844 [10/07/2020-14:48:28] [V] [TRT] Tactic: 1441791 time 0.051644 [10/07/2020-14:48:28] [V] [TRT] Tactic: 1638399 time 0.036748 [10/07/2020-14:48:28] [V] [TRT] Tactic: 1835007 time 0.043204 [10/07/2020-14:48:28] [V] [TRT] Tactic: 2097151 time 0.034572 [10/07/2020-14:48:28] [V] [TRT] Tactic: 2162687 time 0.137208 [10/07/2020-14:48:28] [V] [TRT] Tactic: 2293759 time 0.130568 [10/07/2020-14:48:28] [V] [TRT] Tactic: 2359295 time 0.078872 [10/07/2020-14:48:28] [V] [TRT] Tactic: 2686975 time 0.130932 [10/07/2020-14:48:28] [V] [TRT] Tactic: 3407871 time 0.07056 [10/07/2020-14:48:28] [V] [TRT] Tactic: 3538943 time 0.04036 [10/07/2020-14:48:28] [V] [TRT] Tactic: 3997695 time 0.03042 [10/07/2020-14:48:28] [V] [TRT] Tactic: 4194303 time 0.047276 [10/07/2020-14:48:28] [V] [TRT] Tactic: 4259839 time 0.03668 [10/07/2020-14:48:28] [V] [TRT] Tactic: 4325375 time 0.03992 [10/07/2020-14:48:28] [V] [TRT] Tactic: 4521983 time 0.121988 [10/07/2020-14:48:28] [V] [TRT] Tactic: 4587519 time 0.03182 [10/07/2020-14:48:28] [V] [TRT] Tactic: 4653055 time 0.033088 [10/07/2020-14:48:28] [V] [TRT] Tactic: 4915199 time 0.03198 [10/07/2020-14:48:28] [V] [TRT] Tactic: 4980735 time 0.066632 [10/07/2020-14:48:28] [V] [TRT] Tactic: 5177343 time 0.028168 [10/07/2020-14:48:28] [V] [TRT] Tactic: 5242879 time 0.066532 [10/07/2020-14:48:28] [V] [TRT] Tactic: 5373951 time 0.028012 [10/07/2020-14:48:28] [V] [TRT] Tactic: 5439487 time 0.043368 [10/07/2020-14:48:28] [V] [TRT] Tactic: 5701631 time 0.125472 [10/07/2020-14:48:28] [V] [TRT] Tactic: 5767167 time 0.062724 [10/07/2020-14:48:28] [V] [TRT] Tactic: 5832703 time 0.071072 [10/07/2020-14:48:28] [V] [TRT] Tactic: 5898239 time 0.03404 [10/07/2020-14:48:28] [V] [TRT] Tactic: 6029311 time 0.122308 [10/07/2020-14:48:28] [V] [TRT] Tactic: 6225919 time 0.038192 [10/07/2020-14:48:28] [V] [TRT] Tactic: 6291455 time 0.028164 [10/07/2020-14:48:28] [V] [TRT] Tactic: 6750207 time 0.028308 [10/07/2020-14:48:28] [V] [TRT] Tactic: 6815743 time 0.066424 [10/07/2020-14:48:28] [V] [TRT] Tactic: 6946815 time 0.042636 [10/07/2020-14:48:28] [V] [TRT] Tactic: 7012351 time 0.034656 [10/07/2020-14:48:28] [V] [TRT] Tactic: 7077887 time 0.04116 [10/07/2020-14:48:28] [V] [TRT] Tactic: 7143423 time 0.062444 [10/07/2020-14:48:28] [V] [TRT] Tactic: 7208959 time 0.070776 [10/07/2020-14:48:28] [V] [TRT] Tactic: 7340031 time 0.03446 [10/07/2020-14:48:28] [V] [TRT] Tactic: 7405567 time 0.038728 [10/07/2020-14:48:28] [V] [TRT] Tactic: 7536639 time 0.109348 [10/07/2020-14:48:28] [V] [TRT] Tactic: 7602175 time 0.042188 [10/07/2020-14:48:28] [V] [TRT] Tactic: 7733247 time 0.043616 [10/07/2020-14:48:28] [V] [TRT] Tactic: 7798783 time 0.045312 [10/07/2020-14:48:28] [V] [TRT] Tactic: 8191999 time 0.038728 [10/07/2020-14:48:28] [V] [TRT] Tactic: 8257535 time 0.032084 [10/07/2020-14:48:28] [V] [TRT] Tactic: 8323071 time 0.045036 [10/07/2020-14:48:28] [V] [TRT] Tactic: 8650751 time 0.04222 [10/07/2020-14:48:28] [V] [TRT] Tactic: 8716287 time 0.039236 [10/07/2020-14:48:28] [V] [TRT] Tactic: 9109503 time 0.034532 [10/07/2020-14:48:28] [V] [TRT] Tactic: 9568255 time 0.032464 [10/07/2020-14:48:28] [V] [TRT] Tactic: 9895935 time 0.047748 [10/07/2020-14:48:29] [V] [TRT] Tactic: 10223615 time 0.130752 [10/07/2020-14:48:29] [V] [TRT] Tactic: 10354687 time 0.033292 [10/07/2020-14:48:29] [V] [TRT] Tactic: 10551295 time 0.068864 [10/07/2020-14:48:29] [V] [TRT] Tactic: 10747903 time 0.043248 [10/07/2020-14:48:29] [V] [TRT] Tactic: 10944511 time 0.06654 [10/07/2020-14:48:29] [V] [TRT] Fastest Tactic: 5373951 Time: 0.028012 [10/07/2020-14:48:29] [V] [TRT] --------------- Timing Runner: BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D (CaskConvolution) [10/07/2020-14:48:29] [V] [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:48:29] [V] [TRT] Tactic: 1754569683116234317 time 0.088892 [10/07/2020-14:48:29] [V] [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:29] [V] [TRT] Tactic: 1825138533642645384 time 0.090408 [10/07/2020-14:48:29] [V] [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:48:29] [V] [TRT] Tactic: 2733356012094739613 time 0.097744 [10/07/2020-14:48:29] [V] [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:29] [V] [TRT] Tactic: 3915320020053085238 time 0.090224 [10/07/2020-14:48:29] [V] [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:29] [V] [TRT] Tactic: 6808617066150061604 time 0.093484 [10/07/2020-14:48:29] [V] [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:29] [V] [TRT] Tactic: 9091006216302412844 time 0.090372 [10/07/2020-14:48:29] [V] [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:29] [V] [TRT] Tactic: -8060443123034038864 time 0.096584 [10/07/2020-14:48:29] [V] [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:29] [V] [TRT] Tactic: -4420849921117327522 time 0.081556 [10/07/2020-14:48:29] [V] [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:29] [V] [TRT] Tactic: -3946921629105938337 time 0.10126 [10/07/2020-14:48:29] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.081556 [10/07/2020-14:48:29] [V] [TRT] --------------- Timing Runner: BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D (CudaConvolution) [10/07/2020-14:48:29] [V] [TRT] Tactic: 0 time 0.050992 [10/07/2020-14:48:29] [V] [TRT] Tactic: 2 time 0.187844 [10/07/2020-14:48:29] [V] [TRT] Tactic: 5 skipped. Scratch requested: 20069888, available: 16777216 [10/07/2020-14:48:29] [V] [TRT] Tactic: 57 time 0.050668 [10/07/2020-14:48:29] [V] [TRT] Fastest Tactic: 57 Time: 0.050668 [10/07/2020-14:48:29] [V] [TRT] --------------- Timing Runner: BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D (CudaDepthwiseConvolution) [10/07/2020-14:48:29] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [10/07/2020-14:48:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 5373951 [10/07/2020-14:48:29] [V] [TRT] [10/07/2020-14:48:29] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:29] [V] [TRT] Tactic: 1002 time 0.014728 [10/07/2020-14:48:29] [V] [TRT] Tactic: 0 time 0.006272 [10/07/2020-14:48:29] [V] [TRT] Fastest Tactic: 0 Time: 0.006272 [10/07/2020-14:48:29] [V] [TRT] *************** Autotuning format combination: Float(1,2,4,1024) -> Float(1,2,4,256) *************** [10/07/2020-14:48:29] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:48:29] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:29] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:48:29] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:29] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:29] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:29] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:29] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:29] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:29] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/Relu6 (FusedConvActConvolution) [10/07/2020-14:48:29] [V] [TRT] Tactic: 589823 time 0.086324 [10/07/2020-14:48:29] [V] [TRT] Tactic: 655359 time 0.069772 [10/07/2020-14:48:29] [V] [TRT] Tactic: 786431 time 0.027444 [10/07/2020-14:48:29] [V] [TRT] Tactic: 851967 time 0.025224 [10/07/2020-14:48:29] [V] [TRT] Tactic: 1179647 time 0.016796 [10/07/2020-14:48:29] [V] [TRT] Tactic: 1310719 time 0.078064 [10/07/2020-14:48:29] [V] [TRT] Tactic: 1376255 time 0.077972 [10/07/2020-14:48:29] [V] [TRT] Tactic: 1441791 time 0.021064 [10/07/2020-14:48:29] [V] [TRT] Tactic: 1507327 time 0.042088 [10/07/2020-14:48:29] [V] [TRT] Tactic: 1638399 time 0.018876 [10/07/2020-14:48:29] [V] [TRT] Tactic: 1835007 time 0.02532 [10/07/2020-14:48:29] [V] [TRT] Tactic: 1900543 time 0.07814 [10/07/2020-14:48:29] [V] [TRT] Tactic: 2097151 time 0.014624 [10/07/2020-14:48:29] [V] [TRT] Tactic: 2162687 time 0.076048 [10/07/2020-14:48:29] [V] [TRT] Tactic: 2293759 time 0.067504 [10/07/2020-14:48:29] [V] [TRT] Tactic: 2359295 time 0.044836 [10/07/2020-14:48:29] [V] [TRT] Tactic: 2686975 time 0.069776 [10/07/2020-14:48:29] [V] [TRT] Tactic: 3080191 time 0.035856 [10/07/2020-14:48:29] [V] [TRT] Tactic: 3342335 time 0.042212 [10/07/2020-14:48:29] [V] [TRT] Tactic: 3407871 time 0.038032 [10/07/2020-14:48:29] [V] [TRT] Tactic: 3538943 time 0.021204 [10/07/2020-14:48:29] [V] [TRT] Tactic: 3670015 time 0.133148 [10/07/2020-14:48:29] [V] [TRT] Tactic: 3932159 time 0.052932 [10/07/2020-14:48:29] [V] [TRT] Tactic: 3997695 time 0.016932 [10/07/2020-14:48:29] [V] [TRT] Tactic: 4063231 time 0.025264 [10/07/2020-14:48:29] [V] [TRT] Tactic: 4194303 time 0.029588 [10/07/2020-14:48:29] [V] [TRT] Tactic: 4259839 time 0.016872 [10/07/2020-14:48:29] [V] [TRT] Tactic: 4325375 time 0.020992 [10/07/2020-14:48:29] [V] [TRT] Tactic: 4521983 time 0.063472 [10/07/2020-14:48:29] [V] [TRT] Tactic: 4587519 time 0.018212 [10/07/2020-14:48:29] [V] [TRT] Tactic: 4653055 time 0.020424 [10/07/2020-14:48:29] [V] [TRT] Tactic: 4915199 time 0.019036 [10/07/2020-14:48:29] [V] [TRT] Tactic: 4980735 time 0.035856 [10/07/2020-14:48:29] [V] [TRT] Tactic: 5177343 time 0.016856 [10/07/2020-14:48:29] [V] [TRT] Tactic: 5242879 time 0.03376 [10/07/2020-14:48:29] [V] [TRT] Tactic: 5373951 time 0.01688 [10/07/2020-14:48:29] [V] [TRT] Tactic: 5439487 time 0.026952 [10/07/2020-14:48:29] [V] [TRT] Tactic: 5570559 time 0.040084 [10/07/2020-14:48:29] [V] [TRT] Tactic: 5636095 time 0.02538 [10/07/2020-14:48:29] [V] [TRT] Tactic: 5701631 time 0.06332 [10/07/2020-14:48:29] [V] [TRT] Tactic: 5767167 time 0.031676 [10/07/2020-14:48:29] [V] [TRT] Tactic: 5832703 time 0.037836 [10/07/2020-14:48:29] [V] [TRT] Tactic: 5898239 time 0.02106 [10/07/2020-14:48:29] [V] [TRT] Tactic: 6029311 time 0.061164 [10/07/2020-14:48:29] [V] [TRT] Tactic: 6225919 time 0.020852 [10/07/2020-14:48:29] [V] [TRT] Tactic: 6291455 time 0.016872 [10/07/2020-14:48:29] [V] [TRT] Tactic: 6422527 time 0.031452 [10/07/2020-14:48:29] [V] [TRT] Tactic: 6750207 time 0.016664 [10/07/2020-14:48:29] [V] [TRT] Tactic: 6815743 time 0.033728 [10/07/2020-14:48:29] [V] [TRT] Tactic: 6946815 time 0.023204 [10/07/2020-14:48:29] [V] [TRT] Tactic: 7012351 time 0.014828 [10/07/2020-14:48:29] [V] [TRT] Tactic: 7077887 time 0.022624 [10/07/2020-14:48:29] [V] [TRT] Tactic: 7143423 time 0.031692 [10/07/2020-14:48:29] [V] [TRT] Tactic: 7208959 time 0.038016 [10/07/2020-14:48:30] [V] [TRT] Tactic: 7340031 time 0.020936 [10/07/2020-14:48:30] [V] [TRT] Tactic: 7405567 time 0.021116 [10/07/2020-14:48:30] [V] [TRT] Tactic: 7536639 time 0.048596 [10/07/2020-14:48:30] [V] [TRT] Tactic: 7602175 time 0.023296 [10/07/2020-14:48:30] [V] [TRT] Tactic: 7733247 time 0.02532 [10/07/2020-14:48:30] [V] [TRT] Tactic: 7798783 time 0.02744 [10/07/2020-14:48:30] [V] [TRT] Tactic: 8191999 time 0.021092 [10/07/2020-14:48:30] [V] [TRT] Tactic: 8257535 time 0.018992 [10/07/2020-14:48:30] [V] [TRT] Tactic: 8323071 time 0.027488 [10/07/2020-14:48:30] [V] [TRT] Tactic: 8650751 time 0.023196 [10/07/2020-14:48:30] [V] [TRT] Tactic: 8716287 time 0.021148 [10/07/2020-14:48:30] [V] [TRT] Tactic: 9109503 time 0.014796 [10/07/2020-14:48:30] [V] [TRT] Tactic: 9568255 time 0.018888 [10/07/2020-14:48:30] [V] [TRT] Tactic: 9895935 time 0.029592 [10/07/2020-14:48:30] [V] [TRT] Tactic: 10223615 time 0.069688 [10/07/2020-14:48:30] [V] [TRT] Tactic: 10354687 time 0.016848 [10/07/2020-14:48:30] [V] [TRT] Tactic: 10551295 time 0.040064 [10/07/2020-14:48:30] [V] [TRT] Tactic: 10747903 time 0.025372 [10/07/2020-14:48:30] [V] [TRT] Tactic: 10944511 time 0.035952 [10/07/2020-14:48:30] [V] [TRT] Fastest Tactic: 2097151 Time: 0.014624 [10/07/2020-14:48:30] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/Relu6 (CaskConvolution) [10/07/2020-14:48:30] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:48:30] [V] [TRT] Tactic: 1754569683116234317 time 0.087072 [10/07/2020-14:48:30] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:30] [V] [TRT] Tactic: 1825138533642645384 time 0.088108 [10/07/2020-14:48:30] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:48:30] [V] [TRT] Tactic: 2733356012094739613 time 0.058848 [10/07/2020-14:48:30] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:30] [V] [TRT] Tactic: 3915320020053085238 time 0.08674 [10/07/2020-14:48:30] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:30] [V] [TRT] Tactic: 6808617066150061604 time 0.055116 [10/07/2020-14:48:30] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:30] [V] [TRT] Tactic: 9091006216302412844 time 0.052988 [10/07/2020-14:48:30] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:30] [V] [TRT] Tactic: -8060443123034038864 time 0.057228 [10/07/2020-14:48:30] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:30] [V] [TRT] Tactic: -4420849921117327522 time 0.044376 [10/07/2020-14:48:30] [V] [TRT] FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:30] [V] [TRT] Tactic: -3946921629105938337 time 0.059144 [10/07/2020-14:48:30] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.044376 [10/07/2020-14:48:30] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/Relu6 (CudaConvolution) [10/07/2020-14:48:30] [V] [TRT] Tactic: 0 time 0.0402 [10/07/2020-14:48:30] [V] [TRT] Tactic: 2 time 0.124276 [10/07/2020-14:48:30] [V] [TRT] Tactic: 5 time 0.231484 [10/07/2020-14:48:30] [V] [TRT] Tactic: 57 time 0.061204 [10/07/2020-14:48:30] [V] [TRT] Fastest Tactic: 0 Time: 0.0402 [10/07/2020-14:48:30] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/Relu6 (CudaDepthwiseConvolution) [10/07/2020-14:48:30] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [10/07/2020-14:48:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 2097151 [10/07/2020-14:48:30] [V] [TRT] [10/07/2020-14:48:30] [V] [TRT] *************** Autotuning format combination: Float(1,2,4,256) -> Float(1,1,1,128) *************** [10/07/2020-14:48:30] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/Relu6 (FusedConvActConvolution) [10/07/2020-14:48:30] [V] [TRT] Tactic: 458751 time 0.090772 [10/07/2020-14:48:30] [V] [TRT] Fastest Tactic: 458751 Time: 0.090772 [10/07/2020-14:48:30] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/Relu6 (CaskConvolution) [10/07/2020-14:48:30] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [10/07/2020-14:48:30] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/Relu6 (CudaConvolution) [10/07/2020-14:48:30] [V] [TRT] Tactic: 0 time 0.14196 [10/07/2020-14:48:30] [V] [TRT] Tactic: 2 time 0.141444 [10/07/2020-14:48:30] [V] [TRT] Tactic: 5 skipped. Scratch requested: 36489728, available: 16777216 [10/07/2020-14:48:30] [V] [TRT] Tactic: 57 time 0.142088 [10/07/2020-14:48:30] [V] [TRT] Fastest Tactic: 2 Time: 0.141444 [10/07/2020-14:48:30] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/Relu6 (CudaDepthwiseConvolution) [10/07/2020-14:48:30] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [10/07/2020-14:48:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 458751 [10/07/2020-14:48:30] [V] [TRT] [10/07/2020-14:48:30] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,128) -> Float(1,1,1,570) *************** [10/07/2020-14:48:30] [V] [TRT] BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:48:30] [V] [TRT] BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:30] [V] [TRT] BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:48:30] [V] [TRT] BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:30] [V] [TRT] BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:30] [V] [TRT] BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:30] [V] [TRT] BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:30] [V] [TRT] BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:30] [V] [TRT] BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:30] [V] [TRT] --------------- Timing Runner: BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D (FusedConvActConvolution) [10/07/2020-14:48:30] [V] [TRT] Tactic: 589823 time 0.048456 [10/07/2020-14:48:30] [V] [TRT] Tactic: 786431 time 0.021216 [10/07/2020-14:48:30] [V] [TRT] Tactic: 1179647 time 0.01472 [10/07/2020-14:48:30] [V] [TRT] Tactic: 1310719 time 0.045096 [10/07/2020-14:48:30] [V] [TRT] Tactic: 1376255 time 0.044424 [10/07/2020-14:48:30] [V] [TRT] Tactic: 1441791 time 0.023232 [10/07/2020-14:48:30] [V] [TRT] Tactic: 1638399 time 0.01872 [10/07/2020-14:48:30] [V] [TRT] Tactic: 1835007 time 0.018916 [10/07/2020-14:48:30] [V] [TRT] Tactic: 2097151 time 0.018108 [10/07/2020-14:48:30] [V] [TRT] Tactic: 2162687 time 0.042208 [10/07/2020-14:48:30] [V] [TRT] Tactic: 2293759 time 0.037988 [10/07/2020-14:48:30] [V] [TRT] Tactic: 2359295 time 0.034564 [10/07/2020-14:48:30] [V] [TRT] Tactic: 2686975 time 0.040132 [10/07/2020-14:48:30] [V] [TRT] Tactic: 3407871 time 0.023424 [10/07/2020-14:48:30] [V] [TRT] Tactic: 3538943 time 0.014856 [10/07/2020-14:48:30] [V] [TRT] Tactic: 3997695 time 0.016864 [10/07/2020-14:48:30] [V] [TRT] Tactic: 4194303 time 0.021856 [10/07/2020-14:48:30] [V] [TRT] Tactic: 4259839 time 0.018972 [10/07/2020-14:48:30] [V] [TRT] Tactic: 4325375 time 0.018912 [10/07/2020-14:48:30] [V] [TRT] Tactic: 4521983 time 0.038 [10/07/2020-14:48:30] [V] [TRT] Tactic: 4587519 time 0.01674 [10/07/2020-14:48:30] [V] [TRT] Tactic: 4653055 time 0.018972 [10/07/2020-14:48:30] [V] [TRT] Tactic: 4915199 time 0.016876 [10/07/2020-14:48:30] [V] [TRT] Tactic: 4980735 time 0.023824 [10/07/2020-14:48:30] [V] [TRT] Tactic: 5177343 time 0.014636 [10/07/2020-14:48:30] [V] [TRT] Tactic: 5242879 time 0.021064 [10/07/2020-14:48:30] [V] [TRT] Tactic: 5373951 time 0.014636 [10/07/2020-14:48:30] [V] [TRT] Tactic: 5439487 time 0.018956 [10/07/2020-14:48:30] [V] [TRT] Tactic: 5701631 time 0.035956 [10/07/2020-14:48:30] [V] [TRT] Tactic: 5767167 time 0.018852 [10/07/2020-14:48:30] [V] [TRT] Tactic: 5832703 time 0.023156 [10/07/2020-14:48:30] [V] [TRT] Tactic: 5898239 time 0.01898 [10/07/2020-14:48:30] [V] [TRT] Tactic: 6029311 time 0.035832 [10/07/2020-14:48:30] [V] [TRT] Tactic: 6225919 time 0.01468 [10/07/2020-14:48:30] [V] [TRT] Tactic: 6291455 time 0.01478 [10/07/2020-14:48:30] [V] [TRT] Tactic: 6750207 time 0.014584 [10/07/2020-14:48:31] [V] [TRT] Tactic: 6815743 time 0.021128 [10/07/2020-14:48:31] [V] [TRT] Tactic: 6946815 time 0.016848 [10/07/2020-14:48:31] [V] [TRT] Tactic: 7012351 time 0.018124 [10/07/2020-14:48:31] [V] [TRT] Tactic: 7077887 time 0.015308 [10/07/2020-14:48:31] [V] [TRT] Tactic: 7143423 time 0.018684 [10/07/2020-14:48:31] [V] [TRT] Tactic: 7208959 time 0.0233 [10/07/2020-14:48:31] [V] [TRT] Tactic: 7340031 time 0.018976 [10/07/2020-14:48:31] [V] [TRT] Tactic: 7405567 time 0.016848 [10/07/2020-14:48:31] [V] [TRT] Tactic: 7536639 time 0.027364 [10/07/2020-14:48:31] [V] [TRT] Tactic: 7602175 time 0.016868 [10/07/2020-14:48:31] [V] [TRT] Tactic: 7733247 time 0.02088 [10/07/2020-14:48:31] [V] [TRT] Tactic: 7798783 time 0.020848 [10/07/2020-14:48:31] [V] [TRT] Tactic: 8191999 time 0.014816 [10/07/2020-14:48:31] [V] [TRT] Tactic: 8257535 time 0.01698 [10/07/2020-14:48:31] [V] [TRT] Tactic: 8323071 time 0.01902 [10/07/2020-14:48:31] [V] [TRT] Tactic: 8650751 time 0.016892 [10/07/2020-14:48:31] [V] [TRT] Tactic: 8716287 time 0.01476 [10/07/2020-14:48:31] [V] [TRT] Tactic: 9109503 time 0.018212 [10/07/2020-14:48:31] [V] [TRT] Tactic: 9568255 time 0.016932 [10/07/2020-14:48:31] [V] [TRT] Tactic: 9895935 time 0.021848 [10/07/2020-14:48:31] [V] [TRT] Tactic: 10223615 time 0.039644 [10/07/2020-14:48:31] [V] [TRT] Tactic: 10354687 time 0.018936 [10/07/2020-14:48:31] [V] [TRT] Tactic: 10551295 time 0.02332 [10/07/2020-14:48:31] [V] [TRT] Tactic: 10747903 time 0.019928 [10/07/2020-14:48:31] [V] [TRT] Tactic: 10944511 time 0.023512 [10/07/2020-14:48:31] [V] [TRT] Fastest Tactic: 6750207 Time: 0.014584 [10/07/2020-14:48:31] [V] [TRT] --------------- Timing Runner: BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D (CaskConvolution) [10/07/2020-14:48:31] [V] [TRT] BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:48:31] [V] [TRT] Tactic: 1754569683116234317 time 0.050956 [10/07/2020-14:48:31] [V] [TRT] BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [10/07/2020-14:48:31] [V] [TRT] Tactic: 1825138533642645384 time 0.051488 [10/07/2020-14:48:31] [V] [TRT] BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [10/07/2020-14:48:31] [V] [TRT] Tactic: 2733356012094739613 time 0.052248 [10/07/2020-14:48:31] [V] [TRT] BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [10/07/2020-14:48:31] [V] [TRT] Tactic: 3915320020053085238 time 0.050996 [10/07/2020-14:48:31] [V] [TRT] BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:31] [V] [TRT] Tactic: 6808617066150061604 time 0.054456 [10/07/2020-14:48:31] [V] [TRT] BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:31] [V] [TRT] Tactic: 9091006216302412844 time 0.052488 [10/07/2020-14:48:31] [V] [TRT] BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [10/07/2020-14:48:31] [V] [TRT] Tactic: -8060443123034038864 time 0.054656 [10/07/2020-14:48:31] [V] [TRT] BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [10/07/2020-14:48:31] [V] [TRT] Tactic: -4420849921117327522 time 0.042416 [10/07/2020-14:48:31] [V] [TRT] BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:31] [V] [TRT] Tactic: -3946921629105938337 time 0.05596 [10/07/2020-14:48:31] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.042416 [10/07/2020-14:48:31] [V] [TRT] --------------- Timing Runner: BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D (CudaConvolution) [10/07/2020-14:48:31] [V] [TRT] Tactic: 0 time 0.032316 [10/07/2020-14:48:31] [V] [TRT] Tactic: 2 time 0.067888 [10/07/2020-14:48:31] [V] [TRT] Tactic: 5 time 0.491044 [10/07/2020-14:48:31] [V] [TRT] Tactic: 57 time 0.032212 [10/07/2020-14:48:31] [V] [TRT] Fastest Tactic: 57 Time: 0.032212 [10/07/2020-14:48:31] [V] [TRT] --------------- Timing Runner: BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D (CudaDepthwiseConvolution) [10/07/2020-14:48:31] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [10/07/2020-14:48:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 6750207 [10/07/2020-14:48:31] [V] [TRT] [10/07/2020-14:48:31] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:31] [V] [TRT] Tactic: 1002 time 0.010428 [10/07/2020-14:48:31] [V] [TRT] Tactic: 0 time 0.006228 [10/07/2020-14:48:31] [V] [TRT] Fastest Tactic: 0 Time: 0.006228 [10/07/2020-14:48:31] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:31] [V] [TRT] Tactic: 1002 time 0.035804 [10/07/2020-14:48:31] [V] [TRT] Tactic: 0 time 0.072108 [10/07/2020-14:48:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.035804 [10/07/2020-14:48:31] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:31] [V] [TRT] Tactic: 1002 time 0.062584 [10/07/2020-14:48:31] [V] [TRT] Tactic: 0 time 0.035168 [10/07/2020-14:48:31] [V] [TRT] Fastest Tactic: 0 Time: 0.035168 [10/07/2020-14:48:31] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:31] [V] [TRT] Tactic: 1002 time 0.036904 [10/07/2020-14:48:31] [V] [TRT] Tactic: 0 time 0.08274 [10/07/2020-14:48:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.036904 [10/07/2020-14:48:31] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,102885) -> Float(1,1,91,98553) *************** [10/07/2020-14:48:31] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 288) [Shuffle] + BoxPredictor_0/Reshape_1 (Shuffle) [10/07/2020-14:48:31] [V] [TRT] Tactic: 0 time 0.03454 [10/07/2020-14:48:31] [V] [TRT] Tactic: 1 time 0.067204 [10/07/2020-14:48:31] [V] [TRT] Fastest Tactic: 0 Time: 0.03454 [10/07/2020-14:48:31] [V] [TRT] *************** Autotuning format combination: Float(1,19,361:32,3249) -> Float(1,1,91:32,3094) *************** [10/07/2020-14:48:31] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 288) [Shuffle] + BoxPredictor_0/Reshape_1 (Shuffle) [10/07/2020-14:48:31] [V] [TRT] Tactic: 0 time 0.071748 [10/07/2020-14:48:31] [V] [TRT] Tactic: 1 time 0.080756 [10/07/2020-14:48:31] [V] [TRT] Fastest Tactic: 0 Time: 0.071748 [10/07/2020-14:48:31] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:31] [V] [TRT] Tactic: 1002 time 0.024964 [10/07/2020-14:48:31] [V] [TRT] Tactic: 0 time 0.040772 [10/07/2020-14:48:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.024964 [10/07/2020-14:48:31] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:31] [V] [TRT] Tactic: 1002 time 0.04882 [10/07/2020-14:48:31] [V] [TRT] Tactic: 0 time 0.01948 [10/07/2020-14:48:31] [V] [TRT] Fastest Tactic: 0 Time: 0.01948 [10/07/2020-14:48:31] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:31] [V] [TRT] Tactic: 1002 time 0.026452 [10/07/2020-14:48:31] [V] [TRT] Tactic: 0 time 0.048792 [10/07/2020-14:48:31] [V] [TRT] Fastest Tactic: 1002 Time: 0.026452 [10/07/2020-14:48:31] [V] [TRT] *************** Autotuning format combination: Float(1,10,100,57000) -> Float(1,1,91,54600) *************** [10/07/2020-14:48:31] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 296) [Shuffle] + BoxPredictor_1/Reshape_1 (Shuffle) [10/07/2020-14:48:31] [V] [TRT] Tactic: 0 time 0.019612 [10/07/2020-14:48:31] [V] [TRT] Tactic: 1 time 0.037708 [10/07/2020-14:48:31] [V] [TRT] Fastest Tactic: 0 Time: 0.019612 [10/07/2020-14:48:31] [V] [TRT] *************** Autotuning format combination: Float(1,10,100:32,1800) -> Float(1,1,91:32,1729) *************** [10/07/2020-14:48:31] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 296) [Shuffle] + BoxPredictor_1/Reshape_1 (Shuffle) [10/07/2020-14:48:31] [V] [TRT] Tactic: 0 time 0.040936 [10/07/2020-14:48:31] [V] [TRT] Tactic: 1 time 0.054476 [10/07/2020-14:48:31] [V] [TRT] Fastest Tactic: 0 Time: 0.040936 [10/07/2020-14:48:31] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:31] [V] [TRT] Tactic: 1002 time 0.014676 [10/07/2020-14:48:31] [V] [TRT] Tactic: 0 time 0.012612 [10/07/2020-14:48:31] [V] [TRT] Fastest Tactic: 0 Time: 0.012612 [10/07/2020-14:48:31] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:31] [V] [TRT] Tactic: 1002 time 0.0416 [10/07/2020-14:48:31] [V] [TRT] Tactic: 0 time 0.008348 [10/07/2020-14:48:31] [V] [TRT] Fastest Tactic: 0 Time: 0.008348 [10/07/2020-14:48:31] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:31] [V] [TRT] Tactic: 1002 time 0.014748 [10/07/2020-14:48:31] [V] [TRT] Tactic: 0 time 0.012684 [10/07/2020-14:48:31] [V] [TRT] Fastest Tactic: 0 Time: 0.012684 [10/07/2020-14:48:31] [V] [TRT] *************** Autotuning format combination: Float(1,5,25,14250) -> Float(1,1,91,13650) *************** [10/07/2020-14:48:31] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 304) [Shuffle] + BoxPredictor_2/Reshape_1 (Shuffle) [10/07/2020-14:48:31] [V] [TRT] Tactic: 0 time 0.008536 [10/07/2020-14:48:31] [V] [TRT] Tactic: 1 time 0.01818 [10/07/2020-14:48:31] [V] [TRT] Fastest Tactic: 0 Time: 0.008536 [10/07/2020-14:48:31] [V] [TRT] *************** Autotuning format combination: Float(1,5,25:32,450) -> Float(1,1,91:32,455) *************** [10/07/2020-14:48:31] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 304) [Shuffle] + BoxPredictor_2/Reshape_1 (Shuffle) [10/07/2020-14:48:31] [V] [TRT] Tactic: 0 time 0.014728 [10/07/2020-14:48:31] [V] [TRT] Tactic: 1 time 0.02674 [10/07/2020-14:48:31] [V] [TRT] Fastest Tactic: 0 Time: 0.014728 [10/07/2020-14:48:31] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:31] [V] [TRT] Tactic: 1002 time 0.014716 [10/07/2020-14:48:31] [V] [TRT] Tactic: 0 time 0.007 [10/07/2020-14:48:31] [V] [TRT] Fastest Tactic: 0 Time: 0.007 [10/07/2020-14:48:31] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:31] [V] [TRT] Tactic: 1002 time 0.04192 [10/07/2020-14:48:31] [V] [TRT] Tactic: 0 time 0.006224 [10/07/2020-14:48:31] [V] [TRT] Fastest Tactic: 0 Time: 0.006224 [10/07/2020-14:48:31] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:31] [V] [TRT] Tactic: 1002 time 0.014644 [10/07/2020-14:48:31] [V] [TRT] Tactic: 0 time 0.008148 [10/07/2020-14:48:31] [V] [TRT] Fastest Tactic: 0 Time: 0.008148 [10/07/2020-14:48:31] [V] [TRT] *************** Autotuning format combination: Float(1,3,9,5130) -> Float(1,1,91,4914) *************** [10/07/2020-14:48:31] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 312) [Shuffle] + BoxPredictor_3/Reshape_1 (Shuffle) [10/07/2020-14:48:31] [V] [TRT] Tactic: 0 time 0.008388 [10/07/2020-14:48:31] [V] [TRT] Tactic: 1 time 0.016276 [10/07/2020-14:48:31] [V] [TRT] Fastest Tactic: 0 Time: 0.008388 [10/07/2020-14:48:31] [V] [TRT] *************** Autotuning format combination: Float(1,3,9:32,162) -> Float(1,1,91:32,182) *************** [10/07/2020-14:48:31] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 312) [Shuffle] + BoxPredictor_3/Reshape_1 (Shuffle) [10/07/2020-14:48:31] [V] [TRT] Tactic: 0 time 0.010476 [10/07/2020-14:48:31] [V] [TRT] Tactic: 1 time 0.024856 [10/07/2020-14:48:31] [V] [TRT] Fastest Tactic: 0 Time: 0.010476 [10/07/2020-14:48:31] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:31] [V] [TRT] Tactic: 1002 time 0.014708 [10/07/2020-14:48:31] [V] [TRT] Tactic: 0 time 0.006256 [10/07/2020-14:48:31] [V] [TRT] Fastest Tactic: 0 Time: 0.006256 [10/07/2020-14:48:31] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:31] [V] [TRT] Tactic: 1002 time 0.041888 [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.006304 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.006304 [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:32] [V] [TRT] Tactic: 1002 time 0.013776 [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.006276 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.006276 [10/07/2020-14:48:32] [V] [TRT] *************** Autotuning format combination: Float(1,2,4,2280) -> Float(1,1,91,2184) *************** [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 320) [Shuffle] + BoxPredictor_4/Reshape_1 (Shuffle) [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.00622 [10/07/2020-14:48:32] [V] [TRT] Tactic: 1 time 0.016296 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.00622 [10/07/2020-14:48:32] [V] [TRT] *************** Autotuning format combination: Float(1,2,4:32,72) -> Float(1,1,91:32,91) *************** [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 320) [Shuffle] + BoxPredictor_4/Reshape_1 (Shuffle) [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.00888 [10/07/2020-14:48:32] [V] [TRT] Tactic: 1 time 0.024676 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.00888 [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:32] [V] [TRT] Tactic: 1002 time 0.010544 [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.006376 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.006376 [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:32] [V] [TRT] Tactic: 1002 time 0.010484 [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.006288 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.006288 [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:32] [V] [TRT] Tactic: 1002 time 0.010424 [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.006188 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.006188 [10/07/2020-14:48:32] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,570) -> Float(1,1,91,546) *************** [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 328) [Shuffle] + BoxPredictor_5/Reshape_1 (Shuffle) [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.0062 [10/07/2020-14:48:32] [V] [TRT] Tactic: 1 time 0.014068 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.0062 [10/07/2020-14:48:32] [V] [TRT] *************** Autotuning format combination: Float(1,1,1:32,18) -> Float(1,1,91:32,91) *************** [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 328) [Shuffle] + BoxPredictor_5/Reshape_1 (Shuffle) [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.006252 [10/07/2020-14:48:32] [V] [TRT] Tactic: 1 time 0.020504 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.006252 [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:32] [V] [TRT] Tactic: 1002 time 0.010428 [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.008632 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.008632 [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:32] [V] [TRT] Tactic: 1002 time 0.010556 [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.008308 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.008308 [10/07/2020-14:48:32] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,102885) -> Float(1,4,4,4332) *************** [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 147) [Shuffle] + BoxPredictor_0/Reshape (Shuffle) [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.006252 [10/07/2020-14:48:32] [V] [TRT] Tactic: 1 time 0.0162 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.006252 [10/07/2020-14:48:32] [V] [TRT] *************** Autotuning format combination: Float(1,19,361:32,3249) -> Float(1,4,4:32,136) *************** [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 147) [Shuffle] + BoxPredictor_0/Reshape (Shuffle) [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.006184 [10/07/2020-14:48:32] [V] [TRT] Tactic: 1 time 0.03046 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.006184 [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:32] [V] [TRT] Tactic: 1002 time 0.010524 [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.008316 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.008316 [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:32] [V] [TRT] Tactic: 1002 time 0.01056 [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.006648 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.006648 [10/07/2020-14:48:32] [V] [TRT] *************** Autotuning format combination: Float(1,10,100,57000) -> Float(1,4,4,2400) *************** [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 183) [Shuffle] + BoxPredictor_1/Reshape (Shuffle) [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.006304 [10/07/2020-14:48:32] [V] [TRT] Tactic: 1 time 0.016092 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.006304 [10/07/2020-14:48:32] [V] [TRT] *************** Autotuning format combination: Float(1,10,100:32,1800) -> Float(1,4,4:32,76) *************** [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 183) [Shuffle] + BoxPredictor_1/Reshape (Shuffle) [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.006336 [10/07/2020-14:48:32] [V] [TRT] Tactic: 1 time 0.024748 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.006336 [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:32] [V] [TRT] Tactic: 1002 time 0.0105 [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.006212 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.006212 [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:32] [V] [TRT] Tactic: 1002 time 0.008464 [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.006288 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.006288 [10/07/2020-14:48:32] [V] [TRT] *************** Autotuning format combination: Float(1,5,25,14250) -> Float(1,4,4,600) *************** [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 205) [Shuffle] + BoxPredictor_2/Reshape (Shuffle) [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.006256 [10/07/2020-14:48:32] [V] [TRT] Tactic: 1 time 0.016164 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.006256 [10/07/2020-14:48:32] [V] [TRT] *************** Autotuning format combination: Float(1,5,25:32,450) -> Float(1,4,4:32,20) *************** [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 205) [Shuffle] + BoxPredictor_2/Reshape (Shuffle) [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.006268 [10/07/2020-14:48:32] [V] [TRT] Tactic: 1 time 0.020396 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.006268 [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:32] [V] [TRT] Tactic: 1002 time 0.010476 [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.006268 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.006268 [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:32] [V] [TRT] Tactic: 1002 time 0.008348 [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.006188 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.006188 [10/07/2020-14:48:32] [V] [TRT] *************** Autotuning format combination: Float(1,3,9,5130) -> Float(1,4,4,216) *************** [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 227) [Shuffle] + BoxPredictor_3/Reshape (Shuffle) [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.006224 [10/07/2020-14:48:32] [V] [TRT] Tactic: 1 time 0.012796 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.006224 [10/07/2020-14:48:32] [V] [TRT] *************** Autotuning format combination: Float(1,3,9:32,162) -> Float(1,4,4:32,8) *************** [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 227) [Shuffle] + BoxPredictor_3/Reshape (Shuffle) [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.006272 [10/07/2020-14:48:32] [V] [TRT] Tactic: 1 time 0.020192 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.006272 [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:32] [V] [TRT] Tactic: 1002 time 0.010568 [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.006144 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:32] [V] [TRT] Tactic: 1002 time 0.008336 [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.006208 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.006208 [10/07/2020-14:48:32] [V] [TRT] *************** Autotuning format combination: Float(1,2,4,2280) -> Float(1,4,4,96) *************** [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 249) [Shuffle] + BoxPredictor_4/Reshape (Shuffle) [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.006224 [10/07/2020-14:48:32] [V] [TRT] Tactic: 1 time 0.011888 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.006224 [10/07/2020-14:48:32] [V] [TRT] *************** Autotuning format combination: Float(1,2,4:32,72) -> Float(1,4,4:32,4) *************** [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 249) [Shuffle] + BoxPredictor_4/Reshape (Shuffle) [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.006236 [10/07/2020-14:48:32] [V] [TRT] Tactic: 1 time 0.018336 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.006236 [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:32] [V] [TRT] Tactic: 1002 time 0.010468 [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.0063 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.0063 [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:32] [V] [TRT] Tactic: 1002 time 0.008372 [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.006256 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.006256 [10/07/2020-14:48:32] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,570) -> Float(1,4,4,24) *************** [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 271) [Shuffle] + BoxPredictor_5/Reshape (Shuffle) [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.006172 [10/07/2020-14:48:32] [V] [TRT] Tactic: 1 time 0.012044 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.006172 [10/07/2020-14:48:32] [V] [TRT] *************** Autotuning format combination: Float(1,1,1:32,18) -> Float(1,4,4:32,4) *************** [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 271) [Shuffle] + BoxPredictor_5/Reshape (Shuffle) [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.006152 [10/07/2020-14:48:32] [V] [TRT] Tactic: 1 time 0.016288 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.006152 [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:32] [V] [TRT] Tactic: 1002 time 0.08816 [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.0063 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.0063 [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:32] [V] [TRT] Tactic: 1002 time 0.050976 [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.006248 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.006248 [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:32] [V] [TRT] Tactic: 1002 time 0.017568 [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.006192 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.006192 [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:32] [V] [TRT] Tactic: 1002 time 0.01042 [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.0063 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.0063 [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:32] [V] [TRT] Tactic: 1002 time 0.010432 [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.006276 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.006276 [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:32] [V] [TRT] Tactic: 1002 time 0.008776 [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.006256 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.006256 [10/07/2020-14:48:32] [V] [TRT] *************** Autotuning format combination: Float(1,4,4,4332), Float(1,4,4,2400), Float(1,4,4,600), Float(1,4,4,216), Float(1,4,4,96), Float(1,4,4,24) -> Float(1,1,1,7668) *************** [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:32] [V] [TRT] Tactic: 1002 time 0.10244 [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.03186 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.03186 [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:32] [V] [TRT] Tactic: 1002 time 0.057636 [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.019544 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.019544 [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:32] [V] [TRT] Tactic: 1002 time 0.019168 [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.010416 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.010416 [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:32] [V] [TRT] Tactic: 1002 time 0.012616 [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.008236 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.008236 [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:32] [V] [TRT] Tactic: 1002 time 0.010456 [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.006324 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.006324 [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: (Reformat) [10/07/2020-14:48:32] [V] [TRT] Tactic: 1002 time 0.010316 [10/07/2020-14:48:32] [V] [TRT] Tactic: 0 time 0.006232 [10/07/2020-14:48:32] [V] [TRT] Fastest Tactic: 0 Time: 0.006232 [10/07/2020-14:48:32] [V] [TRT] *************** Autotuning format combination: Float(1,1,91,98553), Float(1,1,91,54600), Float(1,1,91,13650), Float(1,1,91,4914), Float(1,1,91,2184), Float(1,1,91,546) -> Float(1,1,1,174447) *************** [10/07/2020-14:48:32] [V] [TRT] --------------- Timing Runner: GridAnchor copy (Reformat) [10/07/2020-14:48:33] [V] [TRT] Tactic: 1002 time 0.00832 [10/07/2020-14:48:33] [V] [TRT] Tactic: 0 time 0.006208 [10/07/2020-14:48:33] [V] [TRT] Fastest Tactic: 0 Time: 0.006208 [10/07/2020-14:48:33] [V] [TRT] --------------- Timing Runner: GridAnchor_1 copy (Reformat) [10/07/2020-14:48:33] [V] [TRT] Tactic: 1002 time 0.008384 [10/07/2020-14:48:33] [V] [TRT] Tactic: 0 time 0.006224 [10/07/2020-14:48:33] [V] [TRT] Fastest Tactic: 0 Time: 0.006224 [10/07/2020-14:48:33] [V] [TRT] --------------- Timing Runner: GridAnchor_2 copy (Reformat) [10/07/2020-14:48:33] [V] [TRT] Tactic: 1002 time 0.00834 [10/07/2020-14:48:33] [V] [TRT] Tactic: 0 time 0.006268 [10/07/2020-14:48:33] [V] [TRT] Fastest Tactic: 0 Time: 0.006268 [10/07/2020-14:48:33] [V] [TRT] --------------- Timing Runner: GridAnchor_3 copy (Reformat) [10/07/2020-14:48:33] [V] [TRT] Tactic: 1002 time 0.008436 [10/07/2020-14:48:33] [V] [TRT] Tactic: 0 time 0.00618 [10/07/2020-14:48:33] [V] [TRT] Fastest Tactic: 0 Time: 0.00618 [10/07/2020-14:48:33] [V] [TRT] --------------- Timing Runner: GridAnchor_4 copy (Reformat) [10/07/2020-14:48:33] [V] [TRT] Tactic: 1002 time 0.008316 [10/07/2020-14:48:33] [V] [TRT] Tactic: 0 time 0.006196 [10/07/2020-14:48:33] [V] [TRT] Fastest Tactic: 0 Time: 0.006196 [10/07/2020-14:48:33] [V] [TRT] --------------- Timing Runner: GridAnchor_5 copy (Reformat) [10/07/2020-14:48:33] [V] [TRT] Tactic: 1002 time 0.008124 [10/07/2020-14:48:33] [V] [TRT] Tactic: 0 time 0.006288 [10/07/2020-14:48:33] [V] [TRT] Fastest Tactic: 0 Time: 0.006288 [10/07/2020-14:48:33] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,7668), Float(1,1,7668,15336), Float(1,1,1,174447) -> Float(1,7,700,700), Float(1,1,1,1) *************** [10/07/2020-14:48:33] [V] [TRT] Formats and tactics selection completed in 65.9138 seconds. [10/07/2020-14:48:33] [V] [TRT] After reformat layers: 63 layers [10/07/2020-14:48:33] [V] [TRT] Block size 16777216 [10/07/2020-14:48:33] [V] [TRT] Block size 5760000 [10/07/2020-14:48:33] [V] [TRT] Block size 2880000 [10/07/2020-14:48:33] [V] [TRT] Block size 409600 [10/07/2020-14:48:33] [V] [TRT] Block size 228352 [10/07/2020-14:48:33] [V] [TRT] Block size 218624 [10/07/2020-14:48:33] [V] [TRT] Block size 54784 [10/07/2020-14:48:33] [V] [TRT] Block size 34816 [10/07/2020-14:48:33] [V] [TRT] Block size 20992 [10/07/2020-14:48:33] [V] [TRT] Block size 19968 [10/07/2020-14:48:33] [V] [TRT] Block size 19456 [10/07/2020-14:48:33] [V] [TRT] Block size 17408 [10/07/2020-14:48:33] [V] [TRT] Block size 9216 [10/07/2020-14:48:33] [V] [TRT] Block size 9216 [10/07/2020-14:48:33] [V] [TRT] Block size 5120 [10/07/2020-14:48:33] [V] [TRT] Block size 2560 [10/07/2020-14:48:33] [V] [TRT] Block size 2560 [10/07/2020-14:48:33] [V] [TRT] Block size 2560 [10/07/2020-14:48:33] [V] [TRT] Block size 2048 [10/07/2020-14:48:33] [V] [TRT] Block size 1024 [10/07/2020-14:48:33] [V] [TRT] Block size 512 [10/07/2020-14:48:33] [V] [TRT] Block size 512 [10/07/2020-14:48:33] [V] [TRT] Total Activation Memory: 26476544 [10/07/2020-14:48:33] [I] [TRT] Detected 1 inputs and 2 output network tensors. [10/07/2020-14:48:33] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [10/07/2020-14:48:33] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [10/07/2020-14:48:33] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:33] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:33] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:33] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:33] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:33] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:33] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:33] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:33] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:33] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:33] [V] [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:33] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [10/07/2020-14:48:33] [V] [TRT] FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [10/07/2020-14:48:33] [V] [TRT] Layer: GridAnchor Weights: 0 HostPersistent: 48 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6 Weights: 0 HostPersistent: 1664 DevicePersistent: 138752 [10/07/2020-14:48:33] [V] [TRT] Layer: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/Relu6 Weights: 1152 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6 Weights: 0 HostPersistent: 1664 DevicePersistent: 143872 [10/07/2020-14:48:33] [V] [TRT] Layer: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/Relu6 Weights: 2304 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6 Weights: 0 HostPersistent: 3200 DevicePersistent: 67072 [10/07/2020-14:48:33] [V] [TRT] Layer: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/Relu6 Weights: 4608 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6 Weights: 0 HostPersistent: 3200 DevicePersistent: 99840 [10/07/2020-14:48:33] [V] [TRT] Layer: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/Relu6 Weights: 4608 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6 Weights: 0 HostPersistent: 3200 DevicePersistent: 140800 [10/07/2020-14:48:33] [V] [TRT] Layer: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/Relu6 Weights: 9216 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6 Weights: 0 HostPersistent: 3200 DevicePersistent: 271872 [10/07/2020-14:48:33] [V] [TRT] Layer: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/Relu6 Weights: 9216 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6 Weights: 0 HostPersistent: 3200 DevicePersistent: 528896 [10/07/2020-14:48:33] [V] [TRT] Layer: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/Relu6 Weights: 18432 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6 Weights: 0 HostPersistent: 3200 DevicePersistent: 1053184 [10/07/2020-14:48:33] [V] [TRT] Layer: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/Relu6 Weights: 18432 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_pointwise/Relu6 Weights: 0 HostPersistent: 3200 DevicePersistent: 1053184 [10/07/2020-14:48:33] [V] [TRT] Layer: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/Relu6 Weights: 18432 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_pointwise/Relu6 Weights: 0 HostPersistent: 3200 DevicePersistent: 1053184 [10/07/2020-14:48:33] [V] [TRT] Layer: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/Relu6 Weights: 18432 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_pointwise/Relu6 Weights: 0 HostPersistent: 3200 DevicePersistent: 1053184 [10/07/2020-14:48:33] [V] [TRT] Layer: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/Relu6 Weights: 18432 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_pointwise/Relu6 Weights: 0 HostPersistent: 3200 DevicePersistent: 1053184 [10/07/2020-14:48:33] [V] [TRT] Layer: BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D Weights: 0 HostPersistent: 3200 DevicePersistent: 587264 [10/07/2020-14:48:33] [V] [TRT] Layer: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/Relu6 Weights: 18432 HostPersistent: 8 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6 Weights: 0 HostPersistent: 3200 DevicePersistent: 2102272 [10/07/2020-14:48:33] [V] [TRT] Layer: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/Relu6 Weights: 36864 HostPersistent: 8 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6 Weights: 0 HostPersistent: 3200 DevicePersistent: 4199424 [10/07/2020-14:48:33] [V] [TRT] Layer: BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D Weights: 2334720 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/Relu6 Weights: 1048576 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/Relu6 Weights: 4718592 HostPersistent: 8 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D Weights: 1167360 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/Relu6 Weights: 262144 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/Relu6 Weights: 1179648 HostPersistent: 8 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D Weights: 583680 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/Relu6 Weights: 131072 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/Relu6 Weights: 1179648 HostPersistent: 8 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D Weights: 583680 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/Relu6 Weights: 65536 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/Relu6 Weights: 294912 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D Weights: 291840 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: (Unnamed Layer* 288) [Shuffle] + BoxPredictor_0/Reshape_1 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: (Unnamed Layer* 296) [Shuffle] + BoxPredictor_1/Reshape_1 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: (Unnamed Layer* 304) [Shuffle] + BoxPredictor_2/Reshape_1 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: (Unnamed Layer* 312) [Shuffle] + BoxPredictor_3/Reshape_1 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: (Unnamed Layer* 320) [Shuffle] + BoxPredictor_4/Reshape_1 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: (Unnamed Layer* 328) [Shuffle] + BoxPredictor_5/Reshape_1 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: (Unnamed Layer* 147) [Shuffle] + BoxPredictor_0/Reshape Weights: 0 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: (Unnamed Layer* 183) [Shuffle] + BoxPredictor_1/Reshape Weights: 0 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: (Unnamed Layer* 205) [Shuffle] + BoxPredictor_2/Reshape Weights: 0 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: (Unnamed Layer* 227) [Shuffle] + BoxPredictor_3/Reshape Weights: 0 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: (Unnamed Layer* 249) [Shuffle] + BoxPredictor_4/Reshape Weights: 0 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: (Unnamed Layer* 271) [Shuffle] + BoxPredictor_5/Reshape Weights: 0 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: Squeeze Weights: 0 HostPersistent: 56 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: concat_box_conf Weights: 0 HostPersistent: 56 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: GridAnchor copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: GridAnchor_1 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: GridAnchor_2 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: GridAnchor_3 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: GridAnchor_4 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: GridAnchor_5 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Layer: NMS Weights: 0 HostPersistent: 40 DevicePersistent: 0 [10/07/2020-14:48:33] [V] [TRT] Total Host Persistent Memory: 45168 [10/07/2020-14:48:33] [V] [TRT] Total Device Persistent Memory: 13545984 [10/07/2020-14:48:33] [V] [TRT] Total Weight Memory: 14019968 [10/07/2020-14:48:33] [V] [TRT] Builder timing cache: created 81 entries, 8 hit(s) [10/07/2020-14:48:33] [V] [TRT] Engine generation completed in 68.8079 seconds. [10/07/2020-14:48:33] [V] [TRT] Engine Layer Information: [10/07/2020-14:48:33] [V] [TRT] Layer(PluginV2): GridAnchor, Tactic: 0, -> GridAnchor[Float(2,4332,1)], GridAnchor_1[Float(2,2400,1)], GridAnchor_2[Float(2,600,1)], GridAnchor_3[Float(2,216,1)], GridAnchor_4[Float(2,96,1)], GridAnchor_5[Float(2,24,1)] [10/07/2020-14:48:33] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6, Tactic: -3946921629105938337, Input[Float(3,300,300)] -> FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6[Float(32,150,150)] [10/07/2020-14:48:33] [V] [TRT] Layer(DepthwiseConvolution): FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/Relu6, Tactic: -1, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_0/Relu6[Float(32,150,150)] -> FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/Relu6[Float(32,150,150)] [10/07/2020-14:48:33] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6, Tactic: 6808617066150061604, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_depthwise/Relu6[Float(32,150,150)] -> FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6[Float(64,150,150)] [10/07/2020-14:48:33] [V] [TRT] Layer(DepthwiseConvolution): FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/Relu6, Tactic: -1, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_1_pointwise/Relu6[Float(64,150,150)] -> FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/Relu6[Float(64,75,75)] [10/07/2020-14:48:33] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6, Tactic: 9091006216302412844, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_depthwise/Relu6[Float(64,75,75)] -> FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6[Float(128,75,75)] [10/07/2020-14:48:33] [V] [TRT] Layer(DepthwiseConvolution): FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/Relu6, Tactic: -1, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_2_pointwise/Relu6[Float(128,75,75)] -> FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/Relu6[Float(128,75,75)] [10/07/2020-14:48:33] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6, Tactic: 9091006216302412844, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_depthwise/Relu6[Float(128,75,75)] -> FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6[Float(128,75,75)] [10/07/2020-14:48:33] [V] [TRT] Layer(DepthwiseConvolution): FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/Relu6, Tactic: -1, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_3_pointwise/Relu6[Float(128,75,75)] -> FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/Relu6[Float(128,38,38)] [10/07/2020-14:48:33] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6, Tactic: 9091006216302412844, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_depthwise/Relu6[Float(128,38,38)] -> FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6[Float(256,38,38)] [10/07/2020-14:48:33] [V] [TRT] Layer(DepthwiseConvolution): FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/Relu6, Tactic: -1, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_4_pointwise/Relu6[Float(256,38,38)] -> FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/Relu6[Float(256,38,38)] [10/07/2020-14:48:33] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6, Tactic: 9091006216302412844, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_depthwise/Relu6[Float(256,38,38)] -> FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6[Float(256,38,38)] [10/07/2020-14:48:33] [V] [TRT] Layer(DepthwiseConvolution): FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/Relu6, Tactic: -1, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_5_pointwise/Relu6[Float(256,38,38)] -> FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/Relu6[Float(256,19,19)] [10/07/2020-14:48:33] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6, Tactic: 9091006216302412844, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_depthwise/Relu6[Float(256,19,19)] -> FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6[Float(512,19,19)] [10/07/2020-14:48:33] [V] [TRT] Layer(DepthwiseConvolution): FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/Relu6, Tactic: -1, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_6_pointwise/Relu6[Float(512,19,19)] -> FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/Relu6[Float(512,19,19)] [10/07/2020-14:48:33] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6, Tactic: 9091006216302412844, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_depthwise/Relu6[Float(512,19,19)] -> FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6[Float(512,19,19)] [10/07/2020-14:48:33] [V] [TRT] Layer(DepthwiseConvolution): FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/Relu6, Tactic: -1, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_7_pointwise/Relu6[Float(512,19,19)] -> FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/Relu6[Float(512,19,19)] [10/07/2020-14:48:33] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_pointwise/Relu6, Tactic: 9091006216302412844, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_depthwise/Relu6[Float(512,19,19)] -> FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_pointwise/Relu6[Float(512,19,19)] [10/07/2020-14:48:33] [V] [TRT] Layer(DepthwiseConvolution): FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/Relu6, Tactic: -1, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_8_pointwise/Relu6[Float(512,19,19)] -> FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/Relu6[Float(512,19,19)] [10/07/2020-14:48:33] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_pointwise/Relu6, Tactic: 9091006216302412844, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_depthwise/Relu6[Float(512,19,19)] -> FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_pointwise/Relu6[Float(512,19,19)] [10/07/2020-14:48:33] [V] [TRT] Layer(DepthwiseConvolution): FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/Relu6, Tactic: -1, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_9_pointwise/Relu6[Float(512,19,19)] -> FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/Relu6[Float(512,19,19)] [10/07/2020-14:48:33] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_pointwise/Relu6, Tactic: 9091006216302412844, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_depthwise/Relu6[Float(512,19,19)] -> FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_pointwise/Relu6[Float(512,19,19)] [10/07/2020-14:48:33] [V] [TRT] Layer(DepthwiseConvolution): FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/Relu6, Tactic: -1, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_10_pointwise/Relu6[Float(512,19,19)] -> FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/Relu6[Float(512,19,19)] [10/07/2020-14:48:33] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_pointwise/Relu6, Tactic: 9091006216302412844, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_depthwise/Relu6[Float(512,19,19)] -> FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_pointwise/Relu6[Float(512,19,19)] [10/07/2020-14:48:33] [V] [TRT] Layer(scudnn): BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D, Tactic: 9091006216302412844, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_pointwise/Relu6[Float(512,19,19)] -> BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D[Float(285,19,19)] [10/07/2020-14:48:33] [V] [TRT] Layer(Convolution): FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/Relu6, Tactic: 0, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_11_pointwise/Relu6[Float(512,19,19)] -> FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/Relu6[Float(512,10,10)] [10/07/2020-14:48:33] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6, Tactic: 1754569683116234317, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_depthwise/Relu6[Float(512,10,10)] -> FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6[Float(1024,10,10)] [10/07/2020-14:48:33] [V] [TRT] Layer(Convolution): FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/depthwise + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/Relu6, Tactic: 2, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_12_pointwise/Relu6[Float(1024,10,10)] -> FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/Relu6[Float(1024,10,10)] [10/07/2020-14:48:33] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6, Tactic: 9091006216302412844, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_depthwise/Relu6[Float(1024,10,10)] -> FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6[Float(1024,10,10)] [10/07/2020-14:48:33] [V] [TRT] Layer(FusedConvActDirect): BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D, Tactic: 7798783, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6[Float(1024,10,10)] -> BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D[Float(570,10,10)] [10/07/2020-14:48:33] [V] [TRT] Layer(FusedConvActDirect): FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/Relu6, Tactic: 3997695, FeatureExtractor/MobilenetV1/MobilenetV1/Conv2d_13_pointwise/Relu6[Float(1024,10,10)] -> FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/Relu6[Float(256,10,10)] [10/07/2020-14:48:33] [V] [TRT] Layer(Convolution): FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/Relu6, Tactic: 0, FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_2_1x1_256/Relu6[Float(256,10,10)] -> FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/Relu6[Float(512,5,5)] [10/07/2020-14:48:33] [V] [TRT] Layer(FusedConvActDirect): BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D, Tactic: 3997695, FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/Relu6[Float(512,5,5)] -> BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D[Float(570,5,5)] [10/07/2020-14:48:33] [V] [TRT] Layer(FusedConvActDirect): FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/Relu6, Tactic: 9109503, FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_2_3x3_s2_512/Relu6[Float(512,5,5)] -> FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/Relu6[Float(128,5,5)] [10/07/2020-14:48:33] [V] [TRT] Layer(Convolution): FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/Relu6, Tactic: 0, FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_3_1x1_128/Relu6[Float(128,5,5)] -> FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/Relu6[Float(256,3,3)] [10/07/2020-14:48:33] [V] [TRT] Layer(FusedConvActDirect): BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D, Tactic: 5177343, FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/Relu6[Float(256,3,3)] -> BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D[Float(570,3,3)] [10/07/2020-14:48:33] [V] [TRT] Layer(FusedConvActDirect): FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/Relu6, Tactic: 9109503, FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_3_3x3_s2_256/Relu6[Float(256,3,3)] -> FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/Relu6[Float(128,3,3)] [10/07/2020-14:48:33] [V] [TRT] Layer(Convolution): FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/Relu6, Tactic: 0, FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_4_1x1_128/Relu6[Float(128,3,3)] -> FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/Relu6[Float(256,2,2)] [10/07/2020-14:48:33] [V] [TRT] Layer(FusedConvActDirect): BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D, Tactic: 5373951, FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/Relu6[Float(256,2,2)] -> BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D[Float(570,2,2)] [10/07/2020-14:48:33] [V] [TRT] Layer(FusedConvActDirect): FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/Relu6, Tactic: 2097151, FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_4_3x3_s2_256/Relu6[Float(256,2,2)] -> FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/Relu6[Float(64,2,2)] [10/07/2020-14:48:33] [V] [TRT] Layer(FusedConvActDirect): FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/mul_1 + FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/Relu6, Tactic: 458751, FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_1_Conv2d_5_1x1_64/Relu6[Float(64,2,2)] -> FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/Relu6[Float(128,1,1)] [10/07/2020-14:48:33] [V] [TRT] Layer(FusedConvActDirect): BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D, Tactic: 6750207, FeatureExtractor/MobilenetV1/Conv2d_13_pointwise_2_Conv2d_5_3x3_s2_128/Relu6[Float(128,1,1)] -> BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D[Float(570,1,1)] [10/07/2020-14:48:33] [V] [TRT] Layer(Shuffle): (Unnamed Layer* 288) [Shuffle] + BoxPredictor_0/Reshape_1, Tactic: 0, BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D[Float(273,19,19)] -> BoxPredictor_0/Reshape_1[Float(1083,91,1)] [10/07/2020-14:48:33] [V] [TRT] Layer(Shuffle): (Unnamed Layer* 296) [Shuffle] + BoxPredictor_1/Reshape_1, Tactic: 0, BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D[Float(546,10,10)] -> BoxPredictor_1/Reshape_1[Float(600,91,1)] [10/07/2020-14:48:33] [V] [TRT] Layer(Shuffle): (Unnamed Layer* 304) [Shuffle] + BoxPredictor_2/Reshape_1, Tactic: 0, BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D[Float(546,5,5)] -> BoxPredictor_2/Reshape_1[Float(150,91,1)] [10/07/2020-14:48:33] [V] [TRT] Layer(Shuffle): (Unnamed Layer* 312) [Shuffle] + BoxPredictor_3/Reshape_1, Tactic: 0, BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D[Float(546,3,3)] -> BoxPredictor_3/Reshape_1[Float(54,91,1)] [10/07/2020-14:48:33] [V] [TRT] Layer(Shuffle): (Unnamed Layer* 320) [Shuffle] + BoxPredictor_4/Reshape_1, Tactic: 0, BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D[Float(546,2,2)] -> BoxPredictor_4/Reshape_1[Float(24,91,1)] [10/07/2020-14:48:33] [V] [TRT] Layer(Shuffle): (Unnamed Layer* 328) [Shuffle] + BoxPredictor_5/Reshape_1, Tactic: 0, BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D[Float(546,1,1)] -> BoxPredictor_5/Reshape_1[Float(6,91,1)] [10/07/2020-14:48:33] [V] [TRT] Layer(Shuffle): (Unnamed Layer* 147) [Shuffle] + BoxPredictor_0/Reshape, Tactic: 0, BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D[Float(12,19,19)] -> BoxPredictor_0/Reshape[Float(1083,1,4)] [10/07/2020-14:48:33] [V] [TRT] Layer(Shuffle): (Unnamed Layer* 183) [Shuffle] + BoxPredictor_1/Reshape, Tactic: 0, BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D[Float(24,10,10)] -> BoxPredictor_1/Reshape[Float(600,1,4)] [10/07/2020-14:48:33] [V] [TRT] Layer(Shuffle): (Unnamed Layer* 205) [Shuffle] + BoxPredictor_2/Reshape, Tactic: 0, BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D[Float(24,5,5)] -> BoxPredictor_2/Reshape[Float(150,1,4)] [10/07/2020-14:48:33] [V] [TRT] Layer(Shuffle): (Unnamed Layer* 227) [Shuffle] + BoxPredictor_3/Reshape, Tactic: 0, BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D[Float(24,3,3)] -> BoxPredictor_3/Reshape[Float(54,1,4)] [10/07/2020-14:48:33] [V] [TRT] Layer(Shuffle): (Unnamed Layer* 249) [Shuffle] + BoxPredictor_4/Reshape, Tactic: 0, BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D[Float(24,2,2)] -> BoxPredictor_4/Reshape[Float(24,1,4)] [10/07/2020-14:48:33] [V] [TRT] Layer(Shuffle): (Unnamed Layer* 271) [Shuffle] + BoxPredictor_5/Reshape, Tactic: 0, BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D[Float(24,1,1)] -> BoxPredictor_5/Reshape[Float(6,1,4)] [10/07/2020-14:48:33] [V] [TRT] Layer(PluginV2): Squeeze, Tactic: 0, BoxPredictor_0/Reshape[Float(1083,1,4)], BoxPredictor_1/Reshape[Float(600,1,4)], BoxPredictor_2/Reshape[Float(150,1,4)], BoxPredictor_3/Reshape[Float(54,1,4)], BoxPredictor_4/Reshape[Float(24,1,4)], BoxPredictor_5/Reshape[Float(6,1,4)] -> Squeeze[Float(7668,1,1)] [10/07/2020-14:48:33] [V] [TRT] Layer(PluginV2): concat_box_conf, Tactic: 0, BoxPredictor_0/Reshape_1[Float(1083,91,1)], BoxPredictor_1/Reshape_1[Float(600,91,1)], BoxPredictor_2/Reshape_1[Float(150,91,1)], BoxPredictor_3/Reshape_1[Float(54,91,1)], BoxPredictor_4/Reshape_1[Float(24,91,1)], BoxPredictor_5/Reshape_1[Float(6,91,1)] -> concat_box_conf[Float(174447,1,1)] [10/07/2020-14:48:33] [V] [TRT] Layer(Reformat): GridAnchor copy, Tactic: 0, GridAnchor[Float(2,4332,1)] -> concat_priorbox[Float(2,4332,1)] [10/07/2020-14:48:33] [V] [TRT] Layer(Reformat): GridAnchor_1 copy, Tactic: 0, GridAnchor_1[Float(2,2400,1)] -> concat_priorbox[Float(2,2400,1)] [10/07/2020-14:48:33] [V] [TRT] Layer(Reformat): GridAnchor_2 copy, Tactic: 0, GridAnchor_2[Float(2,600,1)] -> concat_priorbox[Float(2,600,1)] [10/07/2020-14:48:33] [V] [TRT] Layer(Reformat): GridAnchor_3 copy, Tactic: 0, GridAnchor_3[Float(2,216,1)] -> concat_priorbox[Float(2,216,1)] [10/07/2020-14:48:33] [V] [TRT] Layer(Reformat): GridAnchor_4 copy, Tactic: 0, GridAnchor_4[Float(2,96,1)] -> concat_priorbox[Float(2,96,1)] [10/07/2020-14:48:33] [V] [TRT] Layer(Reformat): GridAnchor_5 copy, Tactic: 0, GridAnchor_5[Float(2,24,1)] -> concat_priorbox[Float(2,24,1)] [10/07/2020-14:48:33] [V] [TRT] Layer(PluginV2): NMS, Tactic: 0, Squeeze[Float(7668,1,1)], concat_priorbox[Float(2,7668,1)], concat_box_conf[Float(174447,1,1)] -> NMS[Float(1,100,7)], NMS_1[Float(1,1,1)] [10/07/2020-14:48:33] [I] Starting inference threads [10/07/2020-14:48:36] [I] Warmup completed 25 queries over 200 ms [10/07/2020-14:48:36] [I] Timing trace has 394 queries over 3.0165 s [10/07/2020-14:48:36] [I] Trace averages of 10 runs: [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 7.54309 ms - Host latency: 7.59514 ms (end to end 7.60731 ms, enqueue 1.92364 ms) [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 7.54151 ms - Host latency: 7.59364 ms (end to end 7.60601 ms, enqueue 1.90777 ms) [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 7.5424 ms - Host latency: 7.59429 ms (end to end 7.60565 ms, enqueue 1.91281 ms) [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 7.53729 ms - Host latency: 7.58933 ms (end to end 7.60202 ms, enqueue 1.94841 ms) [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 7.54477 ms - Host latency: 7.59688 ms (end to end 7.60927 ms, enqueue 1.86848 ms) [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 7.54048 ms - Host latency: 7.59251 ms (end to end 7.60453 ms, enqueue 1.92799 ms) [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 7.54045 ms - Host latency: 7.59271 ms (end to end 7.60461 ms, enqueue 1.92887 ms) [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 7.54506 ms - Host latency: 7.59695 ms (end to end 7.6095 ms, enqueue 1.8877 ms) [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 7.54225 ms - Host latency: 7.59445 ms (end to end 7.60625 ms, enqueue 1.9109 ms) [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 7.54362 ms - Host latency: 7.5955 ms (end to end 7.60793 ms, enqueue 1.89942 ms) [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 7.55065 ms - Host latency: 7.6025 ms (end to end 7.61557 ms, enqueue 1.86641 ms) [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 7.55376 ms - Host latency: 7.60562 ms (end to end 7.61837 ms, enqueue 1.86847 ms) [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 7.54077 ms - Host latency: 7.59244 ms (end to end 7.60437 ms, enqueue 1.86075 ms) [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 7.54395 ms - Host latency: 7.59591 ms (end to end 7.60862 ms, enqueue 1.87322 ms) [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 7.53779 ms - Host latency: 7.58944 ms (end to end 7.60219 ms, enqueue 1.96628 ms) [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 7.54163 ms - Host latency: 7.59338 ms (end to end 7.60609 ms, enqueue 1.93069 ms) [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 7.54241 ms - Host latency: 7.59429 ms (end to end 7.60762 ms, enqueue 1.92557 ms) [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 7.5375 ms - Host latency: 7.58906 ms (end to end 7.60104 ms, enqueue 1.9288 ms) [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 7.53829 ms - Host latency: 7.59015 ms (end to end 7.60345 ms, enqueue 1.90326 ms) [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 8.31039 ms - Host latency: 8.36554 ms (end to end 8.37277 ms, enqueue 2.02119 ms) [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 8.36072 ms - Host latency: 8.4167 ms (end to end 8.44925 ms, enqueue 2.0714 ms) [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 7.87266 ms - Host latency: 7.92676 ms (end to end 7.93762 ms, enqueue 2.05005 ms) [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 7.5452 ms - Host latency: 7.59709 ms (end to end 7.61149 ms, enqueue 1.88014 ms) [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 7.53651 ms - Host latency: 7.58851 ms (end to end 7.60104 ms, enqueue 2.00715 ms) [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 7.54419 ms - Host latency: 7.59641 ms (end to end 7.6085 ms, enqueue 1.91606 ms) [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 7.54324 ms - Host latency: 7.59551 ms (end to end 7.60898 ms, enqueue 1.89016 ms) [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 7.53579 ms - Host latency: 7.5876 ms (end to end 7.60034 ms, enqueue 1.89814 ms) [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 7.54846 ms - Host latency: 7.60049 ms (end to end 7.61313 ms, enqueue 1.87539 ms) [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 7.53948 ms - Host latency: 7.59145 ms (end to end 7.60452 ms, enqueue 1.9082 ms) [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 7.54846 ms - Host latency: 7.60068 ms (end to end 7.61323 ms, enqueue 1.86057 ms) [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 7.54402 ms - Host latency: 7.59595 ms (end to end 7.60823 ms, enqueue 1.88806 ms) [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 7.54072 ms - Host latency: 7.59272 ms (end to end 7.60627 ms, enqueue 1.96294 ms) [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 7.53779 ms - Host latency: 7.58962 ms (end to end 7.60056 ms, enqueue 2.18694 ms) [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 7.54614 ms - Host latency: 7.59797 ms (end to end 7.61018 ms, enqueue 2.07542 ms) [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 7.5428 ms - Host latency: 7.59458 ms (end to end 7.60713 ms, enqueue 2.14048 ms) [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 7.54094 ms - Host latency: 7.59275 ms (end to end 7.6053 ms, enqueue 1.88945 ms) [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 7.53757 ms - Host latency: 7.5894 ms (end to end 7.60286 ms, enqueue 1.98809 ms) [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 7.54023 ms - Host latency: 7.59238 ms (end to end 7.60439 ms, enqueue 1.90828 ms) [10/07/2020-14:48:36] [I] Average on 10 runs - GPU latency: 7.5498 ms - Host latency: 7.60151 ms (end to end 7.6123 ms, enqueue 1.895 ms) [10/07/2020-14:48:36] [I] Host Latency [10/07/2020-14:48:36] [I] min: 7.55829 ms (end to end 7.565 ms) [10/07/2020-14:48:36] [I] max: 9.70496 ms (end to end 9.71106 ms) [10/07/2020-14:48:36] [I] mean: 7.64318 ms (end to end 7.65602 ms) [10/07/2020-14:48:36] [I] median: 7.59372 ms (end to end 7.60635 ms) [10/07/2020-14:48:36] [I] percentile: 9.23779 ms at 99% (end to end 9.24146 ms at 99%) [10/07/2020-14:48:36] [I] throughput: 130.615 qps [10/07/2020-14:48:36] [I] walltime: 3.0165 s [10/07/2020-14:48:36] [I] Enqueue Time [10/07/2020-14:48:36] [I] min: 1.78223 ms [10/07/2020-14:48:36] [I] max: 2.76074 ms [10/07/2020-14:48:36] [I] median: 1.90768 ms [10/07/2020-14:48:36] [I] GPU Compute [10/07/2020-14:48:36] [I] min: 7.50592 ms [10/07/2020-14:48:36] [I] max: 9.64709 ms [10/07/2020-14:48:36] [I] mean: 7.591 ms [10/07/2020-14:48:36] [I] median: 7.54175 ms [10/07/2020-14:48:36] [I] percentile: 9.18213 ms at 99% [10/07/2020-14:48:36] [I] total compute time: 2.99086 s &&&& PASSED TensorRT.trtexec # /usr/src/tensorrt/bin/trtexec --verbose --uff=frozen_inference_graph.uff --batch=1 --uffInput=Input,3,300,300 --output=NMS --saveEngine=mobilenetssd.trt