root@f96e084d7778:/Studienarbeit/tensorflow_od/uff/test# /usr/src/tensorrt/bin/trtexec --uff=frozen_inference_graph.uff --uffInput=Input,3,300,300 --output=NMS --verbose &&&& RUNNING TensorRT.trtexec # /usr/src/tensorrt/bin/trtexec --uff=frozen_inference_graph.uff --uffInput=Input,3,300,300 --output=NMS --verbose [01/19/2021-17:50:32] [I] === Model Options === [01/19/2021-17:50:32] [I] Format: UFF [01/19/2021-17:50:32] [I] Model: frozen_inference_graph.uff [01/19/2021-17:50:32] [I] Uff Inputs Layout: NCHW [01/19/2021-17:50:32] [I] Input: Input,3,300,300 [01/19/2021-17:50:32] [I] Output: NMS [01/19/2021-17:50:32] [I] === Build Options === [01/19/2021-17:50:32] [I] Max batch: 1 [01/19/2021-17:50:32] [I] Workspace: 16 MB [01/19/2021-17:50:32] [I] minTiming: 1 [01/19/2021-17:50:32] [I] avgTiming: 8 [01/19/2021-17:50:32] [I] Precision: FP32 [01/19/2021-17:50:32] [I] Calibration: [01/19/2021-17:50:32] [I] Safe mode: Disabled [01/19/2021-17:50:32] [I] Save engine: [01/19/2021-17:50:32] [I] Load engine: [01/19/2021-17:50:32] [I] Inputs format: fp32:CHW [01/19/2021-17:50:32] [I] Outputs format: fp32:CHW [01/19/2021-17:50:32] [I] Input build shapes: model [01/19/2021-17:50:32] [I] === System Options === [01/19/2021-17:50:32] [I] Device: 0 [01/19/2021-17:50:32] [I] DLACore: [01/19/2021-17:50:32] [I] Plugins: [01/19/2021-17:50:32] [I] === Inference Options === [01/19/2021-17:50:32] [I] Batch: 1 [01/19/2021-17:50:32] [I] Iterations: 10 [01/19/2021-17:50:32] [I] Duration: 3s (+ 200ms warm up) [01/19/2021-17:50:32] [I] Sleep time: 0ms [01/19/2021-17:50:32] [I] Streams: 1 [01/19/2021-17:50:32] [I] ExposeDMA: Disabled [01/19/2021-17:50:32] [I] Spin-wait: Disabled [01/19/2021-17:50:32] [I] Multithreading: Disabled [01/19/2021-17:50:32] [I] CUDA Graph: Disabled [01/19/2021-17:50:32] [I] Skip inference: Disabled [01/19/2021-17:50:32] [I] Input inference shapes: model [01/19/2021-17:50:32] [I] Inputs: [01/19/2021-17:50:32] [I] === Reporting Options === [01/19/2021-17:50:32] [I] Verbose: Enabled [01/19/2021-17:50:32] [I] Averages: 10 inferences [01/19/2021-17:50:32] [I] Percentile: 99 [01/19/2021-17:50:32] [I] Dump output: Disabled [01/19/2021-17:50:32] [I] Profile: Disabled [01/19/2021-17:50:32] [I] Export timing to JSON file: [01/19/2021-17:50:32] [I] Export output to JSON file: [01/19/2021-17:50:32] [I] Export profile to JSON file: [01/19/2021-17:50:32] [I] [01/19/2021-17:50:32] [V] [TRT] Plugin creator registration succeeded - ::GridAnchor_TRT [01/19/2021-17:50:32] [V] [TRT] Plugin creator registration succeeded - ::NMS_TRT [01/19/2021-17:50:32] [V] [TRT] Plugin creator registration succeeded - ::Reorg_TRT [01/19/2021-17:50:32] [V] [TRT] Plugin creator registration succeeded - ::Region_TRT [01/19/2021-17:50:32] [V] [TRT] Plugin creator registration succeeded - ::Clip_TRT [01/19/2021-17:50:32] [V] [TRT] Plugin creator registration succeeded - ::LReLU_TRT [01/19/2021-17:50:32] [V] [TRT] Plugin creator registration succeeded - ::PriorBox_TRT [01/19/2021-17:50:32] [V] [TRT] Plugin creator registration succeeded - ::Normalize_TRT [01/19/2021-17:50:32] [V] [TRT] Plugin creator registration succeeded - ::RPROI_TRT [01/19/2021-17:50:32] [V] [TRT] Plugin creator registration succeeded - ::BatchedNMS_TRT [01/19/2021-17:50:32] [V] [TRT] Plugin creator registration succeeded - ::FlattenConcat_TRT [01/19/2021-17:50:32] [V] [TRT] Plugin creator registration succeeded - ::CropAndResize [01/19/2021-17:50:32] [V] [TRT] Plugin creator registration succeeded - ::DetectionLayer_TRT [01/19/2021-17:50:32] [V] [TRT] Plugin creator registration succeeded - ::Proposal [01/19/2021-17:50:32] [V] [TRT] Plugin creator registration succeeded - ::ProposalLayer_TRT [01/19/2021-17:50:32] [V] [TRT] Plugin creator registration succeeded - ::PyramidROIAlign_TRT [01/19/2021-17:50:32] [V] [TRT] Plugin creator registration succeeded - ::ResizeNearest_TRT [01/19/2021-17:50:32] [V] [TRT] Plugin creator registration succeeded - ::Split [01/19/2021-17:50:32] [V] [TRT] Plugin creator registration succeeded - ::SpecialSlice_TRT [01/19/2021-17:50:32] [V] [TRT] Plugin creator registration succeeded - ::InstanceNormalization_TRT [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing Input[Op: Input]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: Input -> [3,300,300] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: Input [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/Conv/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/Conv/weights -> [3,3,3,32] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/Conv/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/Conv/Conv2D[Op: Conv]. Inputs: Input, FeatureExtractor/MobilenetV2/Conv/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/Conv/Conv2D -> [32,150,150] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/Conv/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/Conv/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/Conv/BatchNorm/moving_variance -> [32] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/Conv/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/Conv/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/Conv/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/Conv/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/Conv/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/Conv/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/Conv/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/Conv/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/Conv/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/Conv/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/Conv/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/Conv/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/Conv/BatchNorm/gamma -> [32] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/Conv/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/Conv/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/Conv/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/Conv/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/Conv/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/Conv/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/Conv/Conv2D, FeatureExtractor/MobilenetV2/Conv/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/Conv/BatchNorm/batchnorm/mul_1 -> [32,150,150] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/Conv/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/Conv/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/Conv/BatchNorm/beta -> [32] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/Conv/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/Conv/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/Conv/BatchNorm/moving_mean -> [32] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/Conv/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/Conv/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/Conv/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/Conv/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/Conv/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/Conv/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/Conv/BatchNorm/beta, FeatureExtractor/MobilenetV2/Conv/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/Conv/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/Conv/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/Conv/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/Conv/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/Conv/BatchNorm/batchnorm/add_1 -> [32,150,150] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/Conv/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/Conv/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/Conv/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 9) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/Conv/Relu6 -> [32,150,150] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/Conv/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv/depthwise/depthwise_weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/depthwise_weights -> [3,3,32,1] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv/depthwise/depthwise[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/Conv/Relu6, FeatureExtractor/MobilenetV2/expanded_conv/depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/depthwise -> [32,150,150] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/depthwise [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/moving_variance -> [32] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/gamma -> [32] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/depthwise, FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/batchnorm/mul_1 -> [32,150,150] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/beta -> [32] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/moving_mean -> [32] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/batchnorm/add_1 -> [32,150,150] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv/depthwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 19) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/Relu6 -> [32,150,150] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv/project/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv/project/weights -> [1,1,32,16] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv/project/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv/project/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/Relu6, FeatureExtractor/MobilenetV2/expanded_conv/project/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv/project/Conv2D -> [16,150,150] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv/project/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/moving_variance -> [16] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/gamma -> [16] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv/project/Conv2D, FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/batchnorm/mul_1 -> [16,150,150] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/beta -> [16] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/moving_mean -> [16] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/batchnorm/add_1 -> [16,150,150] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/expand/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/weights -> [1,1,16,96] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/batchnorm/add_1, FeatureExtractor/MobilenetV2/expanded_conv_1/expand/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Conv2D -> [96,150,150] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/moving_variance -> [96] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/gamma -> [96] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Conv2D, FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/batchnorm/mul_1 -> [96,150,150] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/beta -> [96] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/moving_mean -> [96] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/batchnorm/add_1 -> [96,150,150] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 38) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Relu6 -> [96,150,150] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/depthwise_weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/depthwise_weights -> [3,3,96,1] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/depthwise[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Relu6, FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/depthwise -> [96,75,75] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/depthwise [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/moving_variance -> [96] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/gamma -> [96] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/depthwise, FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/batchnorm/mul_1 -> [96,75,75] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/beta -> [96] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/moving_mean -> [96] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/batchnorm/add_1 -> [96,75,75] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 48) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/Relu6 -> [96,75,75] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/project/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_1/project/weights -> [1,1,96,24] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/project/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/project/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/Relu6, FeatureExtractor/MobilenetV2/expanded_conv_1/project/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_1/project/Conv2D -> [24,75,75] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/project/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/moving_variance -> [24] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/gamma -> [24] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_1/project/Conv2D, FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/batchnorm/mul_1 -> [24,75,75] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/beta -> [24] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/moving_mean -> [24] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/batchnorm/add_1 -> [24,75,75] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/expand/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/weights -> [1,1,24,144] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/batchnorm/add_1, FeatureExtractor/MobilenetV2/expanded_conv_2/expand/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Conv2D -> [144,75,75] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/moving_variance -> [144] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/gamma -> [144] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Conv2D, FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/batchnorm/mul_1 -> [144,75,75] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/beta -> [144] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/moving_mean -> [144] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/batchnorm/add_1 -> [144,75,75] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 67) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Relu6 -> [144,75,75] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/depthwise_weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/depthwise_weights -> [3,3,144,1] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/depthwise[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Relu6, FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/depthwise -> [144,75,75] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/depthwise [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/moving_variance -> [144] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/gamma -> [144] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/depthwise, FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/batchnorm/mul_1 -> [144,75,75] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/beta -> [144] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/moving_mean -> [144] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/batchnorm/add_1 -> [144,75,75] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 77) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/Relu6 -> [144,75,75] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/project/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_2/project/weights -> [1,1,144,24] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/project/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/project/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/Relu6, FeatureExtractor/MobilenetV2/expanded_conv_2/project/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_2/project/Conv2D -> [24,75,75] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/project/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/moving_variance -> [24] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/gamma -> [24] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_2/project/Conv2D, FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/batchnorm/mul_1 -> [24,75,75] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/beta -> [24] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/moving_mean -> [24] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/batchnorm/add_1 -> [24,75,75] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_2/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/batchnorm/add_1, FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_2/add -> [24,75,75] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_2/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/expand/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/weights -> [1,1,24,144] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_2/add, FeatureExtractor/MobilenetV2/expanded_conv_3/expand/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Conv2D -> [144,75,75] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/moving_variance -> [144] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/gamma -> [144] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Conv2D, FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/batchnorm/mul_1 -> [144,75,75] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/beta -> [144] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/moving_mean -> [144] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/batchnorm/add_1 -> [144,75,75] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 97) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Relu6 -> [144,75,75] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/depthwise_weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/depthwise_weights -> [3,3,144,1] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/depthwise[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Relu6, FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/depthwise -> [144,38,38] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/depthwise [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/moving_variance -> [144] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/gamma -> [144] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/depthwise, FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/batchnorm/mul_1 -> [144,38,38] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/beta -> [144] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/moving_mean -> [144] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/batchnorm/add_1 -> [144,38,38] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 107) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/Relu6 -> [144,38,38] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/project/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_3/project/weights -> [1,1,144,32] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/project/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/project/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/Relu6, FeatureExtractor/MobilenetV2/expanded_conv_3/project/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_3/project/Conv2D -> [32,38,38] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/project/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/moving_variance -> [32] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/gamma -> [32] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_3/project/Conv2D, FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/batchnorm/mul_1 -> [32,38,38] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/beta -> [32] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/moving_mean -> [32] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/batchnorm/add_1 -> [32,38,38] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/expand/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/weights -> [1,1,32,192] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/batchnorm/add_1, FeatureExtractor/MobilenetV2/expanded_conv_4/expand/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Conv2D -> [192,38,38] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/moving_variance -> [192] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/gamma -> [192] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Conv2D, FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/batchnorm/mul_1 -> [192,38,38] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/beta -> [192] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/moving_mean -> [192] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/batchnorm/add_1 -> [192,38,38] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 126) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Relu6 -> [192,38,38] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/depthwise_weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/depthwise_weights -> [3,3,192,1] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/depthwise[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Relu6, FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/depthwise -> [192,38,38] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/depthwise [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/moving_variance -> [192] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/gamma -> [192] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/depthwise, FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/batchnorm/mul_1 -> [192,38,38] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/beta -> [192] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/moving_mean -> [192] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/batchnorm/add_1 -> [192,38,38] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 136) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/Relu6 -> [192,38,38] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/project/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_4/project/weights -> [1,1,192,32] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/project/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/project/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/Relu6, FeatureExtractor/MobilenetV2/expanded_conv_4/project/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_4/project/Conv2D -> [32,38,38] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/project/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/moving_variance -> [32] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/gamma -> [32] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_4/project/Conv2D, FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/batchnorm/mul_1 -> [32,38,38] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/beta -> [32] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/moving_mean -> [32] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/batchnorm/add_1 -> [32,38,38] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_4/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/batchnorm/add_1, FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_4/add -> [32,38,38] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_4/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/expand/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/weights -> [1,1,32,192] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_4/add, FeatureExtractor/MobilenetV2/expanded_conv_5/expand/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Conv2D -> [192,38,38] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/moving_variance -> [192] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/gamma -> [192] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Conv2D, FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/batchnorm/mul_1 -> [192,38,38] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/beta -> [192] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/moving_mean -> [192] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/batchnorm/add_1 -> [192,38,38] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 156) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Relu6 -> [192,38,38] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/depthwise_weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/depthwise_weights -> [3,3,192,1] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/depthwise[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Relu6, FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/depthwise -> [192,38,38] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/depthwise [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/moving_variance -> [192] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/gamma -> [192] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/depthwise, FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/batchnorm/mul_1 -> [192,38,38] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/beta -> [192] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/moving_mean -> [192] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/batchnorm/add_1 -> [192,38,38] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 166) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/Relu6 -> [192,38,38] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/project/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_5/project/weights -> [1,1,192,32] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/project/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/project/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/Relu6, FeatureExtractor/MobilenetV2/expanded_conv_5/project/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_5/project/Conv2D -> [32,38,38] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/project/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/moving_variance -> [32] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/gamma -> [32] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_5/project/Conv2D, FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/batchnorm/mul_1 -> [32,38,38] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/beta -> [32] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/moving_mean -> [32] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/batchnorm/add_1 -> [32,38,38] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_5/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/batchnorm/add_1, FeatureExtractor/MobilenetV2/expanded_conv_4/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_5/add -> [32,38,38] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_5/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/expand/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/weights -> [1,1,32,192] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_5/add, FeatureExtractor/MobilenetV2/expanded_conv_6/expand/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Conv2D -> [192,38,38] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/moving_variance -> [192] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/gamma -> [192] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Conv2D, FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/batchnorm/mul_1 -> [192,38,38] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/beta -> [192] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/moving_mean -> [192] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/batchnorm/add_1 -> [192,38,38] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 186) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Relu6 -> [192,38,38] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/depthwise_weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/depthwise_weights -> [3,3,192,1] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/depthwise[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Relu6, FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/depthwise -> [192,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/depthwise [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/moving_variance -> [192] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/gamma -> [192] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/depthwise, FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/batchnorm/mul_1 -> [192,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/beta -> [192] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/moving_mean -> [192] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/batchnorm/add_1 -> [192,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 196) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/Relu6 -> [192,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/project/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_6/project/weights -> [1,1,192,64] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/project/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/project/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/Relu6, FeatureExtractor/MobilenetV2/expanded_conv_6/project/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_6/project/Conv2D -> [64,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/project/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/moving_variance -> [64] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/gamma -> [64] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_6/project/Conv2D, FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/batchnorm/mul_1 -> [64,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/beta -> [64] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/moving_mean -> [64] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/batchnorm/add_1 -> [64,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/expand/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/weights -> [1,1,64,384] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/batchnorm/add_1, FeatureExtractor/MobilenetV2/expanded_conv_7/expand/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D -> [384,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/moving_variance -> [384] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/gamma -> [384] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D, FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/batchnorm/mul_1 -> [384,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/beta -> [384] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/moving_mean -> [384] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/batchnorm/add_1 -> [384,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 215) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6 -> [384,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise_weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise_weights -> [3,3,384,1] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6, FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise -> [384,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/moving_variance -> [384] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/gamma -> [384] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise, FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/batchnorm/mul_1 -> [384,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/beta -> [384] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/moving_mean -> [384] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/batchnorm/add_1 -> [384,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 225) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6 -> [384,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/project/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_7/project/weights -> [1,1,384,64] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/project/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6, FeatureExtractor/MobilenetV2/expanded_conv_7/project/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D -> [64,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/moving_variance -> [64] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/gamma -> [64] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D, FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/batchnorm/mul_1 -> [64,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/beta -> [64] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/moving_mean -> [64] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/batchnorm/add_1 -> [64,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_7/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/batchnorm/add_1, FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_7/add -> [64,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_7/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/expand/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/weights -> [1,1,64,384] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_7/add, FeatureExtractor/MobilenetV2/expanded_conv_8/expand/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Conv2D -> [384,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/moving_variance -> [384] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/gamma -> [384] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Conv2D, FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/batchnorm/mul_1 -> [384,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/beta -> [384] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/moving_mean -> [384] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/batchnorm/add_1 -> [384,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 245) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Relu6 -> [384,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/depthwise_weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/depthwise_weights -> [3,3,384,1] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/depthwise[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Relu6, FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/depthwise -> [384,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/depthwise [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/moving_variance -> [384] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/gamma -> [384] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/depthwise, FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/batchnorm/mul_1 -> [384,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/beta -> [384] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/moving_mean -> [384] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/batchnorm/add_1 -> [384,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 255) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/Relu6 -> [384,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/project/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_8/project/weights -> [1,1,384,64] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/project/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/project/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/Relu6, FeatureExtractor/MobilenetV2/expanded_conv_8/project/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_8/project/Conv2D -> [64,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/project/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/moving_variance -> [64] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/gamma -> [64] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_8/project/Conv2D, FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/batchnorm/mul_1 -> [64,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/beta -> [64] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/moving_mean -> [64] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/batchnorm/add_1 -> [64,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_8/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/batchnorm/add_1, FeatureExtractor/MobilenetV2/expanded_conv_7/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_8/add -> [64,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_8/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/expand/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/weights -> [1,1,64,384] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_8/add, FeatureExtractor/MobilenetV2/expanded_conv_9/expand/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Conv2D -> [384,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/moving_variance -> [384] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/gamma -> [384] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Conv2D, FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/batchnorm/mul_1 -> [384,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/beta -> [384] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/moving_mean -> [384] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/batchnorm/add_1 -> [384,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 275) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Relu6 -> [384,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/depthwise_weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/depthwise_weights -> [3,3,384,1] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/depthwise[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Relu6, FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/depthwise -> [384,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/depthwise [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/moving_variance -> [384] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/gamma -> [384] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/depthwise, FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/batchnorm/mul_1 -> [384,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/beta -> [384] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/moving_mean -> [384] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/batchnorm/add_1 -> [384,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 285) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/Relu6 -> [384,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/project/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_9/project/weights -> [1,1,384,64] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/project/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/project/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/Relu6, FeatureExtractor/MobilenetV2/expanded_conv_9/project/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_9/project/Conv2D -> [64,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/project/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/moving_variance -> [64] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/gamma -> [64] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_9/project/Conv2D, FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/batchnorm/mul_1 -> [64,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/beta -> [64] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/moving_mean -> [64] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/batchnorm/add_1 -> [64,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_9/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/batchnorm/add_1, FeatureExtractor/MobilenetV2/expanded_conv_8/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_9/add -> [64,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_9/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/expand/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/weights -> [1,1,64,384] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_9/add, FeatureExtractor/MobilenetV2/expanded_conv_10/expand/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Conv2D -> [384,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/moving_variance -> [384] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/gamma -> [384] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Conv2D, FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/batchnorm/mul_1 -> [384,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/beta -> [384] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/moving_mean -> [384] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/batchnorm/add_1 -> [384,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 305) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Relu6 -> [384,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/depthwise_weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/depthwise_weights -> [3,3,384,1] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/depthwise[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Relu6, FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/depthwise -> [384,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/depthwise [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/moving_variance -> [384] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/gamma -> [384] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/depthwise, FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/batchnorm/mul_1 -> [384,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/beta -> [384] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/moving_mean -> [384] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/batchnorm/add_1 -> [384,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 315) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/Relu6 -> [384,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/project/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_10/project/weights -> [1,1,384,96] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/project/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/Relu6, FeatureExtractor/MobilenetV2/expanded_conv_10/project/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D -> [96,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/moving_variance -> [96] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/gamma -> [96] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D, FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/batchnorm/mul_1 -> [96,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/beta -> [96] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/moving_mean -> [96] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/batchnorm/add_1 -> [96,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/expand/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/weights -> [1,1,96,576] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/batchnorm/add_1, FeatureExtractor/MobilenetV2/expanded_conv_11/expand/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D -> [576,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/moving_variance -> [576] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/gamma -> [576] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D, FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/batchnorm/mul_1 -> [576,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/beta -> [576] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/moving_mean -> [576] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/batchnorm/add_1 -> [576,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 334) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6 -> [576,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise_weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise_weights -> [3,3,576,1] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6, FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise -> [576,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/moving_variance -> [576] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/gamma -> [576] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise, FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/batchnorm/mul_1 -> [576,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/beta -> [576] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/moving_mean -> [576] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/batchnorm/add_1 -> [576,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 344) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6 -> [576,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/project/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_11/project/weights -> [1,1,576,96] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/project/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6, FeatureExtractor/MobilenetV2/expanded_conv_11/project/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D -> [96,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/moving_variance -> [96] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/gamma -> [96] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D, FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/batchnorm/mul_1 -> [96,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/beta -> [96] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/moving_mean -> [96] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/batchnorm/add_1 -> [96,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_11/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/batchnorm/add_1, FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_11/add -> [96,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_11/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/expand/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/weights -> [1,1,96,576] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_11/add, FeatureExtractor/MobilenetV2/expanded_conv_12/expand/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Conv2D -> [576,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/moving_variance -> [576] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/gamma -> [576] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Conv2D, FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/batchnorm/mul_1 -> [576,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/beta -> [576] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/moving_mean -> [576] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/batchnorm/add_1 -> [576,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 364) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Relu6 -> [576,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/depthwise_weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/depthwise_weights -> [3,3,576,1] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/depthwise[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Relu6, FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/depthwise -> [576,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/depthwise [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/moving_variance -> [576] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/gamma -> [576] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/depthwise, FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/batchnorm/mul_1 -> [576,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/beta -> [576] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/moving_mean -> [576] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/batchnorm/add_1 -> [576,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 374) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/Relu6 -> [576,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/project/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_12/project/weights -> [1,1,576,96] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/project/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/project/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/Relu6, FeatureExtractor/MobilenetV2/expanded_conv_12/project/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_12/project/Conv2D -> [96,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/project/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/moving_variance -> [96] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/gamma -> [96] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_12/project/Conv2D, FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/batchnorm/mul_1 -> [96,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/beta -> [96] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/moving_mean -> [96] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/batchnorm/add_1 -> [96,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_12/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/batchnorm/add_1, FeatureExtractor/MobilenetV2/expanded_conv_11/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_12/add -> [96,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_12/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/expand/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/weights -> [1,1,96,576] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_12/add, FeatureExtractor/MobilenetV2/expanded_conv_13/expand/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Conv2D -> [576,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/moving_variance -> [576] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/gamma -> [576] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Conv2D, FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/batchnorm/mul_1 -> [576,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/beta -> [576] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/moving_mean -> [576] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/batchnorm/add_1 -> [576,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 394) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6 -> [576,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_0/ClassPredictor/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_0/ClassPredictor/weights -> [3,3,576,273] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/ClassPredictor/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_0/ClassPredictor/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6, BoxPredictor_0/ClassPredictor/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_0/ClassPredictor/Conv2D -> [273,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/ClassPredictor/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_0/ClassPredictor/biases[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_0/ClassPredictor/biases -> [273] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/ClassPredictor/biases [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_0/ClassPredictor/BiasAdd[Op: Binary]. Inputs: BoxPredictor_0/ClassPredictor/Conv2D, BoxPredictor_0/ClassPredictor/biases [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_0/ClassPredictor/BiasAdd -> [273,19,19] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/ClassPredictor/BiasAdd [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_0/Shape[Op: Shape]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/Shape [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_0/strided_slice/stack[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_0/strided_slice/stack -> [1] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/strided_slice/stack [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_0/strided_slice/stack_1[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_0/strided_slice/stack_1 -> [1] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/strided_slice/stack_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_0/strided_slice/stack_2[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_0/strided_slice/stack_2 -> [1] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/strided_slice/stack_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_0/strided_slice[Op: StridedSlice]. Inputs: BoxPredictor_0/Shape, BoxPredictor_0/strided_slice/stack, BoxPredictor_0/strided_slice/stack_1, BoxPredictor_0/strided_slice/stack_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/strided_slice [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_0/stack_1/1[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_0/stack_1/1 -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/stack_1/1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_0/stack_1/2[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_0/stack_1/2 -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/stack_1/2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_0/stack_1[Op: Stack]. Inputs: BoxPredictor_0/strided_slice, BoxPredictor_0/stack_1/1, BoxPredictor_0/stack_1/2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/stack_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_0/Reshape_1[Op: Reshape]. Inputs: BoxPredictor_0/ClassPredictor/BiasAdd, BoxPredictor_0/stack_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_0/Reshape_1 -> [1083,91,1] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/Reshape_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise_weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise_weights -> [3,3,576,1] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6, FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise -> [576,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/moving_variance -> [576] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/gamma -> [576] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise, FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/batchnorm/mul_1 -> [576,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/beta -> [576] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/moving_mean -> [576] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/batchnorm/add_1 -> [576,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 415) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6 -> [576,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/project/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_13/project/weights -> [1,1,576,160] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/project/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6, FeatureExtractor/MobilenetV2/expanded_conv_13/project/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D -> [160,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/moving_variance -> [160] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/gamma -> [160] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D, FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/batchnorm/mul_1 -> [160,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/beta -> [160] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/moving_mean -> [160] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/batchnorm/add_1 -> [160,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/expand/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/weights -> [1,1,160,960] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/batchnorm/add_1, FeatureExtractor/MobilenetV2/expanded_conv_14/expand/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D -> [960,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/moving_variance -> [960] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/gamma -> [960] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D, FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/batchnorm/mul_1 -> [960,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/beta -> [960] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/moving_mean -> [960] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/batchnorm/add_1 -> [960,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 434) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6 -> [960,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise_weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise_weights -> [3,3,960,1] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6, FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise -> [960,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/moving_variance -> [960] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/gamma -> [960] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise, FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/batchnorm/mul_1 -> [960,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/beta -> [960] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/moving_mean -> [960] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/batchnorm/add_1 -> [960,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 444) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6 -> [960,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/project/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_14/project/weights -> [1,1,960,160] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/project/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6, FeatureExtractor/MobilenetV2/expanded_conv_14/project/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D -> [160,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/moving_variance -> [160] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/gamma -> [160] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D, FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/batchnorm/mul_1 -> [160,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/beta -> [160] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/moving_mean -> [160] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/batchnorm/add_1 -> [160,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_14/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/batchnorm/add_1, FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_14/add -> [160,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_14/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/expand/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/weights -> [1,1,160,960] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_14/add, FeatureExtractor/MobilenetV2/expanded_conv_15/expand/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Conv2D -> [960,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/moving_variance -> [960] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/gamma -> [960] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Conv2D, FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/batchnorm/mul_1 -> [960,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/beta -> [960] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/moving_mean -> [960] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/batchnorm/add_1 -> [960,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 464) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Relu6 -> [960,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/depthwise_weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/depthwise_weights -> [3,3,960,1] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/depthwise[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Relu6, FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/depthwise -> [960,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/depthwise [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/moving_variance -> [960] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/gamma -> [960] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/depthwise, FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/batchnorm/mul_1 -> [960,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/beta -> [960] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/moving_mean -> [960] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/batchnorm/add_1 -> [960,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 474) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/Relu6 -> [960,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/project/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_15/project/weights -> [1,1,960,160] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/project/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/project/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/Relu6, FeatureExtractor/MobilenetV2/expanded_conv_15/project/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_15/project/Conv2D -> [160,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/project/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/moving_variance -> [160] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/gamma -> [160] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_15/project/Conv2D, FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/batchnorm/mul_1 -> [160,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/beta -> [160] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/moving_mean -> [160] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/batchnorm/add_1 -> [160,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_15/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/batchnorm/add_1, FeatureExtractor/MobilenetV2/expanded_conv_14/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_15/add -> [160,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_15/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/expand/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/weights -> [1,1,160,960] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_15/add, FeatureExtractor/MobilenetV2/expanded_conv_16/expand/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Conv2D -> [960,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/moving_variance -> [960] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/gamma -> [960] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Conv2D, FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/batchnorm/mul_1 -> [960,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/beta -> [960] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/moving_mean -> [960] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/batchnorm/add_1 -> [960,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 494) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Relu6 -> [960,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/depthwise_weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/depthwise_weights -> [3,3,960,1] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/depthwise[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Relu6, FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/depthwise -> [960,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/depthwise [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/moving_variance -> [960] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/gamma -> [960] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/depthwise, FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/batchnorm/mul_1 -> [960,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/beta -> [960] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/moving_mean -> [960] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/batchnorm/add_1 -> [960,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 504) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/Relu6 -> [960,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/project/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_16/project/weights -> [1,1,960,320] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/project/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/Relu6, FeatureExtractor/MobilenetV2/expanded_conv_16/project/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D -> [320,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/moving_variance -> [320] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/gamma -> [320] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D, FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/batchnorm/mul_1 -> [320,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/beta -> [320] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/moving_mean -> [320] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/beta, FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/batchnorm/add_1 -> [320,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/Conv_1/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/Conv_1/weights -> [1,1,320,1280] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/Conv_1/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/Conv_1/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/batchnorm/add_1, FeatureExtractor/MobilenetV2/Conv_1/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/Conv_1/Conv2D -> [1280,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/Conv_1/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/moving_variance -> [1280] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/gamma -> [1280] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/Conv_1/Conv2D, FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/batchnorm/mul_1 -> [1280,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/beta -> [1280] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/moving_mean -> [1280] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/beta, FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/batchnorm/add_1 -> [1280,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/Conv_1/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 523) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/Conv_1/Relu6 -> [1280,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/Conv_1/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_1/ClassPredictor/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_1/ClassPredictor/weights -> [3,3,1280,546] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/ClassPredictor/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_1/ClassPredictor/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/Conv_1/Relu6, BoxPredictor_1/ClassPredictor/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_1/ClassPredictor/Conv2D -> [546,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/ClassPredictor/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_1/ClassPredictor/biases[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_1/ClassPredictor/biases -> [546] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/ClassPredictor/biases [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_1/ClassPredictor/BiasAdd[Op: Binary]. Inputs: BoxPredictor_1/ClassPredictor/Conv2D, BoxPredictor_1/ClassPredictor/biases [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_1/ClassPredictor/BiasAdd -> [546,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/ClassPredictor/BiasAdd [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_1/Shape[Op: Shape]. Inputs: FeatureExtractor/MobilenetV2/Conv_1/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/Shape [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_1/strided_slice/stack[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_1/strided_slice/stack -> [1] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/strided_slice/stack [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_1/strided_slice/stack_1[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_1/strided_slice/stack_1 -> [1] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/strided_slice/stack_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_1/strided_slice/stack_2[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_1/strided_slice/stack_2 -> [1] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/strided_slice/stack_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_1/strided_slice[Op: StridedSlice]. Inputs: BoxPredictor_1/Shape, BoxPredictor_1/strided_slice/stack, BoxPredictor_1/strided_slice/stack_1, BoxPredictor_1/strided_slice/stack_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/strided_slice [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_1/stack_1/1[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_1/stack_1/1 -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/stack_1/1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_1/stack_1/2[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_1/stack_1/2 -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/stack_1/2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_1/stack_1[Op: Stack]. Inputs: BoxPredictor_1/strided_slice, BoxPredictor_1/stack_1/1, BoxPredictor_1/stack_1/2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/stack_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_1/Reshape_1[Op: Reshape]. Inputs: BoxPredictor_1/ClassPredictor/BiasAdd, BoxPredictor_1/stack_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_1/Reshape_1 -> [600,91,1] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/Reshape_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/weights -> [1,1,1280,256] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/Conv_1/Relu6, FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D -> [256,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/moving_variance -> [256] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/gamma -> [256] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D, FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_1 -> [256,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/beta -> [256] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/moving_mean -> [256] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/beta, FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/add_1 -> [256,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 544) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6 -> [256,10,10] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise_weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise_weights -> [3,3,256,1] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise -> [256,5,5] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/moving_variance -> [256] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/gamma -> [256] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/batchnorm/mul_1 -> [256,5,5] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/beta -> [256] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/moving_mean -> [256] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/beta, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/batchnorm/add_1 -> [256,5,5] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 554) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6 -> [256,5,5] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/weights -> [1,1,256,512] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D -> [512,5,5] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/moving_variance -> [512] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/gamma -> [512] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul_1 -> [512,5,5] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/beta -> [512] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/moving_mean -> [512] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/beta, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/add_1 -> [512,5,5] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 564) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6 -> [512,5,5] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_2/ClassPredictor/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_2/ClassPredictor/weights -> [3,3,512,546] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/ClassPredictor/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_2/ClassPredictor/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6, BoxPredictor_2/ClassPredictor/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_2/ClassPredictor/Conv2D -> [546,5,5] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/ClassPredictor/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_2/ClassPredictor/biases[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_2/ClassPredictor/biases -> [546] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/ClassPredictor/biases [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_2/ClassPredictor/BiasAdd[Op: Binary]. Inputs: BoxPredictor_2/ClassPredictor/Conv2D, BoxPredictor_2/ClassPredictor/biases [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_2/ClassPredictor/BiasAdd -> [546,5,5] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/ClassPredictor/BiasAdd [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_2/Shape[Op: Shape]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/Shape [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_2/strided_slice/stack[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_2/strided_slice/stack -> [1] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/strided_slice/stack [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_2/strided_slice/stack_1[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_2/strided_slice/stack_1 -> [1] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/strided_slice/stack_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_2/strided_slice/stack_2[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_2/strided_slice/stack_2 -> [1] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/strided_slice/stack_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_2/strided_slice[Op: StridedSlice]. Inputs: BoxPredictor_2/Shape, BoxPredictor_2/strided_slice/stack, BoxPredictor_2/strided_slice/stack_1, BoxPredictor_2/strided_slice/stack_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/strided_slice [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_2/stack_1/1[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_2/stack_1/1 -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/stack_1/1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_2/stack_1/2[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_2/stack_1/2 -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/stack_1/2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_2/stack_1[Op: Stack]. Inputs: BoxPredictor_2/strided_slice, BoxPredictor_2/stack_1/1, BoxPredictor_2/stack_1/2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/stack_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_2/Reshape_1[Op: Reshape]. Inputs: BoxPredictor_2/ClassPredictor/BiasAdd, BoxPredictor_2/stack_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_2/Reshape_1 -> [150,91,1] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/Reshape_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/weights -> [1,1,512,128] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6, FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D -> [128,5,5] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/moving_variance -> [128] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/gamma -> [128] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D, FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_1 -> [128,5,5] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/beta -> [128] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/moving_mean -> [128] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/beta, FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/add_1 -> [128,5,5] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 585) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6 -> [128,5,5] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise_weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise_weights -> [3,3,128,1] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise -> [128,3,3] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/moving_variance -> [128] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/gamma -> [128] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/batchnorm/mul_1 -> [128,3,3] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/beta -> [128] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/moving_mean -> [128] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/beta, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/batchnorm/add_1 -> [128,3,3] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 595) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6 -> [128,3,3] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/weights -> [1,1,128,256] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D -> [256,3,3] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/moving_variance -> [256] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/gamma -> [256] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul_1 -> [256,3,3] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/beta -> [256] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/moving_mean -> [256] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/beta, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/add_1 -> [256,3,3] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 605) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6 -> [256,3,3] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_3/ClassPredictor/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_3/ClassPredictor/weights -> [3,3,256,546] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/ClassPredictor/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_3/ClassPredictor/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6, BoxPredictor_3/ClassPredictor/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_3/ClassPredictor/Conv2D -> [546,3,3] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/ClassPredictor/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_3/ClassPredictor/biases[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_3/ClassPredictor/biases -> [546] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/ClassPredictor/biases [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_3/ClassPredictor/BiasAdd[Op: Binary]. Inputs: BoxPredictor_3/ClassPredictor/Conv2D, BoxPredictor_3/ClassPredictor/biases [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_3/ClassPredictor/BiasAdd -> [546,3,3] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/ClassPredictor/BiasAdd [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_3/Shape[Op: Shape]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/Shape [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_3/strided_slice/stack[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_3/strided_slice/stack -> [1] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/strided_slice/stack [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_3/strided_slice/stack_1[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_3/strided_slice/stack_1 -> [1] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/strided_slice/stack_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_3/strided_slice/stack_2[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_3/strided_slice/stack_2 -> [1] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/strided_slice/stack_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_3/strided_slice[Op: StridedSlice]. Inputs: BoxPredictor_3/Shape, BoxPredictor_3/strided_slice/stack, BoxPredictor_3/strided_slice/stack_1, BoxPredictor_3/strided_slice/stack_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/strided_slice [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_3/stack_1/1[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_3/stack_1/1 -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/stack_1/1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_3/stack_1/2[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_3/stack_1/2 -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/stack_1/2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_3/stack_1[Op: Stack]. Inputs: BoxPredictor_3/strided_slice, BoxPredictor_3/stack_1/1, BoxPredictor_3/stack_1/2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/stack_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_3/Reshape_1[Op: Reshape]. Inputs: BoxPredictor_3/ClassPredictor/BiasAdd, BoxPredictor_3/stack_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_3/Reshape_1 -> [54,91,1] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/Reshape_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/weights -> [1,1,256,128] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6, FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D -> [128,3,3] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/moving_variance -> [128] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/gamma -> [128] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D, FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_1 -> [128,3,3] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/beta -> [128] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/moving_mean -> [128] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/beta, FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/add_1 -> [128,3,3] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 626) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6 -> [128,3,3] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise_weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise_weights -> [3,3,128,1] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise_weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise -> [128,2,2] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/moving_variance -> [128] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/gamma -> [128] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/batchnorm/mul_1 -> [128,2,2] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/beta -> [128] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/moving_mean -> [128] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/beta, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/batchnorm/add_1 -> [128,2,2] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 636) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6 -> [128,2,2] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/weights -> [1,1,128,256] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/weights [01/19/2021-17:50:32] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D -> [256,2,2] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/moving_variance -> [256] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/moving_variance [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/add/y [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/add [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/gamma -> [256] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/gamma [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul_1 -> [256,2,2] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/beta -> [256] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/beta [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/moving_mean -> [256] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/moving_mean [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/beta, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/sub [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/add_1 -> [256,2,2] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:32] [V] [TRT] Setting dynamic range for (Unnamed Layer* 646) [Activation]_output to [0,6] [01/19/2021-17:50:32] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6 -> [256,2,2] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6 [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_4/ClassPredictor/weights[Op: Const]. [01/19/2021-17:50:32] [V] [TRT] UFFParser: BoxPredictor_4/ClassPredictor/weights -> [3,3,256,546] [01/19/2021-17:50:32] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/ClassPredictor/weights [01/19/2021-17:50:32] [V] [TRT] UFFParser: Parsing BoxPredictor_4/ClassPredictor/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6, BoxPredictor_4/ClassPredictor/weights [01/19/2021-17:50:33] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_4/ClassPredictor/Conv2D -> [546,2,2] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/ClassPredictor/Conv2D [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_4/ClassPredictor/biases[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_4/ClassPredictor/biases -> [546] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/ClassPredictor/biases [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_4/ClassPredictor/BiasAdd[Op: Binary]. Inputs: BoxPredictor_4/ClassPredictor/Conv2D, BoxPredictor_4/ClassPredictor/biases [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_4/ClassPredictor/BiasAdd -> [546,2,2] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/ClassPredictor/BiasAdd [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_4/Shape[Op: Shape]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/Shape [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_4/strided_slice/stack[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_4/strided_slice/stack -> [1] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/strided_slice/stack [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_4/strided_slice/stack_1[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_4/strided_slice/stack_1 -> [1] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/strided_slice/stack_1 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_4/strided_slice/stack_2[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_4/strided_slice/stack_2 -> [1] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/strided_slice/stack_2 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_4/strided_slice[Op: StridedSlice]. Inputs: BoxPredictor_4/Shape, BoxPredictor_4/strided_slice/stack, BoxPredictor_4/strided_slice/stack_1, BoxPredictor_4/strided_slice/stack_2 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/strided_slice [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_4/stack_1/1[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_4/stack_1/1 -> [] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/stack_1/1 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_4/stack_1/2[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_4/stack_1/2 -> [] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/stack_1/2 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_4/stack_1[Op: Stack]. Inputs: BoxPredictor_4/strided_slice, BoxPredictor_4/stack_1/1, BoxPredictor_4/stack_1/2 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/stack_1 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_4/Reshape_1[Op: Reshape]. Inputs: BoxPredictor_4/ClassPredictor/BiasAdd, BoxPredictor_4/stack_1 [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_4/Reshape_1 -> [24,91,1] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/Reshape_1 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/weights[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/weights -> [1,1,256,64] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/weights [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6, FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/weights [01/19/2021-17:50:33] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:33] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D -> [64,2,2] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/moving_variance -> [64] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/moving_variance [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/add/y [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/add/y [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/add [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/add [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/gamma -> [64] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/gamma [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/gamma [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D, FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul [01/19/2021-17:50:33] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_1 -> [64,2,2] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/beta -> [64] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/beta [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/moving_mean -> [64] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/moving_mean [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/beta, FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/sub [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/sub [01/19/2021-17:50:33] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/add_1 -> [64,2,2] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Setting dynamic range for (Unnamed Layer* 667) [Activation]_output to [0,6] [01/19/2021-17:50:33] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6 -> [64,2,2] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise_weights[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise_weights -> [3,3,64,1] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise_weights [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise_weights [01/19/2021-17:50:33] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:33] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise -> [64,1,1] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/moving_variance -> [64] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/moving_variance [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/batchnorm/add/y [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/batchnorm/add [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/gamma -> [64] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/gamma [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/gamma [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:33] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/batchnorm/mul_1 -> [64,1,1] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/beta -> [64] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/beta [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/moving_mean -> [64] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/moving_mean [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/batchnorm/mul [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/beta, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/batchnorm/sub [01/19/2021-17:50:33] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/batchnorm/add_1 -> [64,1,1] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Setting dynamic range for (Unnamed Layer* 677) [Activation]_output to [0,6] [01/19/2021-17:50:33] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6 -> [64,1,1] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/weights[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/weights -> [1,1,64,128] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/weights [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/weights [01/19/2021-17:50:33] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:33] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D -> [128,1,1] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/moving_variance[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/moving_variance -> [128] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/moving_variance [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/add/y[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/add/y -> [] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/add/y [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/add[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/moving_variance, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/add/y [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/add [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/Rsqrt[Op: Unary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/add [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/Rsqrt [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/gamma[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/gamma -> [128] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/gamma [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/mul[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/Rsqrt, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/gamma [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/mul [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/mul_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/mul [01/19/2021-17:50:33] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/mul_1 -> [128,1,1] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/beta[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/beta -> [128] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/beta [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/moving_mean[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/moving_mean -> [128] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/moving_mean [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/mul_2[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/moving_mean, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/mul [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/sub[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/beta, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/mul_2 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/sub [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/add_1[Op: Binary]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/mul_1, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/sub [01/19/2021-17:50:33] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/add_1 -> [128,1,1] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6[Op: Activation]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Setting dynamic range for (Unnamed Layer* 687) [Activation]_output to [0,6] [01/19/2021-17:50:33] [V] [TRT] UFFParser: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6 -> [128,1,1] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_5/ClassPredictor/weights[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_5/ClassPredictor/weights -> [3,3,128,546] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/ClassPredictor/weights [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_5/ClassPredictor/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6, BoxPredictor_5/ClassPredictor/weights [01/19/2021-17:50:33] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_5/ClassPredictor/Conv2D -> [546,1,1] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/ClassPredictor/Conv2D [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_5/ClassPredictor/biases[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_5/ClassPredictor/biases -> [546] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/ClassPredictor/biases [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_5/ClassPredictor/BiasAdd[Op: Binary]. Inputs: BoxPredictor_5/ClassPredictor/Conv2D, BoxPredictor_5/ClassPredictor/biases [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_5/ClassPredictor/BiasAdd -> [546,1,1] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/ClassPredictor/BiasAdd [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_5/Shape[Op: Shape]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/Shape [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_5/strided_slice/stack[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_5/strided_slice/stack -> [1] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/strided_slice/stack [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_5/strided_slice/stack_1[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_5/strided_slice/stack_1 -> [1] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/strided_slice/stack_1 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_5/strided_slice/stack_2[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_5/strided_slice/stack_2 -> [1] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/strided_slice/stack_2 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_5/strided_slice[Op: StridedSlice]. Inputs: BoxPredictor_5/Shape, BoxPredictor_5/strided_slice/stack, BoxPredictor_5/strided_slice/stack_1, BoxPredictor_5/strided_slice/stack_2 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/strided_slice [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_5/stack_1/1[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_5/stack_1/1 -> [] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/stack_1/1 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_5/stack_1/2[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_5/stack_1/2 -> [] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/stack_1/2 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_5/stack_1[Op: Stack]. Inputs: BoxPredictor_5/strided_slice, BoxPredictor_5/stack_1/1, BoxPredictor_5/stack_1/2 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/stack_1 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_5/Reshape_1[Op: Reshape]. Inputs: BoxPredictor_5/ClassPredictor/BiasAdd, BoxPredictor_5/stack_1 [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_5/Reshape_1 -> [6,91,1] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/Reshape_1 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing concat_box_conf[Op: _FlattenConcat_TRT]. Inputs: BoxPredictor_0/Reshape_1, BoxPredictor_1/Reshape_1, BoxPredictor_2/Reshape_1, BoxPredictor_3/Reshape_1, BoxPredictor_4/Reshape_1, BoxPredictor_5/Reshape_1 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_0/BoxEncodingPredictor/weights[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_0/BoxEncodingPredictor/weights -> [3,3,576,12] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/BoxEncodingPredictor/weights [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_0/BoxEncodingPredictor/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6, BoxPredictor_0/BoxEncodingPredictor/weights [01/19/2021-17:50:33] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_0/BoxEncodingPredictor/Conv2D -> [12,19,19] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/BoxEncodingPredictor/Conv2D [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_0/BoxEncodingPredictor/biases[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_0/BoxEncodingPredictor/biases -> [12] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/BoxEncodingPredictor/biases [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_0/BoxEncodingPredictor/BiasAdd[Op: Binary]. Inputs: BoxPredictor_0/BoxEncodingPredictor/Conv2D, BoxPredictor_0/BoxEncodingPredictor/biases [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_0/BoxEncodingPredictor/BiasAdd -> [12,19,19] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/BoxEncodingPredictor/BiasAdd [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_0/stack/1[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_0/stack/1 -> [] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/stack/1 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_0/stack/2[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_0/stack/2 -> [] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/stack/2 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_0/stack/3[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_0/stack/3 -> [] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/stack/3 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_0/stack[Op: Stack]. Inputs: BoxPredictor_0/strided_slice, BoxPredictor_0/stack/1, BoxPredictor_0/stack/2, BoxPredictor_0/stack/3 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/stack [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_0/Reshape[Op: Reshape]. Inputs: BoxPredictor_0/BoxEncodingPredictor/BiasAdd, BoxPredictor_0/stack [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_0/Reshape -> [1083,1,4] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_0/Reshape [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_1/BoxEncodingPredictor/weights[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_1/BoxEncodingPredictor/weights -> [3,3,1280,24] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/BoxEncodingPredictor/weights [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_1/BoxEncodingPredictor/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/Conv_1/Relu6, BoxPredictor_1/BoxEncodingPredictor/weights [01/19/2021-17:50:33] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_1/BoxEncodingPredictor/Conv2D -> [24,10,10] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/BoxEncodingPredictor/Conv2D [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_1/BoxEncodingPredictor/biases[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_1/BoxEncodingPredictor/biases -> [24] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/BoxEncodingPredictor/biases [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_1/BoxEncodingPredictor/BiasAdd[Op: Binary]. Inputs: BoxPredictor_1/BoxEncodingPredictor/Conv2D, BoxPredictor_1/BoxEncodingPredictor/biases [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_1/BoxEncodingPredictor/BiasAdd -> [24,10,10] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/BoxEncodingPredictor/BiasAdd [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_1/stack/1[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_1/stack/1 -> [] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/stack/1 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_1/stack/2[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_1/stack/2 -> [] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/stack/2 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_1/stack/3[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_1/stack/3 -> [] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/stack/3 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_1/stack[Op: Stack]. Inputs: BoxPredictor_1/strided_slice, BoxPredictor_1/stack/1, BoxPredictor_1/stack/2, BoxPredictor_1/stack/3 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/stack [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_1/Reshape[Op: Reshape]. Inputs: BoxPredictor_1/BoxEncodingPredictor/BiasAdd, BoxPredictor_1/stack [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_1/Reshape -> [600,1,4] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_1/Reshape [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_2/BoxEncodingPredictor/weights[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_2/BoxEncodingPredictor/weights -> [3,3,512,24] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/BoxEncodingPredictor/weights [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_2/BoxEncodingPredictor/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6, BoxPredictor_2/BoxEncodingPredictor/weights [01/19/2021-17:50:33] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_2/BoxEncodingPredictor/Conv2D -> [24,5,5] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/BoxEncodingPredictor/Conv2D [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_2/BoxEncodingPredictor/biases[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_2/BoxEncodingPredictor/biases -> [24] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/BoxEncodingPredictor/biases [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_2/BoxEncodingPredictor/BiasAdd[Op: Binary]. Inputs: BoxPredictor_2/BoxEncodingPredictor/Conv2D, BoxPredictor_2/BoxEncodingPredictor/biases [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_2/BoxEncodingPredictor/BiasAdd -> [24,5,5] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/BoxEncodingPredictor/BiasAdd [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_2/stack/1[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_2/stack/1 -> [] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/stack/1 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_2/stack/2[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_2/stack/2 -> [] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/stack/2 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_2/stack/3[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_2/stack/3 -> [] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/stack/3 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_2/stack[Op: Stack]. Inputs: BoxPredictor_2/strided_slice, BoxPredictor_2/stack/1, BoxPredictor_2/stack/2, BoxPredictor_2/stack/3 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/stack [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_2/Reshape[Op: Reshape]. Inputs: BoxPredictor_2/BoxEncodingPredictor/BiasAdd, BoxPredictor_2/stack [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_2/Reshape -> [150,1,4] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_2/Reshape [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_3/BoxEncodingPredictor/weights[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_3/BoxEncodingPredictor/weights -> [3,3,256,24] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/BoxEncodingPredictor/weights [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_3/BoxEncodingPredictor/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6, BoxPredictor_3/BoxEncodingPredictor/weights [01/19/2021-17:50:33] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_3/BoxEncodingPredictor/Conv2D -> [24,3,3] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/BoxEncodingPredictor/Conv2D [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_3/BoxEncodingPredictor/biases[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_3/BoxEncodingPredictor/biases -> [24] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/BoxEncodingPredictor/biases [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_3/BoxEncodingPredictor/BiasAdd[Op: Binary]. Inputs: BoxPredictor_3/BoxEncodingPredictor/Conv2D, BoxPredictor_3/BoxEncodingPredictor/biases [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_3/BoxEncodingPredictor/BiasAdd -> [24,3,3] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/BoxEncodingPredictor/BiasAdd [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_3/stack/1[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_3/stack/1 -> [] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/stack/1 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_3/stack/2[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_3/stack/2 -> [] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/stack/2 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_3/stack/3[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_3/stack/3 -> [] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/stack/3 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_3/stack[Op: Stack]. Inputs: BoxPredictor_3/strided_slice, BoxPredictor_3/stack/1, BoxPredictor_3/stack/2, BoxPredictor_3/stack/3 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/stack [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_3/Reshape[Op: Reshape]. Inputs: BoxPredictor_3/BoxEncodingPredictor/BiasAdd, BoxPredictor_3/stack [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_3/Reshape -> [54,1,4] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_3/Reshape [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_4/BoxEncodingPredictor/weights[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_4/BoxEncodingPredictor/weights -> [3,3,256,24] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/BoxEncodingPredictor/weights [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_4/BoxEncodingPredictor/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6, BoxPredictor_4/BoxEncodingPredictor/weights [01/19/2021-17:50:33] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_4/BoxEncodingPredictor/Conv2D -> [24,2,2] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/BoxEncodingPredictor/Conv2D [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_4/BoxEncodingPredictor/biases[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_4/BoxEncodingPredictor/biases -> [24] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/BoxEncodingPredictor/biases [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_4/BoxEncodingPredictor/BiasAdd[Op: Binary]. Inputs: BoxPredictor_4/BoxEncodingPredictor/Conv2D, BoxPredictor_4/BoxEncodingPredictor/biases [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_4/BoxEncodingPredictor/BiasAdd -> [24,2,2] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/BoxEncodingPredictor/BiasAdd [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_4/stack/1[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_4/stack/1 -> [] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/stack/1 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_4/stack/2[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_4/stack/2 -> [] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/stack/2 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_4/stack/3[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_4/stack/3 -> [] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/stack/3 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_4/stack[Op: Stack]. Inputs: BoxPredictor_4/strided_slice, BoxPredictor_4/stack/1, BoxPredictor_4/stack/2, BoxPredictor_4/stack/3 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/stack [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_4/Reshape[Op: Reshape]. Inputs: BoxPredictor_4/BoxEncodingPredictor/BiasAdd, BoxPredictor_4/stack [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_4/Reshape -> [24,1,4] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_4/Reshape [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_5/BoxEncodingPredictor/weights[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_5/BoxEncodingPredictor/weights -> [3,3,128,24] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/BoxEncodingPredictor/weights [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_5/BoxEncodingPredictor/Conv2D[Op: Conv]. Inputs: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6, BoxPredictor_5/BoxEncodingPredictor/weights [01/19/2021-17:50:33] [V] [TRT] Bias weights are not set yet. Bias weights can be set using setInput(2, bias_tensor) API call. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_5/BoxEncodingPredictor/Conv2D -> [24,1,1] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/BoxEncodingPredictor/Conv2D [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_5/BoxEncodingPredictor/biases[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_5/BoxEncodingPredictor/biases -> [24] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/BoxEncodingPredictor/biases [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_5/BoxEncodingPredictor/BiasAdd[Op: Binary]. Inputs: BoxPredictor_5/BoxEncodingPredictor/Conv2D, BoxPredictor_5/BoxEncodingPredictor/biases [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_5/BoxEncodingPredictor/BiasAdd -> [24,1,1] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/BoxEncodingPredictor/BiasAdd [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_5/stack/1[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_5/stack/1 -> [] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/stack/1 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_5/stack/2[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_5/stack/2 -> [] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/stack/2 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_5/stack/3[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_5/stack/3 -> [] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/stack/3 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_5/stack[Op: Stack]. Inputs: BoxPredictor_5/strided_slice, BoxPredictor_5/stack/1, BoxPredictor_5/stack/2, BoxPredictor_5/stack/3 [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/stack [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing BoxPredictor_5/Reshape[Op: Reshape]. Inputs: BoxPredictor_5/BoxEncodingPredictor/BiasAdd, BoxPredictor_5/stack [01/19/2021-17:50:33] [V] [TRT] UFFParser: BoxPredictor_5/Reshape -> [6,1,4] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: BoxPredictor_5/Reshape [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing concat_box_loc[Op: _FlattenConcat_TRT]. Inputs: BoxPredictor_0/Reshape, BoxPredictor_1/Reshape, BoxPredictor_2/Reshape, BoxPredictor_3/Reshape, BoxPredictor_4/Reshape, BoxPredictor_5/Reshape [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing Squeeze[Op: Squeeze]. Inputs: concat_box_loc [01/19/2021-17:50:33] [V] [TRT] UFFParser: Squeeze -> [7668,1,1] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: Squeeze [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing Const[Op: Const]. [01/19/2021-17:50:33] [V] [TRT] UFFParser: Const -> [2] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: Const [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing GridAnchor[Op: _GridAnchor_TRT]. Inputs: Const [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing concat_priorbox[Op: Concat]. Inputs: GridAnchor [01/19/2021-17:50:33] [V] [TRT] UFFParser: concat_priorbox -> [2,7668,1] [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: concat_priorbox [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing NMS[Op: _NMS_TRT]. Inputs: concat_box_conf, Squeeze, concat_priorbox [01/19/2021-17:50:33] [V] [TRT] UFFParser: Parsing MarkOutput_0[Op: MarkOutput]. Inputs: NMS [01/19/2021-17:50:33] [V] [TRT] UFFParser: Applying order forwarding to: MarkOutput_0 [01/19/2021-17:50:33] [V] [TRT] Applying generic optimizations to the graph for inference. [01/19/2021-17:50:33] [V] [TRT] Original: 759 layers [01/19/2021-17:50:33] [V] [TRT] After dead-layer removal: 303 layers [01/19/2021-17:50:33] [V] [TRT] After Myelin optimization: 303 layers [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/Conv/Conv2D with scale FeatureExtractor/MobilenetV2/Conv/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/Conv/Conv2D with scale FeatureExtractor/MobilenetV2/Conv/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv/depthwise/depthwise with scale FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv/depthwise/depthwise with scale FeatureExtractor/MobilenetV2/expanded_conv/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv/project/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv/project/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_1/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/depthwise with scale FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/depthwise with scale FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_1/project/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_1/project/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_2/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/depthwise with scale FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/depthwise with scale FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_2/project/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_2/project/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_2/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_3/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/depthwise with scale FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/depthwise with scale FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_3/project/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_3/project/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_4/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/depthwise with scale FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/depthwise with scale FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_4/project/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_4/project/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_4/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_5/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/depthwise with scale FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/depthwise with scale FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_5/project/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_5/project/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_5/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_6/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/depthwise with scale FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/depthwise with scale FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_6/project/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_6/project/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_7/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise with scale FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise with scale FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_7/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_8/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/depthwise with scale FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/depthwise with scale FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_8/project/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_8/project/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_8/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_9/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/depthwise with scale FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/depthwise with scale FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_9/project/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_9/project/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_9/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_10/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/depthwise with scale FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/depthwise with scale FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_11/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise with scale FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise with scale FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_11/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_12/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/depthwise with scale FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/depthwise with scale FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_12/project/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_12/project/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_12/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_13/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from BoxPredictor_0/ClassPredictor/Conv2D with scale BoxPredictor_0/ClassPredictor/BiasAdd [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise with scale FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise with scale FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_14/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise with scale FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise with scale FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_14/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_15/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/depthwise with scale FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/depthwise with scale FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_15/project/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_15/project/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_15/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_16/expand/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/depthwise with scale FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/depthwise with scale FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D with scale FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/Conv_1/Conv2D with scale FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/Conv_1/Conv2D with scale FeatureExtractor/MobilenetV2/Conv_1/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from BoxPredictor_1/ClassPredictor/Conv2D with scale BoxPredictor_1/ClassPredictor/BiasAdd [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D with scale FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D with scale FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise with scale FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise with scale FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D with scale FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D with scale FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from BoxPredictor_2/ClassPredictor/Conv2D with scale BoxPredictor_2/ClassPredictor/BiasAdd [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D with scale FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D with scale FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise with scale FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise with scale FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D with scale FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D with scale FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from BoxPredictor_3/ClassPredictor/Conv2D with scale BoxPredictor_3/ClassPredictor/BiasAdd [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D with scale FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D with scale FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise with scale FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise with scale FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D with scale FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D with scale FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from BoxPredictor_4/ClassPredictor/Conv2D with scale BoxPredictor_4/ClassPredictor/BiasAdd [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D with scale FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D with scale FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise with scale FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise with scale FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D with scale FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/mul_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D with scale FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/BatchNorm/batchnorm/add_1 [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from BoxPredictor_5/ClassPredictor/Conv2D with scale BoxPredictor_5/ClassPredictor/BiasAdd [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from BoxPredictor_0/BoxEncodingPredictor/Conv2D with scale BoxPredictor_0/BoxEncodingPredictor/BiasAdd [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from BoxPredictor_1/BoxEncodingPredictor/Conv2D with scale BoxPredictor_1/BoxEncodingPredictor/BiasAdd [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from BoxPredictor_2/BoxEncodingPredictor/Conv2D with scale BoxPredictor_2/BoxEncodingPredictor/BiasAdd [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from BoxPredictor_3/BoxEncodingPredictor/Conv2D with scale BoxPredictor_3/BoxEncodingPredictor/BiasAdd [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from BoxPredictor_4/BoxEncodingPredictor/Conv2D with scale BoxPredictor_4/BoxEncodingPredictor/BiasAdd [01/19/2021-17:50:33] [V] [TRT] Fusing convolution weights from BoxPredictor_5/BoxEncodingPredictor/Conv2D with scale BoxPredictor_5/BoxEncodingPredictor/BiasAdd [01/19/2021-17:50:33] [V] [TRT] After scale fusion: 163 layers [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/Conv/Conv2D with FeatureExtractor/MobilenetV2/Conv/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv/depthwise/depthwise with FeatureExtractor/MobilenetV2/expanded_conv/depthwise/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Conv2D with FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/depthwise with FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Conv2D with FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/depthwise with FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_2/project/Conv2D with FeatureExtractor/MobilenetV2/expanded_conv_2/add [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Conv2D with FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/depthwise with FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Conv2D with FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/depthwise with FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_4/project/Conv2D with FeatureExtractor/MobilenetV2/expanded_conv_4/add [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Conv2D with FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/depthwise with FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_5/project/Conv2D with FeatureExtractor/MobilenetV2/expanded_conv_5/add [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Conv2D with FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/depthwise with FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D with FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise with FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D with FeatureExtractor/MobilenetV2/expanded_conv_7/add [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Conv2D with FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/depthwise with FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_8/project/Conv2D with FeatureExtractor/MobilenetV2/expanded_conv_8/add [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Conv2D with FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/depthwise with FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_9/project/Conv2D with FeatureExtractor/MobilenetV2/expanded_conv_9/add [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Conv2D with FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/depthwise with FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D with FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise with FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D with FeatureExtractor/MobilenetV2/expanded_conv_11/add [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Conv2D with FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/depthwise with FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_12/project/Conv2D with FeatureExtractor/MobilenetV2/expanded_conv_12/add [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Conv2D with FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing (Unnamed Layer* 404) [Shuffle] with BoxPredictor_0/Reshape_1 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise with FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D with FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise with FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D with FeatureExtractor/MobilenetV2/expanded_conv_14/add [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Conv2D with FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/depthwise with FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_15/project/Conv2D with FeatureExtractor/MobilenetV2/expanded_conv_15/add [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Conv2D with FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/depthwise with FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/Conv_1/Conv2D with FeatureExtractor/MobilenetV2/Conv_1/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing (Unnamed Layer* 533) [Shuffle] with BoxPredictor_1/Reshape_1 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D with FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise with FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D with FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing (Unnamed Layer* 574) [Shuffle] with BoxPredictor_2/Reshape_1 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D with FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise with FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D with FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing (Unnamed Layer* 615) [Shuffle] with BoxPredictor_3/Reshape_1 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D with FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise with FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D with FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing (Unnamed Layer* 656) [Shuffle] with BoxPredictor_4/Reshape_1 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D with FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise with FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D with FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6 [01/19/2021-17:50:33] [V] [TRT] Fusing (Unnamed Layer* 697) [Shuffle] with BoxPredictor_5/Reshape_1 [01/19/2021-17:50:33] [V] [TRT] Fusing (Unnamed Layer* 707) [Shuffle] with BoxPredictor_0/Reshape [01/19/2021-17:50:33] [V] [TRT] Fusing (Unnamed Layer* 716) [Shuffle] with BoxPredictor_1/Reshape [01/19/2021-17:50:33] [V] [TRT] Fusing (Unnamed Layer* 725) [Shuffle] with BoxPredictor_2/Reshape [01/19/2021-17:50:33] [V] [TRT] Fusing (Unnamed Layer* 734) [Shuffle] with BoxPredictor_3/Reshape [01/19/2021-17:50:33] [V] [TRT] Fusing (Unnamed Layer* 743) [Shuffle] with BoxPredictor_4/Reshape [01/19/2021-17:50:33] [V] [TRT] Fusing (Unnamed Layer* 752) [Shuffle] with BoxPredictor_5/Reshape [01/19/2021-17:50:33] [V] [TRT] After vertical fusions: 94 layers [01/19/2021-17:50:33] [V] [TRT] After final dead-layer removal: 94 layers [01/19/2021-17:50:33] [V] [TRT] Merging layers: BoxPredictor_0/ClassPredictor/Conv2D || BoxPredictor_0/BoxEncodingPredictor/Conv2D [01/19/2021-17:50:33] [V] [TRT] Merging layers: BoxPredictor_1/ClassPredictor/Conv2D || BoxPredictor_1/BoxEncodingPredictor/Conv2D [01/19/2021-17:50:33] [V] [TRT] Merging layers: BoxPredictor_2/ClassPredictor/Conv2D || BoxPredictor_2/BoxEncodingPredictor/Conv2D [01/19/2021-17:50:33] [V] [TRT] Merging layers: BoxPredictor_3/ClassPredictor/Conv2D || BoxPredictor_3/BoxEncodingPredictor/Conv2D [01/19/2021-17:50:33] [V] [TRT] Merging layers: BoxPredictor_4/ClassPredictor/Conv2D || BoxPredictor_4/BoxEncodingPredictor/Conv2D [01/19/2021-17:50:33] [V] [TRT] Merging layers: BoxPredictor_5/ClassPredictor/Conv2D || BoxPredictor_5/BoxEncodingPredictor/Conv2D [01/19/2021-17:50:33] [V] [TRT] After tensor merging: 88 layers [01/19/2021-17:50:33] [V] [TRT] Eliminating concatenation concat_priorbox [01/19/2021-17:50:33] [V] [TRT] Generating copy for GridAnchor to concat_priorbox [01/19/2021-17:50:33] [V] [TRT] Generating copy for GridAnchor_1 to concat_priorbox [01/19/2021-17:50:33] [V] [TRT] Generating copy for GridAnchor_2 to concat_priorbox [01/19/2021-17:50:33] [V] [TRT] Generating copy for GridAnchor_3 to concat_priorbox [01/19/2021-17:50:33] [V] [TRT] Generating copy for GridAnchor_4 to concat_priorbox [01/19/2021-17:50:33] [V] [TRT] Generating copy for GridAnchor_5 to concat_priorbox [01/19/2021-17:50:33] [V] [TRT] After concat removal: 93 layers [01/19/2021-17:50:33] [V] [TRT] Graph construction and optimization completed in 0.0730802 seconds. [01/19/2021-17:50:33] [V] [TRT] Constructing optimization profile number 0 out of 1 *************** Autotuning format combination: Float(1,300,90000,270000) -> Float(1,150,22500,720000) *************** [01/19/2021-17:50:33] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/Conv/Conv2D + FeatureExtractor/MobilenetV2/Conv/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:33] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:33] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/Conv/Conv2D + FeatureExtractor/MobilenetV2/Conv/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:33] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:33] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/Conv/Conv2D + FeatureExtractor/MobilenetV2/Conv/Relu6 (CaskConvolution) [01/19/2021-17:50:33] [V] [TRT] FeatureExtractor/MobilenetV2/Conv/Conv2D + FeatureExtractor/MobilenetV2/Conv/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:33] [V] [TRT] Tactic: 1062367460111450758 time 0.03584 [01/19/2021-17:50:33] [V] [TRT] FeatureExtractor/MobilenetV2/Conv/Conv2D + FeatureExtractor/MobilenetV2/Conv/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [01/19/2021-17:50:33] [V] [TRT] Tactic: 4337000649858996379 time 0.047104 [01/19/2021-17:50:33] [V] [TRT] FeatureExtractor/MobilenetV2/Conv/Conv2D + FeatureExtractor/MobilenetV2/Conv/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:33] [V] [TRT] Tactic: 4501471010995462441 time 0.079872 [01/19/2021-17:50:33] [V] [TRT] FeatureExtractor/MobilenetV2/Conv/Conv2D + FeatureExtractor/MobilenetV2/Conv/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:33] [V] [TRT] Tactic: 5137655947464784826 time 0.045056 [01/19/2021-17:50:33] [V] [TRT] FeatureExtractor/MobilenetV2/Conv/Conv2D + FeatureExtractor/MobilenetV2/Conv/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:33] [V] [TRT] Tactic: 6645123197870846056 time 0.04608 [01/19/2021-17:50:33] [V] [TRT] FeatureExtractor/MobilenetV2/Conv/Conv2D + FeatureExtractor/MobilenetV2/Conv/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [01/19/2021-17:50:33] [V] [TRT] Tactic: -9137461792520977713 time 0.080896 [01/19/2021-17:50:33] [V] [TRT] FeatureExtractor/MobilenetV2/Conv/Conv2D + FeatureExtractor/MobilenetV2/Conv/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [01/19/2021-17:50:33] [V] [TRT] Tactic: -6092040395344634144 time 0.034816 [01/19/2021-17:50:33] [V] [TRT] FeatureExtractor/MobilenetV2/Conv/Conv2D + FeatureExtractor/MobilenetV2/Conv/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:33] [V] [TRT] Tactic: -3456450830548107839 time 0.034816 [01/19/2021-17:50:33] [V] [TRT] FeatureExtractor/MobilenetV2/Conv/Conv2D + FeatureExtractor/MobilenetV2/Conv/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:33] [V] [TRT] Tactic: -410470605513481746 time 0.078848 [01/19/2021-17:50:33] [V] [TRT] Fastest Tactic: -6092040395344634144 Time: 0.034816 [01/19/2021-17:50:33] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/Conv/Conv2D + FeatureExtractor/MobilenetV2/Conv/Relu6 (CudaConvolution) [01/19/2021-17:50:33] [V] [TRT] Tactic: 0 time 0.132096 [01/19/2021-17:50:33] [V] [TRT] Tactic: 1 time 0.119808 [01/19/2021-17:50:33] [V] [TRT] Tactic: 2 time 0.155648 [01/19/2021-17:50:33] [V] [TRT] Tactic: 5 time 3.43654 [01/19/2021-17:50:33] [V] [TRT] Fastest Tactic: 1 Time: 0.119808 [01/19/2021-17:50:33] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/Conv/Conv2D + FeatureExtractor/MobilenetV2/Conv/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:33] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6092040395344634144 [01/19/2021-17:50:33] [V] [TRT] FeatureExtractor/MobilenetV2/Conv/Conv2D + FeatureExtractor/MobilenetV2/Conv/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [01/19/2021-17:50:33] [V] [TRT] [01/19/2021-17:50:33] [V] [TRT] *************** Autotuning format combination: Float(1,150,22500,720000) -> Float(1,150,22500,720000) *************** [01/19/2021-17:50:33] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv/depthwise/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:33] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:33] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv/depthwise/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:33] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:33] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv/depthwise/Relu6 (CaskConvolution) [01/19/2021-17:50:33] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:33] [V] [TRT] Tactic: 1062367460111450758 time 0.648192 [01/19/2021-17:50:33] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [01/19/2021-17:50:33] [V] [TRT] Tactic: 4337000649858996379 time 1.03117 [01/19/2021-17:50:33] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:33] [V] [TRT] Tactic: 4501471010995462441 time 1.88006 [01/19/2021-17:50:33] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:33] [V] [TRT] Tactic: 5137655947464784826 time 0.9984 [01/19/2021-17:50:33] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:33] [V] [TRT] Tactic: 6645123197870846056 time 1.01581 [01/19/2021-17:50:33] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [01/19/2021-17:50:33] [V] [TRT] Tactic: -9137461792520977713 time 1.8944 [01/19/2021-17:50:33] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [01/19/2021-17:50:33] [V] [TRT] Tactic: -6092040395344634144 time 0.657408 [01/19/2021-17:50:33] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:33] [V] [TRT] Tactic: -3456450830548107839 time 0.62976 [01/19/2021-17:50:33] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:33] [V] [TRT] Tactic: -410470605513481746 time 1.85754 [01/19/2021-17:50:33] [V] [TRT] Fastest Tactic: -3456450830548107839 Time: 0.62976 [01/19/2021-17:50:33] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv/depthwise/Relu6 (CudaConvolution) [01/19/2021-17:50:33] [V] [TRT] Tactic: 0 time 0.152576 [01/19/2021-17:50:33] [V] [TRT] Tactic: 1 time 0.674816 [01/19/2021-17:50:33] [V] [TRT] Tactic: 2 time 0.672768 [01/19/2021-17:50:33] [V] [TRT] Tactic: 4 time 17.7807 [01/19/2021-17:50:33] [V] [TRT] Tactic: 5 time 16.7834 [01/19/2021-17:50:33] [V] [TRT] Tactic: 6 time 1.3752 [01/19/2021-17:50:33] [V] [TRT] Fastest Tactic: 0 Time: 0.152576 [01/19/2021-17:50:33] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv/depthwise/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:33] [V] [TRT] Tactic: -1 time 0.06688 [01/19/2021-17:50:33] [V] [TRT] Fastest Tactic: -1 Time: 0.06688 [01/19/2021-17:50:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [01/19/2021-17:50:33] [V] [TRT] [01/19/2021-17:50:33] [V] [TRT] *************** Autotuning format combination: Float(1,150,22500,720000) -> Float(1,150,22500,360000) *************** [01/19/2021-17:50:33] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv/project/Conv2D (LegacySASSConvolution) [01/19/2021-17:50:33] [V] [TRT] Tactic: 0 time 0.037888 [01/19/2021-17:50:33] [V] [TRT] Fastest Tactic: 0 Time: 0.037888 [01/19/2021-17:50:33] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv/project/Conv2D (FusedConvActConvolution) [01/19/2021-17:50:33] [V] [TRT] Tactic: 8 time 0.067584 [01/19/2021-17:50:33] [V] [TRT] Tactic: 9 time 0.111616 [01/19/2021-17:50:33] [V] [TRT] Tactic: 11 time 0.070656 [01/19/2021-17:50:33] [V] [TRT] Tactic: 12 time 0.171008 [01/19/2021-17:50:33] [V] [TRT] Tactic: 17 time 0.096256 [01/19/2021-17:50:33] [V] [TRT] Tactic: 19 time 0.152576 [01/19/2021-17:50:33] [V] [TRT] Tactic: 20 time 0.07168 [01/19/2021-17:50:33] [V] [TRT] Tactic: 21 time 0.164864 [01/19/2021-17:50:33] [V] [TRT] Tactic: 22 time 0.137216 [01/19/2021-17:50:33] [V] [TRT] Tactic: 24 time 0.075712 [01/19/2021-17:50:33] [V] [TRT] Tactic: 27 time 0.07168 [01/19/2021-17:50:33] [V] [TRT] Tactic: 28 time 0.12288 [01/19/2021-17:50:33] [V] [TRT] Tactic: 31 time 0.084928 [01/19/2021-17:50:33] [V] [TRT] Tactic: 32 time 0.070656 [01/19/2021-17:50:33] [V] [TRT] Tactic: 34 time 0.064512 [01/19/2021-17:50:33] [V] [TRT] Tactic: 35 time 0.086016 [01/19/2021-17:50:33] [V] [TRT] Tactic: 40 time 0.06848 [01/19/2021-17:50:33] [V] [TRT] Tactic: 46 time 0.131072 [01/19/2021-17:50:33] [V] [TRT] Tactic: 50 time 0.137216 [01/19/2021-17:50:33] [V] [TRT] Tactic: 51 time 0.074752 [01/19/2021-17:50:33] [V] [TRT] Tactic: 53 time 0.072704 [01/19/2021-17:50:33] [V] [TRT] Tactic: 55 time 0.098208 [01/19/2021-17:50:33] [V] [TRT] Tactic: 59 time 0.106496 [01/19/2021-17:50:33] [V] [TRT] Tactic: 60 time 0.072704 [01/19/2021-17:50:33] [V] [TRT] Tactic: 61 time 0.169984 [01/19/2021-17:50:33] [V] [TRT] Tactic: 63 time 0.07168 [01/19/2021-17:50:33] [V] [TRT] Tactic: 64 time 0.078848 [01/19/2021-17:50:33] [V] [TRT] Tactic: 65 time 0.067584 [01/19/2021-17:50:33] [V] [TRT] Tactic: 68 time 0.060416 [01/19/2021-17:50:33] [V] [TRT] Tactic: 69 time 0.070656 [01/19/2021-17:50:33] [V] [TRT] Tactic: 70 time 0.11264 [01/19/2021-17:50:33] [V] [TRT] Tactic: 74 time 0.069632 [01/19/2021-17:50:33] [V] [TRT] Tactic: 75 time 0.069632 [01/19/2021-17:50:33] [V] [TRT] Tactic: 78 time 0.09728 [01/19/2021-17:50:33] [V] [TRT] Tactic: 79 time 0.0768 [01/19/2021-17:50:33] [V] [TRT] Tactic: 81 time 0.099328 [01/19/2021-17:50:33] [V] [TRT] Tactic: 82 time 0.091072 [01/19/2021-17:50:33] [V] [TRT] Tactic: 84 time 0.140256 [01/19/2021-17:50:33] [V] [TRT] Tactic: 85 time 0.166912 [01/19/2021-17:50:33] [V] [TRT] Tactic: 86 time 0.07168 [01/19/2021-17:50:33] [V] [TRT] Tactic: 87 time 0.172032 [01/19/2021-17:50:33] [V] [TRT] Tactic: 88 time 0.074752 [01/19/2021-17:50:33] [V] [TRT] Tactic: 89 time 0.08704 [01/19/2021-17:50:33] [V] [TRT] Tactic: 91 time 0.065536 [01/19/2021-17:50:33] [V] [TRT] Tactic: 94 time 0.074752 [01/19/2021-17:50:33] [V] [TRT] Tactic: 95 time 0.095232 [01/19/2021-17:50:33] [V] [TRT] Tactic: 97 time 0.114688 [01/19/2021-17:50:33] [V] [TRT] Tactic: 102 time 0.070656 [01/19/2021-17:50:33] [V] [TRT] Tactic: 103 time 0.094144 [01/19/2021-17:50:33] [V] [TRT] Tactic: 105 time 0.085952 [01/19/2021-17:50:33] [V] [TRT] Tactic: 106 time 0.083968 [01/19/2021-17:50:33] [V] [TRT] Tactic: 107 time 0.07472 [01/19/2021-17:50:33] [V] [TRT] Tactic: 108 time 0.07472 [01/19/2021-17:50:33] [V] [TRT] Tactic: 109 time 0.0768 [01/19/2021-17:50:33] [V] [TRT] Tactic: 111 time 0.087008 [01/19/2021-17:50:33] [V] [TRT] Tactic: 112 time 0.091136 [01/19/2021-17:50:33] [V] [TRT] Tactic: 114 time 0.082944 [01/19/2021-17:50:33] [V] [TRT] Tactic: 115 time 0.073728 [01/19/2021-17:50:33] [V] [TRT] Tactic: 117 time 0.082944 [01/19/2021-17:50:33] [V] [TRT] Tactic: 118 time 0.069632 [01/19/2021-17:50:33] [V] [TRT] Tactic: 124 time 0.0768 [01/19/2021-17:50:33] [V] [TRT] Tactic: 125 time 0.068608 [01/19/2021-17:50:33] [V] [TRT] Tactic: 126 time 0.070656 [01/19/2021-17:50:33] [V] [TRT] Tactic: 131 time 0.075648 [01/19/2021-17:50:33] [V] [TRT] Tactic: 132 time 0.092032 [01/19/2021-17:50:33] [V] [TRT] Tactic: 138 time 0.082912 [01/19/2021-17:50:33] [V] [TRT] Tactic: 145 time 0.068608 [01/19/2021-17:50:33] [V] [TRT] Tactic: 150 time 0.069632 [01/19/2021-17:50:33] [V] [TRT] Tactic: 155 time 0.068608 [01/19/2021-17:50:33] [V] [TRT] Tactic: 157 time 0.071552 [01/19/2021-17:50:33] [V] [TRT] Tactic: 160 time 0.060416 [01/19/2021-17:50:33] [V] [TRT] Tactic: 163 time 0.082944 [01/19/2021-17:50:33] [V] [TRT] Tactic: 166 time 0.069632 [01/19/2021-17:50:33] [V] [TRT] Fastest Tactic: 68 Time: 0.060416 [01/19/2021-17:50:33] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv/project/Conv2D (CaskConvolution) [01/19/2021-17:50:33] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:33] [V] [TRT] Tactic: 1062367460111450758 time 0.034816 [01/19/2021-17:50:33] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:33] [V] [TRT] Tactic: 4501471010995462441 time 0.074752 [01/19/2021-17:50:33] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:33] [V] [TRT] Tactic: 5137655947464784826 time 0.044032 [01/19/2021-17:50:33] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:33] [V] [TRT] Tactic: 5326823351883942011 time 0.07168 [01/19/2021-17:50:33] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:33] [V] [TRT] Tactic: 6645123197870846056 time 0.045056 [01/19/2021-17:50:33] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:33] [V] [TRT] Tactic: -6576203419454146580 time 0.033792 [01/19/2021-17:50:33] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:33] [V] [TRT] Tactic: -3456450830548107839 time 0.035776 [01/19/2021-17:50:33] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:33] [V] [TRT] Tactic: -410470605513481746 time 0.073728 [01/19/2021-17:50:33] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:33] [V] [TRT] Tactic: -37215280111360163 time 0.043008 [01/19/2021-17:50:33] [V] [TRT] Fastest Tactic: -6576203419454146580 Time: 0.033792 [01/19/2021-17:50:33] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv/project/Conv2D (CudaConvolution) [01/19/2021-17:50:33] [V] [TRT] Tactic: 0 time 0.057344 [01/19/2021-17:50:33] [V] [TRT] Tactic: 1 time 0.057344 [01/19/2021-17:50:33] [V] [TRT] Tactic: 2 time 0.089088 [01/19/2021-17:50:33] [V] [TRT] Tactic: 4 skipped. Scratch requested: 289013760, available: 16777216 [01/19/2021-17:50:33] [V] [TRT] Tactic: 5 time 0.183296 [01/19/2021-17:50:33] [I] [TRT] Some tactics do not have sufficient workspace memory to run. Increasing workspace size may increase performance, please check verbose output. [01/19/2021-17:50:33] [V] [TRT] Fastest Tactic: 0 Time: 0.057344 [01/19/2021-17:50:33] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv/project/Conv2D (CudaDepthwiseConvolution) [01/19/2021-17:50:33] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6576203419454146580 [01/19/2021-17:50:33] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:33] [V] [TRT] [01/19/2021-17:50:33] [V] [TRT] *************** Autotuning format combination: Float(1,150,22500,360000) -> Float(1,150,22500,2160000) *************** [01/19/2021-17:50:33] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:33] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:33] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:33] [V] [TRT] Tactic: 8 time 0.222208 [01/19/2021-17:50:33] [V] [TRT] Tactic: 9 time 0.226304 [01/19/2021-17:50:34] [V] [TRT] Tactic: 11 time 0.24576 [01/19/2021-17:50:34] [V] [TRT] Tactic: 12 time 0.24064 [01/19/2021-17:50:34] [V] [TRT] Tactic: 17 time 0.27136 [01/19/2021-17:50:34] [V] [TRT] Tactic: 19 time 0.393216 [01/19/2021-17:50:34] [V] [TRT] Tactic: 20 time 0.207872 [01/19/2021-17:50:34] [V] [TRT] Tactic: 21 time 0.300032 [01/19/2021-17:50:34] [V] [TRT] Tactic: 22 time 0.241664 [01/19/2021-17:50:34] [V] [TRT] Tactic: 24 time 0.251904 [01/19/2021-17:50:34] [V] [TRT] Tactic: 27 time 0.239616 [01/19/2021-17:50:34] [V] [TRT] Tactic: 28 time 0.23552 [01/19/2021-17:50:34] [V] [TRT] Tactic: 32 time 0.217088 [01/19/2021-17:50:34] [V] [TRT] Tactic: 34 time 0.201728 [01/19/2021-17:50:34] [V] [TRT] Tactic: 35 time 0.232448 [01/19/2021-17:50:34] [V] [TRT] Tactic: 40 time 0.2048 [01/19/2021-17:50:34] [V] [TRT] Tactic: 46 time 0.233472 [01/19/2021-17:50:34] [V] [TRT] Tactic: 50 time 0.24064 [01/19/2021-17:50:34] [V] [TRT] Tactic: 51 time 0.2272 [01/19/2021-17:50:34] [V] [TRT] Tactic: 53 time 0.228352 [01/19/2021-17:50:34] [V] [TRT] Tactic: 55 time 0.227328 [01/19/2021-17:50:34] [V] [TRT] Tactic: 59 time 0.226304 [01/19/2021-17:50:34] [V] [TRT] Tactic: 60 time 0.242688 [01/19/2021-17:50:34] [V] [TRT] Tactic: 61 time 0.244736 [01/19/2021-17:50:34] [V] [TRT] Tactic: 63 time 0.24064 [01/19/2021-17:50:34] [V] [TRT] Tactic: 65 time 0.228352 [01/19/2021-17:50:34] [V] [TRT] Tactic: 68 time 0.217056 [01/19/2021-17:50:34] [V] [TRT] Tactic: 69 time 0.249856 [01/19/2021-17:50:34] [V] [TRT] Tactic: 70 time 0.268288 [01/19/2021-17:50:34] [V] [TRT] Tactic: 74 time 0.243712 [01/19/2021-17:50:34] [V] [TRT] Tactic: 75 time 0.228352 [01/19/2021-17:50:34] [V] [TRT] Tactic: 78 time 0.258048 [01/19/2021-17:50:34] [V] [TRT] Tactic: 79 time 0.233472 [01/19/2021-17:50:34] [V] [TRT] Tactic: 81 time 0.25088 [01/19/2021-17:50:34] [V] [TRT] Tactic: 82 time 0.263168 [01/19/2021-17:50:34] [V] [TRT] Tactic: 84 time 0.234496 [01/19/2021-17:50:34] [V] [TRT] Tactic: 85 time 0.243712 [01/19/2021-17:50:34] [V] [TRT] Tactic: 86 time 0.214016 [01/19/2021-17:50:34] [V] [TRT] Tactic: 87 time 0.32768 [01/19/2021-17:50:34] [V] [TRT] Tactic: 88 time 0.229376 [01/19/2021-17:50:34] [V] [TRT] Tactic: 89 time 0.238528 [01/19/2021-17:50:34] [V] [TRT] Tactic: 91 time 0.205792 [01/19/2021-17:50:34] [V] [TRT] Tactic: 94 time 0.237568 [01/19/2021-17:50:34] [V] [TRT] Tactic: 95 time 0.270336 [01/19/2021-17:50:34] [V] [TRT] Tactic: 97 time 0.224256 [01/19/2021-17:50:34] [V] [TRT] Tactic: 102 time 0.252928 [01/19/2021-17:50:34] [V] [TRT] Tactic: 103 time 0.251872 [01/19/2021-17:50:34] [V] [TRT] Tactic: 105 time 0.259072 [01/19/2021-17:50:34] [V] [TRT] Tactic: 107 time 0.232448 [01/19/2021-17:50:34] [V] [TRT] Tactic: 108 time 0.231264 [01/19/2021-17:50:34] [V] [TRT] Tactic: 109 time 0.234496 [01/19/2021-17:50:34] [V] [TRT] Tactic: 111 time 0.23344 [01/19/2021-17:50:34] [V] [TRT] Tactic: 112 time 0.243712 [01/19/2021-17:50:34] [V] [TRT] Tactic: 114 time 0.222208 [01/19/2021-17:50:34] [V] [TRT] Tactic: 115 time 0.241664 [01/19/2021-17:50:34] [V] [TRT] Tactic: 117 time 0.229376 [01/19/2021-17:50:34] [V] [TRT] Tactic: 118 time 0.247808 [01/19/2021-17:50:34] [V] [TRT] Tactic: 124 time 0.253952 [01/19/2021-17:50:34] [V] [TRT] Tactic: 125 time 0.232448 [01/19/2021-17:50:34] [V] [TRT] Tactic: 126 time 0.24064 [01/19/2021-17:50:34] [V] [TRT] Tactic: 131 time 0.248832 [01/19/2021-17:50:34] [V] [TRT] Tactic: 132 time 0.242688 [01/19/2021-17:50:34] [V] [TRT] Tactic: 145 time 0.244672 [01/19/2021-17:50:34] [V] [TRT] Tactic: 150 time 0.239616 [01/19/2021-17:50:34] [V] [TRT] Tactic: 155 time 0.206816 [01/19/2021-17:50:34] [V] [TRT] Tactic: 157 time 0.26112 [01/19/2021-17:50:34] [V] [TRT] Tactic: 160 time 0.210944 [01/19/2021-17:50:34] [V] [TRT] Tactic: 163 time 0.232448 [01/19/2021-17:50:34] [V] [TRT] Tactic: 166 time 0.227328 [01/19/2021-17:50:34] [V] [TRT] Fastest Tactic: 34 Time: 0.201728 [01/19/2021-17:50:34] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Relu6 (CaskConvolution) [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: 1062367460111450758 time 0.079872 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: 4501471010995462441 time 0.069632 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: 5137655947464784826 time 0.077824 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: 5326823351883942011 time 0.069632 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: 6645123197870846056 time 0.077824 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: -6576203419454146580 time 0.077856 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: -3456450830548107839 time 0.079872 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: -410470605513481746 time 0.069632 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: -37215280111360163 time 0.075776 [01/19/2021-17:50:34] [V] [TRT] Fastest Tactic: 4501471010995462441 Time: 0.069632 [01/19/2021-17:50:34] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Relu6 (CudaConvolution) [01/19/2021-17:50:34] [V] [TRT] Tactic: 0 time 0.3072 [01/19/2021-17:50:34] [V] [TRT] Tactic: 1 time 0.278528 [01/19/2021-17:50:34] [V] [TRT] Tactic: 2 time 0.327648 [01/19/2021-17:50:34] [V] [TRT] Tactic: 4 skipped. Scratch requested: 821624832, available: 16777216 [01/19/2021-17:50:34] [V] [TRT] Tactic: 5 time 0.479232 [01/19/2021-17:50:34] [V] [TRT] Fastest Tactic: 1 Time: 0.278528 [01/19/2021-17:50:34] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:34] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4501471010995462441 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:34] [V] [TRT] [01/19/2021-17:50:34] [V] [TRT] *************** Autotuning format combination: Float(1,150,22500,2160000) -> Float(1,75,5625,540000) *************** [01/19/2021-17:50:34] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:34] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:34] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:34] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:34] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/Relu6 (CaskConvolution) [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: 1062367460111450758 time 0.827392 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: 4337000649858996379 time 0.910336 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: 4501471010995462441 time 1.54214 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: 5137655947464784826 time 0.842752 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: 6645123197870846056 time 0.85504 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: -9137461792520977713 time 1.55034 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: -6092040395344634144 time 0.80896 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: -3456450830548107839 time 0.779264 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: -410470605513481746 time 1.54522 [01/19/2021-17:50:34] [V] [TRT] Fastest Tactic: -3456450830548107839 Time: 0.779264 [01/19/2021-17:50:34] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/Relu6 (CudaConvolution) [01/19/2021-17:50:34] [V] [TRT] Tactic: 0 time 0.249856 [01/19/2021-17:50:34] [V] [TRT] Tactic: 1 time 0.71168 [01/19/2021-17:50:34] [V] [TRT] Tactic: 2 time 1.06803 [01/19/2021-17:50:34] [V] [TRT] Tactic: 5 time 41.5406 [01/19/2021-17:50:34] [V] [TRT] Fastest Tactic: 0 Time: 0.249856 [01/19/2021-17:50:34] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:34] [V] [TRT] Tactic: -1 time 0.090112 [01/19/2021-17:50:34] [V] [TRT] Fastest Tactic: -1 Time: 0.090112 [01/19/2021-17:50:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [01/19/2021-17:50:34] [V] [TRT] [01/19/2021-17:50:34] [V] [TRT] *************** Autotuning format combination: Float(1,75,5625,540000) -> Float(1,75,5625,135000) *************** [01/19/2021-17:50:34] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_1/project/Conv2D (LegacySASSConvolution) [01/19/2021-17:50:34] [V] [TRT] Tactic: 0 time 0.022528 [01/19/2021-17:50:34] [V] [TRT] Fastest Tactic: 0 Time: 0.022528 [01/19/2021-17:50:34] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_1/project/Conv2D (FusedConvActConvolution) [01/19/2021-17:50:34] [V] [TRT] Tactic: 8 time 0.048128 [01/19/2021-17:50:34] [V] [TRT] Tactic: 9 time 0.071296 [01/19/2021-17:50:34] [V] [TRT] Tactic: 11 time 0.036832 [01/19/2021-17:50:34] [V] [TRT] Tactic: 12 time 0.074752 [01/19/2021-17:50:34] [V] [TRT] Tactic: 17 time 0.045056 [01/19/2021-17:50:34] [V] [TRT] Tactic: 19 time 0.059392 [01/19/2021-17:50:34] [V] [TRT] Tactic: 20 time 0.039936 [01/19/2021-17:50:34] [V] [TRT] Tactic: 21 time 0.070656 [01/19/2021-17:50:34] [V] [TRT] Tactic: 22 time 0.069632 [01/19/2021-17:50:34] [V] [TRT] Tactic: 24 time 0.038912 [01/19/2021-17:50:34] [V] [TRT] Tactic: 27 time 0.036864 [01/19/2021-17:50:34] [V] [TRT] Tactic: 28 time 0.075776 [01/19/2021-17:50:34] [V] [TRT] Tactic: 31 time 0.038912 [01/19/2021-17:50:34] [V] [TRT] Tactic: 32 time 0.039936 [01/19/2021-17:50:34] [V] [TRT] Tactic: 34 time 0.039936 [01/19/2021-17:50:34] [V] [TRT] Tactic: 35 time 0.044032 [01/19/2021-17:50:34] [V] [TRT] Tactic: 40 time 0.039936 [01/19/2021-17:50:34] [V] [TRT] Tactic: 46 time 0.065536 [01/19/2021-17:50:34] [V] [TRT] Tactic: 50 time 0.069632 [01/19/2021-17:50:34] [V] [TRT] Tactic: 51 time 0.04096 [01/19/2021-17:50:34] [V] [TRT] Tactic: 53 time 0.038912 [01/19/2021-17:50:34] [V] [TRT] Tactic: 55 time 0.05632 [01/19/2021-17:50:34] [V] [TRT] Tactic: 59 time 0.067584 [01/19/2021-17:50:34] [V] [TRT] Tactic: 60 time 0.032768 [01/19/2021-17:50:34] [V] [TRT] Tactic: 61 time 0.074752 [01/19/2021-17:50:34] [V] [TRT] Tactic: 63 time 0.03584 [01/19/2021-17:50:34] [V] [TRT] Tactic: 64 time 0.037888 [01/19/2021-17:50:34] [V] [TRT] Tactic: 65 time 0.034816 [01/19/2021-17:50:34] [V] [TRT] Tactic: 68 time 0.036864 [01/19/2021-17:50:34] [V] [TRT] Tactic: 69 time 0.033792 [01/19/2021-17:50:34] [V] [TRT] Tactic: 70 time 0.048128 [01/19/2021-17:50:34] [V] [TRT] Tactic: 74 time 0.032736 [01/19/2021-17:50:34] [V] [TRT] Tactic: 75 time 0.033792 [01/19/2021-17:50:34] [V] [TRT] Tactic: 78 time 0.044032 [01/19/2021-17:50:34] [V] [TRT] Tactic: 79 time 0.04096 [01/19/2021-17:50:34] [V] [TRT] Tactic: 81 time 0.0512 [01/19/2021-17:50:34] [V] [TRT] Tactic: 82 time 0.048128 [01/19/2021-17:50:34] [V] [TRT] Tactic: 84 time 0.067584 [01/19/2021-17:50:34] [V] [TRT] Tactic: 85 time 0.074752 [01/19/2021-17:50:34] [V] [TRT] Tactic: 86 time 0.048128 [01/19/2021-17:50:34] [V] [TRT] Tactic: 87 time 0.104448 [01/19/2021-17:50:34] [V] [TRT] Tactic: 88 time 0.04096 [01/19/2021-17:50:34] [V] [TRT] Tactic: 89 time 0.037888 [01/19/2021-17:50:34] [V] [TRT] Tactic: 91 time 0.037888 [01/19/2021-17:50:34] [V] [TRT] Tactic: 94 time 0.038912 [01/19/2021-17:50:34] [V] [TRT] Tactic: 95 time 0.045056 [01/19/2021-17:50:34] [V] [TRT] Tactic: 97 time 0.062464 [01/19/2021-17:50:34] [V] [TRT] Tactic: 102 time 0.036864 [01/19/2021-17:50:34] [V] [TRT] Tactic: 103 time 0.050176 [01/19/2021-17:50:34] [V] [TRT] Tactic: 105 time 0.049152 [01/19/2021-17:50:34] [V] [TRT] Tactic: 106 time 0.036864 [01/19/2021-17:50:34] [V] [TRT] Tactic: 107 time 0.038912 [01/19/2021-17:50:34] [V] [TRT] Tactic: 108 time 0.043008 [01/19/2021-17:50:34] [V] [TRT] Tactic: 109 time 0.04096 [01/19/2021-17:50:34] [V] [TRT] Tactic: 111 time 0.038912 [01/19/2021-17:50:34] [V] [TRT] Tactic: 112 time 0.044032 [01/19/2021-17:50:34] [V] [TRT] Tactic: 114 time 0.0512 [01/19/2021-17:50:34] [V] [TRT] Tactic: 115 time 0.041984 [01/19/2021-17:50:34] [V] [TRT] Tactic: 117 time 0.04096 [01/19/2021-17:50:34] [V] [TRT] Tactic: 118 time 0.03584 [01/19/2021-17:50:34] [V] [TRT] Tactic: 124 time 0.041984 [01/19/2021-17:50:34] [V] [TRT] Tactic: 125 time 0.033792 [01/19/2021-17:50:34] [V] [TRT] Tactic: 126 time 0.036864 [01/19/2021-17:50:34] [V] [TRT] Tactic: 131 time 0.041984 [01/19/2021-17:50:34] [V] [TRT] Tactic: 132 time 0.0512 [01/19/2021-17:50:34] [V] [TRT] Tactic: 138 time 0.036864 [01/19/2021-17:50:34] [V] [TRT] Tactic: 145 time 0.032768 [01/19/2021-17:50:34] [V] [TRT] Tactic: 150 time 0.03584 [01/19/2021-17:50:34] [V] [TRT] Tactic: 155 time 0.038912 [01/19/2021-17:50:34] [V] [TRT] Tactic: 157 time 0.036864 [01/19/2021-17:50:34] [V] [TRT] Tactic: 160 time 0.03072 [01/19/2021-17:50:34] [V] [TRT] Tactic: 163 time 0.04096 [01/19/2021-17:50:34] [V] [TRT] Tactic: 166 time 0.032768 [01/19/2021-17:50:34] [V] [TRT] Fastest Tactic: 160 Time: 0.03072 [01/19/2021-17:50:34] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_1/project/Conv2D (CaskConvolution) [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_1/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: 1062367460111450758 time 0.023552 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_1/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: 4501471010995462441 time 0.03584 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_1/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: 5137655947464784826 time 0.023552 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_1/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: 5326823351883942011 time 0.03584 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_1/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: 6645123197870846056 time 0.023552 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_1/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: -6576203419454146580 time 0.023552 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_1/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: -3456450830548107839 time 0.023552 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_1/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: -410470605513481746 time 0.03584 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_1/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: -37215280111360163 time 0.023552 [01/19/2021-17:50:34] [V] [TRT] Fastest Tactic: 1062367460111450758 Time: 0.023552 [01/19/2021-17:50:34] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_1/project/Conv2D (CudaConvolution) [01/19/2021-17:50:34] [V] [TRT] Tactic: 0 time 0.031744 [01/19/2021-17:50:34] [V] [TRT] Tactic: 1 time 0.032768 [01/19/2021-17:50:34] [V] [TRT] Tactic: 2 time 0.074752 [01/19/2021-17:50:34] [V] [TRT] Tactic: 4 skipped. Scratch requested: 319881216, available: 16777216 [01/19/2021-17:50:34] [V] [TRT] Tactic: 5 time 0.120832 [01/19/2021-17:50:34] [V] [TRT] Fastest Tactic: 0 Time: 0.031744 [01/19/2021-17:50:34] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_1/project/Conv2D (CudaDepthwiseConvolution) [01/19/2021-17:50:34] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: LegacySASSConvolution Tactic: 0 [01/19/2021-17:50:34] [V] [TRT] [01/19/2021-17:50:34] [V] [TRT] *************** Autotuning format combination: Float(1,75,5625,135000) -> Float(1,75,5625,810000) *************** [01/19/2021-17:50:34] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:34] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:34] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:34] [V] [TRT] Tactic: 8 time 0.093184 [01/19/2021-17:50:34] [V] [TRT] Tactic: 9 time 0.093184 [01/19/2021-17:50:34] [V] [TRT] Tactic: 11 time 0.09216 [01/19/2021-17:50:34] [V] [TRT] Tactic: 12 time 0.103424 [01/19/2021-17:50:34] [V] [TRT] Tactic: 19 time 0.185344 [01/19/2021-17:50:34] [V] [TRT] Tactic: 20 time 0.086016 [01/19/2021-17:50:34] [V] [TRT] Tactic: 22 time 0.095232 [01/19/2021-17:50:34] [V] [TRT] Tactic: 24 time 0.095232 [01/19/2021-17:50:34] [V] [TRT] Tactic: 27 time 0.089088 [01/19/2021-17:50:34] [V] [TRT] Tactic: 28 time 0.093184 [01/19/2021-17:50:34] [V] [TRT] Tactic: 32 time 0.079872 [01/19/2021-17:50:34] [V] [TRT] Tactic: 34 time 0.077824 [01/19/2021-17:50:34] [V] [TRT] Tactic: 35 time 0.091136 [01/19/2021-17:50:34] [V] [TRT] Tactic: 40 time 0.078848 [01/19/2021-17:50:34] [V] [TRT] Tactic: 46 time 0.09216 [01/19/2021-17:50:34] [V] [TRT] Tactic: 50 time 0.095232 [01/19/2021-17:50:34] [V] [TRT] Tactic: 51 time 0.086016 [01/19/2021-17:50:34] [V] [TRT] Tactic: 53 time 0.084992 [01/19/2021-17:50:34] [V] [TRT] Tactic: 55 time 0.089024 [01/19/2021-17:50:34] [V] [TRT] Tactic: 59 time 0.090112 [01/19/2021-17:50:34] [V] [TRT] Tactic: 61 time 0.1024 [01/19/2021-17:50:34] [V] [TRT] Tactic: 63 time 0.090112 [01/19/2021-17:50:34] [V] [TRT] Tactic: 65 time 0.089088 [01/19/2021-17:50:34] [V] [TRT] Tactic: 68 time 0.08704 [01/19/2021-17:50:34] [V] [TRT] Tactic: 75 time 0.093184 [01/19/2021-17:50:34] [V] [TRT] Tactic: 79 time 0.08704 [01/19/2021-17:50:34] [V] [TRT] Tactic: 82 time 0.101376 [01/19/2021-17:50:34] [V] [TRT] Tactic: 84 time 0.095232 [01/19/2021-17:50:34] [V] [TRT] Tactic: 85 time 0.101376 [01/19/2021-17:50:34] [V] [TRT] Tactic: 86 time 0.08192 [01/19/2021-17:50:34] [V] [TRT] Tactic: 87 time 0.13824 [01/19/2021-17:50:34] [V] [TRT] Tactic: 88 time 0.08704 [01/19/2021-17:50:34] [V] [TRT] Tactic: 91 time 0.080896 [01/19/2021-17:50:34] [V] [TRT] Tactic: 94 time 0.08704 [01/19/2021-17:50:34] [V] [TRT] Tactic: 97 time 0.089088 [01/19/2021-17:50:34] [V] [TRT] Tactic: 103 time 0.091136 [01/19/2021-17:50:34] [V] [TRT] Tactic: 105 time 0.101376 [01/19/2021-17:50:34] [V] [TRT] Tactic: 107 time 0.086016 [01/19/2021-17:50:34] [V] [TRT] Tactic: 108 time 0.091136 [01/19/2021-17:50:34] [V] [TRT] Tactic: 109 time 0.08704 [01/19/2021-17:50:34] [V] [TRT] Tactic: 112 time 0.090112 [01/19/2021-17:50:34] [V] [TRT] Tactic: 114 time 0.08704 [01/19/2021-17:50:34] [V] [TRT] Tactic: 115 time 0.093184 [01/19/2021-17:50:34] [V] [TRT] Tactic: 117 time 0.084992 [01/19/2021-17:50:34] [V] [TRT] Tactic: 118 time 0.09216 [01/19/2021-17:50:34] [V] [TRT] Tactic: 124 time 0.100352 [01/19/2021-17:50:34] [V] [TRT] Tactic: 126 time 0.091136 [01/19/2021-17:50:34] [V] [TRT] Tactic: 131 time 0.093184 [01/19/2021-17:50:34] [V] [TRT] Tactic: 132 time 0.091104 [01/19/2021-17:50:34] [V] [TRT] Tactic: 150 time 0.091136 [01/19/2021-17:50:34] [V] [TRT] Tactic: 155 time 0.078848 [01/19/2021-17:50:34] [V] [TRT] Tactic: 160 time 0.080896 [01/19/2021-17:50:34] [V] [TRT] Tactic: 163 time 0.086016 [01/19/2021-17:50:34] [V] [TRT] Tactic: 166 time 0.094208 [01/19/2021-17:50:34] [V] [TRT] Fastest Tactic: 34 Time: 0.077824 [01/19/2021-17:50:34] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Relu6 (CaskConvolution) [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: 1062367460111450758 time 0.03072 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: 4501471010995462441 time 0.037888 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: 5137655947464784826 time 0.033792 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: 5326823351883942011 time 0.03584 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: 6645123197870846056 time 0.033792 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: -6576203419454146580 time 0.029696 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: -3456450830548107839 time 0.029696 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: -410470605513481746 time 0.036864 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: -37215280111360163 time 0.033792 [01/19/2021-17:50:34] [V] [TRT] Fastest Tactic: -6576203419454146580 Time: 0.029696 [01/19/2021-17:50:34] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Relu6 (CudaConvolution) [01/19/2021-17:50:34] [V] [TRT] Tactic: 0 time 0.11776 [01/19/2021-17:50:34] [V] [TRT] Tactic: 1 time 0.110592 [01/19/2021-17:50:34] [V] [TRT] Tactic: 2 time 0.130048 [01/19/2021-17:50:34] [V] [TRT] Tactic: 4 skipped. Scratch requested: 463650816, available: 16777216 [01/19/2021-17:50:34] [V] [TRT] Tactic: 5 time 0.232448 [01/19/2021-17:50:34] [V] [TRT] Fastest Tactic: 1 Time: 0.110592 [01/19/2021-17:50:34] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:34] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6576203419454146580 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:34] [V] [TRT] [01/19/2021-17:50:34] [V] [TRT] *************** Autotuning format combination: Float(1,75,5625,810000) -> Float(1,75,5625,810000) *************** [01/19/2021-17:50:34] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:34] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:34] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:34] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:34] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/Relu6 (CaskConvolution) [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: 1062367460111450758 time 1.11309 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: 4337000649858996379 time 1.1991 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: 4501471010995462441 time 2.16781 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: 5137655947464784826 time 1.16224 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: 6645123197870846056 time 1.18067 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: -9137461792520977713 time 2.18624 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: -6092040395344634144 time 1.1264 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: -3456450830548107839 time 1.06906 [01/19/2021-17:50:34] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:34] [V] [TRT] Tactic: -410470605513481746 time 2.16358 [01/19/2021-17:50:34] [V] [TRT] Fastest Tactic: -3456450830548107839 Time: 1.06906 [01/19/2021-17:50:34] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/Relu6 (CudaConvolution) [01/19/2021-17:50:34] [V] [TRT] Tactic: 0 time 0.129024 [01/19/2021-17:50:34] [V] [TRT] Tactic: 1 time 0.859136 [01/19/2021-17:50:34] [V] [TRT] Tactic: 2 time 1.46086 [01/19/2021-17:50:35] [V] [TRT] Tactic: 4 time 20.2955 [01/19/2021-17:50:35] [V] [TRT] Tactic: 5 time 23.6739 [01/19/2021-17:50:35] [V] [TRT] Tactic: 6 time 1.56877 [01/19/2021-17:50:35] [V] [TRT] Fastest Tactic: 0 Time: 0.129024 [01/19/2021-17:50:35] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:35] [V] [TRT] Tactic: -1 time 0.055296 [01/19/2021-17:50:35] [V] [TRT] Fastest Tactic: -1 Time: 0.055296 [01/19/2021-17:50:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [01/19/2021-17:50:35] [V] [TRT] [01/19/2021-17:50:35] [V] [TRT] *************** Autotuning format combination: Float(1,75,5625,810000), Float(1,75,5625,135000) -> Float(1,75,5625,135000) *************** [01/19/2021-17:50:35] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_2/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_2/add (LegacySASSConvolution) [01/19/2021-17:50:35] [V] [TRT] Tactic: 0 time 0.032768 [01/19/2021-17:50:35] [V] [TRT] Fastest Tactic: 0 Time: 0.032768 [01/19/2021-17:50:35] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_2/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_2/add (CaskConvolution) [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_2/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_2/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: 1062367460111450758 time 0.031744 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_2/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_2/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: 4501471010995462441 time 0.049152 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_2/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_2/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: 5137655947464784826 time 0.031744 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_2/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_2/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: 5326823351883942011 time 0.048128 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_2/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_2/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: 6645123197870846056 time 0.031744 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_2/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_2/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: -6576203419454146580 time 0.029696 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_2/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_2/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: -3456450830548107839 time 0.03072 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_2/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_2/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: -410470605513481746 time 0.048128 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_2/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_2/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: -37215280111360163 time 0.031744 [01/19/2021-17:50:35] [V] [TRT] Fastest Tactic: -6576203419454146580 Time: 0.029696 [01/19/2021-17:50:35] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_2/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_2/add (CudaConvolution) [01/19/2021-17:50:35] [V] [TRT] Tactic: 0 time 0.043008 [01/19/2021-17:50:35] [V] [TRT] Tactic: 1 time 0.044896 [01/19/2021-17:50:35] [V] [TRT] Tactic: 2 time 0.106496 [01/19/2021-17:50:35] [V] [TRT] Tactic: 4 skipped. Scratch requested: 479625216, available: 16777216 [01/19/2021-17:50:35] [V] [TRT] Tactic: 5 time 0.16384 [01/19/2021-17:50:35] [V] [TRT] Fastest Tactic: 0 Time: 0.043008 [01/19/2021-17:50:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6576203419454146580 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_2/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_2/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:35] [V] [TRT] [01/19/2021-17:50:35] [V] [TRT] *************** Autotuning format combination: Float(1,75,5625,135000) -> Float(1,75,5625,810000) *************** [01/19/2021-17:50:35] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:35] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:35] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:35] [V] [TRT] Tactic: 8 time 0.093184 [01/19/2021-17:50:35] [V] [TRT] Tactic: 9 time 0.093184 [01/19/2021-17:50:35] [V] [TRT] Tactic: 11 time 0.09216 [01/19/2021-17:50:35] [V] [TRT] Tactic: 12 time 0.101376 [01/19/2021-17:50:35] [V] [TRT] Tactic: 19 time 0.18432 [01/19/2021-17:50:35] [V] [TRT] Tactic: 20 time 0.090112 [01/19/2021-17:50:35] [V] [TRT] Tactic: 22 time 0.096256 [01/19/2021-17:50:35] [V] [TRT] Tactic: 24 time 0.095232 [01/19/2021-17:50:35] [V] [TRT] Tactic: 27 time 0.089088 [01/19/2021-17:50:35] [V] [TRT] Tactic: 28 time 0.095232 [01/19/2021-17:50:35] [V] [TRT] Tactic: 32 time 0.079872 [01/19/2021-17:50:35] [V] [TRT] Tactic: 34 time 0.080896 [01/19/2021-17:50:35] [V] [TRT] Tactic: 35 time 0.09216 [01/19/2021-17:50:35] [V] [TRT] Tactic: 40 time 0.079872 [01/19/2021-17:50:35] [V] [TRT] Tactic: 46 time 0.093184 [01/19/2021-17:50:35] [V] [TRT] Tactic: 50 time 0.096256 [01/19/2021-17:50:35] [V] [TRT] Tactic: 51 time 0.086016 [01/19/2021-17:50:35] [V] [TRT] Tactic: 53 time 0.083968 [01/19/2021-17:50:35] [V] [TRT] Tactic: 55 time 0.088064 [01/19/2021-17:50:35] [V] [TRT] Tactic: 59 time 0.090112 [01/19/2021-17:50:35] [V] [TRT] Tactic: 61 time 0.1024 [01/19/2021-17:50:35] [V] [TRT] Tactic: 63 time 0.090112 [01/19/2021-17:50:35] [V] [TRT] Tactic: 65 time 0.090016 [01/19/2021-17:50:35] [V] [TRT] Tactic: 68 time 0.08704 [01/19/2021-17:50:35] [V] [TRT] Tactic: 75 time 0.09216 [01/19/2021-17:50:35] [V] [TRT] Tactic: 79 time 0.08704 [01/19/2021-17:50:35] [V] [TRT] Tactic: 82 time 0.100352 [01/19/2021-17:50:35] [V] [TRT] Tactic: 84 time 0.093184 [01/19/2021-17:50:35] [V] [TRT] Tactic: 85 time 0.1024 [01/19/2021-17:50:35] [V] [TRT] Tactic: 86 time 0.08192 [01/19/2021-17:50:35] [V] [TRT] Tactic: 87 time 0.137216 [01/19/2021-17:50:35] [V] [TRT] Tactic: 88 time 0.08704 [01/19/2021-17:50:35] [V] [TRT] Tactic: 91 time 0.079872 [01/19/2021-17:50:35] [V] [TRT] Tactic: 94 time 0.08704 [01/19/2021-17:50:35] [V] [TRT] Tactic: 97 time 0.088064 [01/19/2021-17:50:35] [V] [TRT] Tactic: 103 time 0.091136 [01/19/2021-17:50:35] [V] [TRT] Tactic: 105 time 0.101376 [01/19/2021-17:50:35] [V] [TRT] Tactic: 107 time 0.086016 [01/19/2021-17:50:35] [V] [TRT] Tactic: 108 time 0.091136 [01/19/2021-17:50:35] [V] [TRT] Tactic: 109 time 0.086944 [01/19/2021-17:50:35] [V] [TRT] Tactic: 112 time 0.088064 [01/19/2021-17:50:35] [V] [TRT] Tactic: 114 time 0.086016 [01/19/2021-17:50:35] [V] [TRT] Tactic: 115 time 0.093184 [01/19/2021-17:50:35] [V] [TRT] Tactic: 117 time 0.086016 [01/19/2021-17:50:35] [V] [TRT] Tactic: 118 time 0.091136 [01/19/2021-17:50:35] [V] [TRT] Tactic: 124 time 0.099328 [01/19/2021-17:50:35] [V] [TRT] Tactic: 126 time 0.09216 [01/19/2021-17:50:35] [V] [TRT] Tactic: 131 time 0.093184 [01/19/2021-17:50:35] [V] [TRT] Tactic: 132 time 0.091136 [01/19/2021-17:50:35] [V] [TRT] Tactic: 150 time 0.089088 [01/19/2021-17:50:35] [V] [TRT] Tactic: 155 time 0.080896 [01/19/2021-17:50:35] [V] [TRT] Tactic: 160 time 0.079872 [01/19/2021-17:50:35] [V] [TRT] Tactic: 163 time 0.084992 [01/19/2021-17:50:35] [V] [TRT] Tactic: 166 time 0.093184 [01/19/2021-17:50:35] [V] [TRT] Fastest Tactic: 32 Time: 0.079872 [01/19/2021-17:50:35] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Relu6 (CaskConvolution) [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: 1062367460111450758 time 0.029696 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: 4501471010995462441 time 0.036864 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: 5137655947464784826 time 0.033792 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: 5326823351883942011 time 0.036864 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: 6645123197870846056 time 0.033792 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: -6576203419454146580 time 0.029696 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: -3456450830548107839 time 0.029696 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: -410470605513481746 time 0.036864 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: -37215280111360163 time 0.033792 [01/19/2021-17:50:35] [V] [TRT] Fastest Tactic: 1062367460111450758 Time: 0.029696 [01/19/2021-17:50:35] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Relu6 (CudaConvolution) [01/19/2021-17:50:35] [V] [TRT] Tactic: 0 time 0.11776 [01/19/2021-17:50:35] [V] [TRT] Tactic: 1 time 0.109568 [01/19/2021-17:50:35] [V] [TRT] Tactic: 2 time 0.131072 [01/19/2021-17:50:35] [V] [TRT] Tactic: 4 skipped. Scratch requested: 463650816, available: 16777216 [01/19/2021-17:50:35] [V] [TRT] Tactic: 5 time 0.223232 [01/19/2021-17:50:35] [V] [TRT] Fastest Tactic: 1 Time: 0.109568 [01/19/2021-17:50:35] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:35] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1062367460111450758 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:35] [V] [TRT] [01/19/2021-17:50:35] [V] [TRT] *************** Autotuning format combination: Float(1,75,5625,810000) -> Float(1,38,1444,207936) *************** [01/19/2021-17:50:35] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:35] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:35] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:35] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:35] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/Relu6 (CaskConvolution) [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: 1062367460111450758 time 1.1049 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: 4337000649858996379 time 1.0167 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: 4501471010995462441 time 1.06701 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: 5137655947464784826 time 0.984064 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: 6645123197870846056 time 0.9984 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: -9137461792520977713 time 1.06394 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: -6092040395344634144 time 1.13459 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: -3456450830548107839 time 1.0455 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: -410470605513481746 time 1.06272 [01/19/2021-17:50:35] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.984064 [01/19/2021-17:50:35] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/Relu6 (CudaConvolution) [01/19/2021-17:50:35] [V] [TRT] Tactic: 0 time 0.048128 [01/19/2021-17:50:35] [V] [TRT] Tactic: 1 time 0.768 [01/19/2021-17:50:35] [V] [TRT] Tactic: 2 time 1.35859 [01/19/2021-17:50:35] [V] [TRT] Tactic: 5 time 23.9073 [01/19/2021-17:50:35] [V] [TRT] Fastest Tactic: 0 Time: 0.048128 [01/19/2021-17:50:35] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:35] [V] [TRT] Tactic: -1 time 0.037888 [01/19/2021-17:50:35] [V] [TRT] Fastest Tactic: -1 Time: 0.037888 [01/19/2021-17:50:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [01/19/2021-17:50:35] [V] [TRT] [01/19/2021-17:50:35] [V] [TRT] *************** Autotuning format combination: Float(1,38,1444,207936) -> Float(1,38,1444,46208) *************** [01/19/2021-17:50:35] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_3/project/Conv2D (LegacySASSConvolution) [01/19/2021-17:50:35] [V] [TRT] Tactic: 0 time 0.017408 [01/19/2021-17:50:35] [V] [TRT] Fastest Tactic: 0 Time: 0.017408 [01/19/2021-17:50:35] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_3/project/Conv2D (FusedConvActConvolution) [01/19/2021-17:50:35] [V] [TRT] Tactic: 8 time 0.034816 [01/19/2021-17:50:35] [V] [TRT] Tactic: 9 time 0.029696 [01/19/2021-17:50:35] [V] [TRT] Tactic: 11 time 0.016384 [01/19/2021-17:50:35] [V] [TRT] Tactic: 12 time 0.0256 [01/19/2021-17:50:35] [V] [TRT] Tactic: 17 time 0.018432 [01/19/2021-17:50:35] [V] [TRT] Tactic: 19 time 0.04096 [01/19/2021-17:50:35] [V] [TRT] Tactic: 20 time 0.0256 [01/19/2021-17:50:35] [V] [TRT] Tactic: 21 time 0.022528 [01/19/2021-17:50:35] [V] [TRT] Tactic: 22 time 0.028672 [01/19/2021-17:50:35] [V] [TRT] Tactic: 24 time 0.014336 [01/19/2021-17:50:35] [V] [TRT] Tactic: 27 time 0.016384 [01/19/2021-17:50:35] [V] [TRT] Tactic: 28 time 0.028608 [01/19/2021-17:50:35] [V] [TRT] Tactic: 32 time 0.026624 [01/19/2021-17:50:35] [V] [TRT] Tactic: 34 time 0.0256 [01/19/2021-17:50:35] [V] [TRT] Tactic: 35 time 0.019456 [01/19/2021-17:50:35] [V] [TRT] Tactic: 40 time 0.024576 [01/19/2021-17:50:35] [V] [TRT] Tactic: 46 time 0.026624 [01/19/2021-17:50:35] [V] [TRT] Tactic: 50 time 0.028672 [01/19/2021-17:50:35] [V] [TRT] Tactic: 51 time 0.02048 [01/19/2021-17:50:35] [V] [TRT] Tactic: 53 time 0.017408 [01/19/2021-17:50:35] [V] [TRT] Tactic: 55 time 0.043008 [01/19/2021-17:50:35] [V] [TRT] Tactic: 59 time 0.026624 [01/19/2021-17:50:35] [V] [TRT] Tactic: 60 time 0.014336 [01/19/2021-17:50:35] [V] [TRT] Tactic: 61 time 0.026624 [01/19/2021-17:50:35] [V] [TRT] Tactic: 63 time 0.01536 [01/19/2021-17:50:35] [V] [TRT] Tactic: 65 time 0.01536 [01/19/2021-17:50:35] [V] [TRT] Tactic: 68 time 0.024576 [01/19/2021-17:50:35] [V] [TRT] Tactic: 69 time 0.01536 [01/19/2021-17:50:35] [V] [TRT] Tactic: 70 time 0.02048 [01/19/2021-17:50:35] [V] [TRT] Tactic: 74 time 0.013312 [01/19/2021-17:50:35] [V] [TRT] Tactic: 75 time 0.019456 [01/19/2021-17:50:35] [V] [TRT] Tactic: 78 time 0.019456 [01/19/2021-17:50:35] [V] [TRT] Tactic: 79 time 0.019456 [01/19/2021-17:50:35] [V] [TRT] Tactic: 81 time 0.022528 [01/19/2021-17:50:35] [V] [TRT] Tactic: 82 time 0.018432 [01/19/2021-17:50:35] [V] [TRT] Tactic: 84 time 0.027648 [01/19/2021-17:50:35] [V] [TRT] Tactic: 85 time 0.026624 [01/19/2021-17:50:35] [V] [TRT] Tactic: 86 time 0.024576 [01/19/2021-17:50:35] [V] [TRT] Tactic: 87 time 0.029696 [01/19/2021-17:50:35] [V] [TRT] Tactic: 88 time 0.02048 [01/19/2021-17:50:35] [V] [TRT] Tactic: 89 time 0.017408 [01/19/2021-17:50:35] [V] [TRT] Tactic: 91 time 0.023552 [01/19/2021-17:50:35] [V] [TRT] Tactic: 94 time 0.017408 [01/19/2021-17:50:35] [V] [TRT] Tactic: 95 time 0.017408 [01/19/2021-17:50:35] [V] [TRT] Tactic: 97 time 0.0256 [01/19/2021-17:50:35] [V] [TRT] Tactic: 102 time 0.01536 [01/19/2021-17:50:35] [V] [TRT] Tactic: 103 time 0.02048 [01/19/2021-17:50:35] [V] [TRT] Tactic: 105 time 0.019456 [01/19/2021-17:50:35] [V] [TRT] Tactic: 107 time 0.016384 [01/19/2021-17:50:35] [V] [TRT] Tactic: 108 time 0.019456 [01/19/2021-17:50:35] [V] [TRT] Tactic: 109 time 0.019456 [01/19/2021-17:50:35] [V] [TRT] Tactic: 111 time 0.017408 [01/19/2021-17:50:35] [V] [TRT] Tactic: 112 time 0.02048 [01/19/2021-17:50:35] [V] [TRT] Tactic: 114 time 0.023552 [01/19/2021-17:50:35] [V] [TRT] Tactic: 115 time 0.017408 [01/19/2021-17:50:35] [V] [TRT] Tactic: 117 time 0.016384 [01/19/2021-17:50:35] [V] [TRT] Tactic: 118 time 0.016384 [01/19/2021-17:50:35] [V] [TRT] Tactic: 124 time 0.017408 [01/19/2021-17:50:35] [V] [TRT] Tactic: 125 time 0.014336 [01/19/2021-17:50:35] [V] [TRT] Tactic: 126 time 0.016352 [01/19/2021-17:50:35] [V] [TRT] Tactic: 131 time 0.017408 [01/19/2021-17:50:35] [V] [TRT] Tactic: 132 time 0.019456 [01/19/2021-17:50:35] [V] [TRT] Tactic: 145 time 0.013312 [01/19/2021-17:50:35] [V] [TRT] Tactic: 150 time 0.01536 [01/19/2021-17:50:35] [V] [TRT] Tactic: 155 time 0.024576 [01/19/2021-17:50:35] [V] [TRT] Tactic: 157 time 0.016384 [01/19/2021-17:50:35] [V] [TRT] Tactic: 160 time 0.018432 [01/19/2021-17:50:35] [V] [TRT] Tactic: 163 time 0.016384 [01/19/2021-17:50:35] [V] [TRT] Tactic: 166 time 0.019296 [01/19/2021-17:50:35] [V] [TRT] Fastest Tactic: 74 Time: 0.013312 [01/19/2021-17:50:35] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_3/project/Conv2D (CaskConvolution) [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_3/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: 1062367460111450758 time 0.02048 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_3/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: 4501471010995462441 time 0.019456 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_3/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: 5137655947464784826 time 0.01536 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_3/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: 5326823351883942011 time 0.019456 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_3/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: 6645123197870846056 time 0.016384 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_3/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: -6576203419454146580 time 0.017408 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_3/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: -3456450830548107839 time 0.017408 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_3/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: -410470605513481746 time 0.019456 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_3/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: -37215280111360163 time 0.01536 [01/19/2021-17:50:35] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.01536 [01/19/2021-17:50:35] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_3/project/Conv2D (CudaConvolution) [01/19/2021-17:50:35] [V] [TRT] Tactic: 0 time 0.02048 [01/19/2021-17:50:35] [V] [TRT] Tactic: 1 time 0.023552 [01/19/2021-17:50:35] [V] [TRT] Tactic: 2 time 0.053248 [01/19/2021-17:50:35] [V] [TRT] Tactic: 4 skipped. Scratch requested: 160677888, available: 16777216 [01/19/2021-17:50:35] [V] [TRT] Tactic: 5 time 0.065536 [01/19/2021-17:50:35] [V] [TRT] Fastest Tactic: 0 Time: 0.02048 [01/19/2021-17:50:35] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_3/project/Conv2D (CudaDepthwiseConvolution) [01/19/2021-17:50:35] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 74 [01/19/2021-17:50:35] [V] [TRT] [01/19/2021-17:50:35] [V] [TRT] *************** Autotuning format combination: Float(1,38,1444,46208) -> Float(1,38,1444,277248) *************** [01/19/2021-17:50:35] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:35] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:35] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:35] [V] [TRT] Tactic: 8 time 0.032768 [01/19/2021-17:50:35] [V] [TRT] Tactic: 9 time 0.034816 [01/19/2021-17:50:35] [V] [TRT] Tactic: 11 time 0.038912 [01/19/2021-17:50:35] [V] [TRT] Tactic: 12 time 0.036704 [01/19/2021-17:50:35] [V] [TRT] Tactic: 17 time 0.03584 [01/19/2021-17:50:35] [V] [TRT] Tactic: 19 time 0.055296 [01/19/2021-17:50:35] [V] [TRT] Tactic: 20 time 0.03072 [01/19/2021-17:50:35] [V] [TRT] Tactic: 21 time 0.038912 [01/19/2021-17:50:35] [V] [TRT] Tactic: 22 time 0.034816 [01/19/2021-17:50:35] [V] [TRT] Tactic: 24 time 0.037888 [01/19/2021-17:50:35] [V] [TRT] Tactic: 27 time 0.037888 [01/19/2021-17:50:35] [V] [TRT] Tactic: 28 time 0.037888 [01/19/2021-17:50:35] [V] [TRT] Tactic: 31 time 0.04096 [01/19/2021-17:50:35] [V] [TRT] Tactic: 32 time 0.03072 [01/19/2021-17:50:35] [V] [TRT] Tactic: 34 time 0.032768 [01/19/2021-17:50:35] [V] [TRT] Tactic: 35 time 0.03584 [01/19/2021-17:50:35] [V] [TRT] Tactic: 40 time 0.030592 [01/19/2021-17:50:35] [V] [TRT] Tactic: 46 time 0.035712 [01/19/2021-17:50:35] [V] [TRT] Tactic: 50 time 0.03584 [01/19/2021-17:50:35] [V] [TRT] Tactic: 51 time 0.033792 [01/19/2021-17:50:35] [V] [TRT] Tactic: 53 time 0.033664 [01/19/2021-17:50:35] [V] [TRT] Tactic: 55 time 0.033792 [01/19/2021-17:50:35] [V] [TRT] Tactic: 59 time 0.036864 [01/19/2021-17:50:35] [V] [TRT] Tactic: 60 time 0.037888 [01/19/2021-17:50:35] [V] [TRT] Tactic: 61 time 0.03584 [01/19/2021-17:50:35] [V] [TRT] Tactic: 63 time 0.04096 [01/19/2021-17:50:35] [V] [TRT] Tactic: 64 time 0.04096 [01/19/2021-17:50:35] [V] [TRT] Tactic: 65 time 0.036864 [01/19/2021-17:50:35] [V] [TRT] Tactic: 68 time 0.03072 [01/19/2021-17:50:35] [V] [TRT] Tactic: 69 time 0.037888 [01/19/2021-17:50:35] [V] [TRT] Tactic: 70 time 0.03584 [01/19/2021-17:50:35] [V] [TRT] Tactic: 74 time 0.036864 [01/19/2021-17:50:35] [V] [TRT] Tactic: 75 time 0.037888 [01/19/2021-17:50:35] [V] [TRT] Tactic: 78 time 0.036736 [01/19/2021-17:50:35] [V] [TRT] Tactic: 79 time 0.033792 [01/19/2021-17:50:35] [V] [TRT] Tactic: 81 time 0.036864 [01/19/2021-17:50:35] [V] [TRT] Tactic: 82 time 0.04096 [01/19/2021-17:50:35] [V] [TRT] Tactic: 84 time 0.03584 [01/19/2021-17:50:35] [V] [TRT] Tactic: 85 time 0.03584 [01/19/2021-17:50:35] [V] [TRT] Tactic: 86 time 0.03072 [01/19/2021-17:50:35] [V] [TRT] Tactic: 87 time 0.047104 [01/19/2021-17:50:35] [V] [TRT] Tactic: 88 time 0.033792 [01/19/2021-17:50:35] [V] [TRT] Tactic: 89 time 0.032768 [01/19/2021-17:50:35] [V] [TRT] Tactic: 91 time 0.03072 [01/19/2021-17:50:35] [V] [TRT] Tactic: 94 time 0.032768 [01/19/2021-17:50:35] [V] [TRT] Tactic: 95 time 0.036832 [01/19/2021-17:50:35] [V] [TRT] Tactic: 97 time 0.033792 [01/19/2021-17:50:35] [V] [TRT] Tactic: 102 time 0.036864 [01/19/2021-17:50:35] [V] [TRT] Tactic: 103 time 0.034816 [01/19/2021-17:50:35] [V] [TRT] Tactic: 105 time 0.04096 [01/19/2021-17:50:35] [V] [TRT] Tactic: 106 time 0.04096 [01/19/2021-17:50:35] [V] [TRT] Tactic: 107 time 0.031744 [01/19/2021-17:50:35] [V] [TRT] Tactic: 108 time 0.038912 [01/19/2021-17:50:35] [V] [TRT] Tactic: 109 time 0.033792 [01/19/2021-17:50:35] [V] [TRT] Tactic: 111 time 0.033792 [01/19/2021-17:50:35] [V] [TRT] Tactic: 112 time 0.033792 [01/19/2021-17:50:35] [V] [TRT] Tactic: 114 time 0.03584 [01/19/2021-17:50:35] [V] [TRT] Tactic: 115 time 0.037888 [01/19/2021-17:50:35] [V] [TRT] Tactic: 117 time 0.032768 [01/19/2021-17:50:35] [V] [TRT] Tactic: 118 time 0.038784 [01/19/2021-17:50:35] [V] [TRT] Tactic: 124 time 0.038912 [01/19/2021-17:50:35] [V] [TRT] Tactic: 125 time 0.036864 [01/19/2021-17:50:35] [V] [TRT] Tactic: 126 time 0.036864 [01/19/2021-17:50:35] [V] [TRT] Tactic: 131 time 0.038912 [01/19/2021-17:50:35] [V] [TRT] Tactic: 132 time 0.034816 [01/19/2021-17:50:35] [V] [TRT] Tactic: 138 time 0.04096 [01/19/2021-17:50:35] [V] [TRT] Tactic: 145 time 0.037888 [01/19/2021-17:50:35] [V] [TRT] Tactic: 150 time 0.039936 [01/19/2021-17:50:35] [V] [TRT] Tactic: 155 time 0.03072 [01/19/2021-17:50:35] [V] [TRT] Tactic: 157 time 0.037888 [01/19/2021-17:50:35] [V] [TRT] Tactic: 160 time 0.03584 [01/19/2021-17:50:35] [V] [TRT] Tactic: 163 time 0.032768 [01/19/2021-17:50:35] [V] [TRT] Tactic: 166 time 0.037888 [01/19/2021-17:50:35] [V] [TRT] Fastest Tactic: 40 Time: 0.030592 [01/19/2021-17:50:35] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Relu6 (CaskConvolution) [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: 1062367460111450758 time 0.013312 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: 4501471010995462441 time 0.014336 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: 5137655947464784826 time 0.013312 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: 5326823351883942011 time 0.014336 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: 6645123197870846056 time 0.013312 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: -6576203419454146580 time 0.013312 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: -3456450830548107839 time 0.013312 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: -410470605513481746 time 0.014336 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: -37215280111360163 time 0.012224 [01/19/2021-17:50:35] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.012224 [01/19/2021-17:50:35] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Relu6 (CudaConvolution) [01/19/2021-17:50:35] [V] [TRT] Tactic: 0 time 0.037888 [01/19/2021-17:50:35] [V] [TRT] Tactic: 1 time 0.03072 [01/19/2021-17:50:35] [V] [TRT] Tactic: 2 time 0.04608 [01/19/2021-17:50:35] [V] [TRT] Tactic: 4 skipped. Scratch requested: 208797696, available: 16777216 [01/19/2021-17:50:35] [V] [TRT] Tactic: 5 time 0.09728 [01/19/2021-17:50:35] [V] [TRT] Fastest Tactic: 1 Time: 0.03072 [01/19/2021-17:50:35] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:35] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:35] [V] [TRT] [01/19/2021-17:50:35] [V] [TRT] *************** Autotuning format combination: Float(1,38,1444,277248) -> Float(1,38,1444,277248) *************** [01/19/2021-17:50:35] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:35] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:35] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:35] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:35] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/Relu6 (CaskConvolution) [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: 1062367460111450758 time 1.44998 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: 4337000649858996379 time 1.34758 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: 4501471010995462441 time 1.39757 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: 5137655947464784826 time 1.31277 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: 6645123197870846056 time 1.32096 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: -9137461792520977713 time 1.4121 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: -6092040395344634144 time 1.49197 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: -3456450830548107839 time 1.36282 [01/19/2021-17:50:35] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:35] [V] [TRT] Tactic: -410470605513481746 time 1.40288 [01/19/2021-17:50:35] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 1.31277 [01/19/2021-17:50:35] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/Relu6 (CudaConvolution) [01/19/2021-17:50:35] [V] [TRT] Tactic: 0 time 0.03584 [01/19/2021-17:50:35] [V] [TRT] Tactic: 1 time 0.960512 [01/19/2021-17:50:35] [V] [TRT] Tactic: 2 time 1.86656 [01/19/2021-17:50:35] [V] [TRT] Tactic: 4 time 10.9302 [01/19/2021-17:50:36] [V] [TRT] Tactic: 5 time 14.2724 [01/19/2021-17:50:36] [V] [TRT] Tactic: 6 time 1.32506 [01/19/2021-17:50:36] [V] [TRT] Fastest Tactic: 0 Time: 0.03584 [01/19/2021-17:50:36] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:36] [V] [TRT] Tactic: -1 time 0.02048 [01/19/2021-17:50:36] [V] [TRT] Fastest Tactic: -1 Time: 0.02048 [01/19/2021-17:50:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [01/19/2021-17:50:36] [V] [TRT] [01/19/2021-17:50:36] [V] [TRT] *************** Autotuning format combination: Float(1,38,1444,277248), Float(1,38,1444,46208) -> Float(1,38,1444,46208) *************** [01/19/2021-17:50:36] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_4/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_4/add (LegacySASSConvolution) [01/19/2021-17:50:36] [V] [TRT] Tactic: 0 time 0.021504 [01/19/2021-17:50:36] [V] [TRT] Fastest Tactic: 0 Time: 0.021504 [01/19/2021-17:50:36] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_4/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_4/add (CaskConvolution) [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_4/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_4/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: 1062367460111450758 time 0.024576 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_4/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_4/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: 4501471010995462441 time 0.024576 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_4/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_4/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: 5137655947464784826 time 0.018432 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_4/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_4/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: 5326823351883942011 time 0.023552 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_4/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_4/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: 6645123197870846056 time 0.019456 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_4/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_4/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: -6576203419454146580 time 0.02048 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_4/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_4/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: -3456450830548107839 time 0.021504 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_4/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_4/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: -410470605513481746 time 0.023552 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_4/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_4/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: -37215280111360163 time 0.018432 [01/19/2021-17:50:36] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.018432 [01/19/2021-17:50:36] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_4/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_4/add (CudaConvolution) [01/19/2021-17:50:36] [V] [TRT] Tactic: 0 time 0.026624 [01/19/2021-17:50:36] [V] [TRT] Tactic: 1 time 0.028672 [01/19/2021-17:50:36] [V] [TRT] Tactic: 2 time 0.091136 [01/19/2021-17:50:36] [V] [TRT] Tactic: 4 skipped. Scratch requested: 214204416, available: 16777216 [01/19/2021-17:50:36] [V] [TRT] Tactic: 5 time 0.089088 [01/19/2021-17:50:36] [V] [TRT] Fastest Tactic: 0 Time: 0.026624 [01/19/2021-17:50:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5137655947464784826 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_4/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_4/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:36] [V] [TRT] [01/19/2021-17:50:36] [V] [TRT] *************** Autotuning format combination: Float(1,38,1444,46208) -> Float(1,38,1444,277248) *************** [01/19/2021-17:50:36] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:36] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:36] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:36] [V] [TRT] Tactic: 8 time 0.032768 [01/19/2021-17:50:36] [V] [TRT] Tactic: 9 time 0.03584 [01/19/2021-17:50:36] [V] [TRT] Tactic: 11 time 0.038912 [01/19/2021-17:50:36] [V] [TRT] Tactic: 12 time 0.036864 [01/19/2021-17:50:36] [V] [TRT] Tactic: 17 time 0.03584 [01/19/2021-17:50:36] [V] [TRT] Tactic: 19 time 0.055296 [01/19/2021-17:50:36] [V] [TRT] Tactic: 20 time 0.03072 [01/19/2021-17:50:36] [V] [TRT] Tactic: 21 time 0.038912 [01/19/2021-17:50:36] [V] [TRT] Tactic: 22 time 0.03584 [01/19/2021-17:50:36] [V] [TRT] Tactic: 24 time 0.037888 [01/19/2021-17:50:36] [V] [TRT] Tactic: 27 time 0.037888 [01/19/2021-17:50:36] [V] [TRT] Tactic: 28 time 0.039936 [01/19/2021-17:50:36] [V] [TRT] Tactic: 31 time 0.04096 [01/19/2021-17:50:36] [V] [TRT] Tactic: 32 time 0.03072 [01/19/2021-17:50:36] [V] [TRT] Tactic: 34 time 0.032768 [01/19/2021-17:50:36] [V] [TRT] Tactic: 35 time 0.03584 [01/19/2021-17:50:36] [V] [TRT] Tactic: 40 time 0.03072 [01/19/2021-17:50:36] [V] [TRT] Tactic: 46 time 0.03584 [01/19/2021-17:50:36] [V] [TRT] Tactic: 50 time 0.03584 [01/19/2021-17:50:36] [V] [TRT] Tactic: 51 time 0.033792 [01/19/2021-17:50:36] [V] [TRT] Tactic: 53 time 0.032768 [01/19/2021-17:50:36] [V] [TRT] Tactic: 55 time 0.033792 [01/19/2021-17:50:36] [V] [TRT] Tactic: 59 time 0.034816 [01/19/2021-17:50:36] [V] [TRT] Tactic: 60 time 0.037888 [01/19/2021-17:50:36] [V] [TRT] Tactic: 61 time 0.036864 [01/19/2021-17:50:36] [V] [TRT] Tactic: 63 time 0.04096 [01/19/2021-17:50:36] [V] [TRT] Tactic: 64 time 0.04096 [01/19/2021-17:50:36] [V] [TRT] Tactic: 65 time 0.03584 [01/19/2021-17:50:36] [V] [TRT] Tactic: 68 time 0.03072 [01/19/2021-17:50:36] [V] [TRT] Tactic: 69 time 0.036864 [01/19/2021-17:50:36] [V] [TRT] Tactic: 70 time 0.03584 [01/19/2021-17:50:36] [V] [TRT] Tactic: 74 time 0.037888 [01/19/2021-17:50:36] [V] [TRT] Tactic: 75 time 0.037888 [01/19/2021-17:50:36] [V] [TRT] Tactic: 78 time 0.036864 [01/19/2021-17:50:36] [V] [TRT] Tactic: 79 time 0.033792 [01/19/2021-17:50:36] [V] [TRT] Tactic: 81 time 0.036864 [01/19/2021-17:50:36] [V] [TRT] Tactic: 82 time 0.041984 [01/19/2021-17:50:36] [V] [TRT] Tactic: 84 time 0.034816 [01/19/2021-17:50:36] [V] [TRT] Tactic: 85 time 0.03584 [01/19/2021-17:50:36] [V] [TRT] Tactic: 86 time 0.031744 [01/19/2021-17:50:36] [V] [TRT] Tactic: 87 time 0.047104 [01/19/2021-17:50:36] [V] [TRT] Tactic: 88 time 0.033792 [01/19/2021-17:50:36] [V] [TRT] Tactic: 89 time 0.033792 [01/19/2021-17:50:36] [V] [TRT] Tactic: 91 time 0.03072 [01/19/2021-17:50:36] [V] [TRT] Tactic: 94 time 0.032768 [01/19/2021-17:50:36] [V] [TRT] Tactic: 95 time 0.036864 [01/19/2021-17:50:36] [V] [TRT] Tactic: 97 time 0.034816 [01/19/2021-17:50:36] [V] [TRT] Tactic: 102 time 0.036864 [01/19/2021-17:50:36] [V] [TRT] Tactic: 103 time 0.033792 [01/19/2021-17:50:36] [V] [TRT] Tactic: 105 time 0.041952 [01/19/2021-17:50:36] [V] [TRT] Tactic: 106 time 0.04096 [01/19/2021-17:50:36] [V] [TRT] Tactic: 107 time 0.032768 [01/19/2021-17:50:36] [V] [TRT] Tactic: 108 time 0.037888 [01/19/2021-17:50:36] [V] [TRT] Tactic: 109 time 0.033792 [01/19/2021-17:50:36] [V] [TRT] Tactic: 111 time 0.033792 [01/19/2021-17:50:36] [V] [TRT] Tactic: 112 time 0.033792 [01/19/2021-17:50:36] [V] [TRT] Tactic: 114 time 0.034816 [01/19/2021-17:50:36] [V] [TRT] Tactic: 115 time 0.037888 [01/19/2021-17:50:36] [V] [TRT] Tactic: 117 time 0.032768 [01/19/2021-17:50:36] [V] [TRT] Tactic: 118 time 0.038912 [01/19/2021-17:50:36] [V] [TRT] Tactic: 124 time 0.037888 [01/19/2021-17:50:36] [V] [TRT] Tactic: 125 time 0.036864 [01/19/2021-17:50:36] [V] [TRT] Tactic: 126 time 0.037888 [01/19/2021-17:50:36] [V] [TRT] Tactic: 131 time 0.038912 [01/19/2021-17:50:36] [V] [TRT] Tactic: 132 time 0.034816 [01/19/2021-17:50:36] [V] [TRT] Tactic: 138 time 0.04096 [01/19/2021-17:50:36] [V] [TRT] Tactic: 145 time 0.037888 [01/19/2021-17:50:36] [V] [TRT] Tactic: 150 time 0.038912 [01/19/2021-17:50:36] [V] [TRT] Tactic: 155 time 0.03072 [01/19/2021-17:50:36] [V] [TRT] Tactic: 157 time 0.037888 [01/19/2021-17:50:36] [V] [TRT] Tactic: 160 time 0.03584 [01/19/2021-17:50:36] [V] [TRT] Tactic: 163 time 0.032768 [01/19/2021-17:50:36] [V] [TRT] Tactic: 166 time 0.037888 [01/19/2021-17:50:36] [V] [TRT] Fastest Tactic: 20 Time: 0.03072 [01/19/2021-17:50:36] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Relu6 (CaskConvolution) [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: 1062367460111450758 time 0.013312 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: 4501471010995462441 time 0.014336 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: 5137655947464784826 time 0.012288 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: 5326823351883942011 time 0.014336 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: 6645123197870846056 time 0.013312 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: -6576203419454146580 time 0.013312 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: -3456450830548107839 time 0.013312 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: -410470605513481746 time 0.014336 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: -37215280111360163 time 0.012288 [01/19/2021-17:50:36] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.012288 [01/19/2021-17:50:36] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Relu6 (CudaConvolution) [01/19/2021-17:50:36] [V] [TRT] Tactic: 0 time 0.037888 [01/19/2021-17:50:36] [V] [TRT] Tactic: 1 time 0.03072 [01/19/2021-17:50:36] [V] [TRT] Tactic: 2 time 0.04608 [01/19/2021-17:50:36] [V] [TRT] Tactic: 4 skipped. Scratch requested: 208797696, available: 16777216 [01/19/2021-17:50:36] [V] [TRT] Tactic: 5 time 0.09728 [01/19/2021-17:50:36] [V] [TRT] Fastest Tactic: 1 Time: 0.03072 [01/19/2021-17:50:36] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:36] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5137655947464784826 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:36] [V] [TRT] [01/19/2021-17:50:36] [V] [TRT] *************** Autotuning format combination: Float(1,38,1444,277248) -> Float(1,38,1444,277248) *************** [01/19/2021-17:50:36] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:36] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:36] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:36] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:36] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/Relu6 (CaskConvolution) [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: 1062367460111450758 time 1.45408 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: 4337000649858996379 time 1.34758 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: 4501471010995462441 time 1.39763 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: 5137655947464784826 time 1.30547 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: 6645123197870846056 time 1.32915 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: -9137461792520977713 time 1.408 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: -6092040395344634144 time 1.49504 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: -3456450830548107839 time 1.37011 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: -410470605513481746 time 1.40486 [01/19/2021-17:50:36] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 1.30547 [01/19/2021-17:50:36] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/Relu6 (CudaConvolution) [01/19/2021-17:50:36] [V] [TRT] Tactic: 0 time 0.03584 [01/19/2021-17:50:36] [V] [TRT] Tactic: 1 time 0.969728 [01/19/2021-17:50:36] [V] [TRT] Tactic: 2 time 1.84115 [01/19/2021-17:50:36] [V] [TRT] Tactic: 4 time 10.9322 [01/19/2021-17:50:36] [V] [TRT] Tactic: 5 time 14.434 [01/19/2021-17:50:36] [V] [TRT] Tactic: 6 time 1.7623 [01/19/2021-17:50:36] [V] [TRT] Fastest Tactic: 0 Time: 0.03584 [01/19/2021-17:50:36] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:36] [V] [TRT] Tactic: -1 time 0.02048 [01/19/2021-17:50:36] [V] [TRT] Fastest Tactic: -1 Time: 0.02048 [01/19/2021-17:50:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [01/19/2021-17:50:36] [V] [TRT] [01/19/2021-17:50:36] [V] [TRT] *************** Autotuning format combination: Float(1,38,1444,277248), Float(1,38,1444,46208) -> Float(1,38,1444,46208) *************** [01/19/2021-17:50:36] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_5/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_5/add (LegacySASSConvolution) [01/19/2021-17:50:36] [V] [TRT] Tactic: 0 time 0.022528 [01/19/2021-17:50:36] [V] [TRT] Fastest Tactic: 0 Time: 0.022528 [01/19/2021-17:50:36] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_5/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_5/add (CaskConvolution) [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_5/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_5/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: 1062367460111450758 time 0.024576 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_5/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_5/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: 4501471010995462441 time 0.024576 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_5/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_5/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: 5137655947464784826 time 0.018432 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_5/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_5/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: 5326823351883942011 time 0.023552 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_5/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_5/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: 6645123197870846056 time 0.019456 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_5/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_5/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: -6576203419454146580 time 0.02048 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_5/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_5/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: -3456450830548107839 time 0.021504 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_5/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_5/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: -410470605513481746 time 0.023552 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_5/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_5/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: -37215280111360163 time 0.027648 [01/19/2021-17:50:36] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.018432 [01/19/2021-17:50:36] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_5/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_5/add (CudaConvolution) [01/19/2021-17:50:36] [V] [TRT] Tactic: 0 time 0.0256 [01/19/2021-17:50:36] [V] [TRT] Tactic: 1 time 0.028672 [01/19/2021-17:50:36] [V] [TRT] Tactic: 2 time 0.091136 [01/19/2021-17:50:36] [V] [TRT] Tactic: 4 skipped. Scratch requested: 214204416, available: 16777216 [01/19/2021-17:50:36] [V] [TRT] Tactic: 5 time 0.090112 [01/19/2021-17:50:36] [V] [TRT] Fastest Tactic: 0 Time: 0.0256 [01/19/2021-17:50:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5137655947464784826 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_5/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_5/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:36] [V] [TRT] [01/19/2021-17:50:36] [V] [TRT] *************** Autotuning format combination: Float(1,38,1444,46208) -> Float(1,38,1444,277248) *************** [01/19/2021-17:50:36] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:36] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:36] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:36] [V] [TRT] Tactic: 8 time 0.032768 [01/19/2021-17:50:36] [V] [TRT] Tactic: 9 time 0.03568 [01/19/2021-17:50:36] [V] [TRT] Tactic: 11 time 0.039936 [01/19/2021-17:50:36] [V] [TRT] Tactic: 12 time 0.036864 [01/19/2021-17:50:36] [V] [TRT] Tactic: 17 time 0.036864 [01/19/2021-17:50:36] [V] [TRT] Tactic: 19 time 0.055296 [01/19/2021-17:50:36] [V] [TRT] Tactic: 20 time 0.03072 [01/19/2021-17:50:36] [V] [TRT] Tactic: 21 time 0.038912 [01/19/2021-17:50:36] [V] [TRT] Tactic: 22 time 0.03584 [01/19/2021-17:50:36] [V] [TRT] Tactic: 24 time 0.037888 [01/19/2021-17:50:36] [V] [TRT] Tactic: 27 time 0.037888 [01/19/2021-17:50:36] [V] [TRT] Tactic: 28 time 0.038912 [01/19/2021-17:50:36] [V] [TRT] Tactic: 31 time 0.04096 [01/19/2021-17:50:36] [V] [TRT] Tactic: 32 time 0.03072 [01/19/2021-17:50:36] [V] [TRT] Tactic: 34 time 0.032768 [01/19/2021-17:50:36] [V] [TRT] Tactic: 35 time 0.03584 [01/19/2021-17:50:36] [V] [TRT] Tactic: 40 time 0.030592 [01/19/2021-17:50:36] [V] [TRT] Tactic: 46 time 0.03584 [01/19/2021-17:50:36] [V] [TRT] Tactic: 50 time 0.03584 [01/19/2021-17:50:36] [V] [TRT] Tactic: 51 time 0.033792 [01/19/2021-17:50:36] [V] [TRT] Tactic: 53 time 0.033792 [01/19/2021-17:50:36] [V] [TRT] Tactic: 55 time 0.033792 [01/19/2021-17:50:36] [V] [TRT] Tactic: 59 time 0.03584 [01/19/2021-17:50:36] [V] [TRT] Tactic: 60 time 0.037888 [01/19/2021-17:50:36] [V] [TRT] Tactic: 61 time 0.03584 [01/19/2021-17:50:36] [V] [TRT] Tactic: 63 time 0.039936 [01/19/2021-17:50:36] [V] [TRT] Tactic: 64 time 0.04096 [01/19/2021-17:50:36] [V] [TRT] Tactic: 65 time 0.03584 [01/19/2021-17:50:36] [V] [TRT] Tactic: 68 time 0.03072 [01/19/2021-17:50:36] [V] [TRT] Tactic: 69 time 0.036864 [01/19/2021-17:50:36] [V] [TRT] Tactic: 70 time 0.03584 [01/19/2021-17:50:36] [V] [TRT] Tactic: 74 time 0.037888 [01/19/2021-17:50:36] [V] [TRT] Tactic: 75 time 0.036864 [01/19/2021-17:50:36] [V] [TRT] Tactic: 78 time 0.036704 [01/19/2021-17:50:36] [V] [TRT] Tactic: 79 time 0.033792 [01/19/2021-17:50:36] [V] [TRT] Tactic: 81 time 0.036864 [01/19/2021-17:50:36] [V] [TRT] Tactic: 82 time 0.041984 [01/19/2021-17:50:36] [V] [TRT] Tactic: 84 time 0.03584 [01/19/2021-17:50:36] [V] [TRT] Tactic: 85 time 0.03584 [01/19/2021-17:50:36] [V] [TRT] Tactic: 86 time 0.031744 [01/19/2021-17:50:36] [V] [TRT] Tactic: 87 time 0.047104 [01/19/2021-17:50:36] [V] [TRT] Tactic: 88 time 0.033792 [01/19/2021-17:50:36] [V] [TRT] Tactic: 89 time 0.032768 [01/19/2021-17:50:36] [V] [TRT] Tactic: 91 time 0.03072 [01/19/2021-17:50:36] [V] [TRT] Tactic: 94 time 0.033792 [01/19/2021-17:50:36] [V] [TRT] Tactic: 95 time 0.036864 [01/19/2021-17:50:36] [V] [TRT] Tactic: 97 time 0.033792 [01/19/2021-17:50:36] [V] [TRT] Tactic: 102 time 0.036864 [01/19/2021-17:50:36] [V] [TRT] Tactic: 103 time 0.034816 [01/19/2021-17:50:36] [V] [TRT] Tactic: 105 time 0.04096 [01/19/2021-17:50:36] [V] [TRT] Tactic: 106 time 0.04096 [01/19/2021-17:50:36] [V] [TRT] Tactic: 107 time 0.032768 [01/19/2021-17:50:36] [V] [TRT] Tactic: 108 time 0.037888 [01/19/2021-17:50:36] [V] [TRT] Tactic: 109 time 0.033792 [01/19/2021-17:50:36] [V] [TRT] Tactic: 111 time 0.033792 [01/19/2021-17:50:36] [V] [TRT] Tactic: 112 time 0.033792 [01/19/2021-17:50:36] [V] [TRT] Tactic: 114 time 0.03584 [01/19/2021-17:50:36] [V] [TRT] Tactic: 115 time 0.037888 [01/19/2021-17:50:36] [V] [TRT] Tactic: 117 time 0.032768 [01/19/2021-17:50:36] [V] [TRT] Tactic: 118 time 0.038912 [01/19/2021-17:50:36] [V] [TRT] Tactic: 124 time 0.037888 [01/19/2021-17:50:36] [V] [TRT] Tactic: 125 time 0.036864 [01/19/2021-17:50:36] [V] [TRT] Tactic: 126 time 0.036864 [01/19/2021-17:50:36] [V] [TRT] Tactic: 131 time 0.038912 [01/19/2021-17:50:36] [V] [TRT] Tactic: 132 time 0.034816 [01/19/2021-17:50:36] [V] [TRT] Tactic: 138 time 0.041984 [01/19/2021-17:50:36] [V] [TRT] Tactic: 145 time 0.037888 [01/19/2021-17:50:36] [V] [TRT] Tactic: 150 time 0.04096 [01/19/2021-17:50:36] [V] [TRT] Tactic: 155 time 0.03072 [01/19/2021-17:50:36] [V] [TRT] Tactic: 157 time 0.037888 [01/19/2021-17:50:36] [V] [TRT] Tactic: 160 time 0.034816 [01/19/2021-17:50:36] [V] [TRT] Tactic: 163 time 0.032768 [01/19/2021-17:50:36] [V] [TRT] Tactic: 166 time 0.037888 [01/19/2021-17:50:36] [V] [TRT] Fastest Tactic: 40 Time: 0.030592 [01/19/2021-17:50:36] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Relu6 (CaskConvolution) [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: 1062367460111450758 time 0.014336 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: 4501471010995462441 time 0.014336 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: 5137655947464784826 time 0.013312 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: 5326823351883942011 time 0.014336 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: 6645123197870846056 time 0.013312 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: -6576203419454146580 time 0.013312 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: -3456450830548107839 time 0.013312 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: -410470605513481746 time 0.014336 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: -37215280111360163 time 0.012288 [01/19/2021-17:50:36] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.012288 [01/19/2021-17:50:36] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Relu6 (CudaConvolution) [01/19/2021-17:50:36] [V] [TRT] Tactic: 0 time 0.037888 [01/19/2021-17:50:36] [V] [TRT] Tactic: 1 time 0.03072 [01/19/2021-17:50:36] [V] [TRT] Tactic: 2 time 0.04608 [01/19/2021-17:50:36] [V] [TRT] Tactic: 4 skipped. Scratch requested: 208797696, available: 16777216 [01/19/2021-17:50:36] [V] [TRT] Tactic: 5 time 0.096192 [01/19/2021-17:50:36] [V] [TRT] Fastest Tactic: 1 Time: 0.03072 [01/19/2021-17:50:36] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:36] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:36] [V] [TRT] [01/19/2021-17:50:36] [V] [TRT] *************** Autotuning format combination: Float(1,38,1444,277248) -> Float(1,19,361,69312) *************** [01/19/2021-17:50:36] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:36] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:36] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:36] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:36] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/Relu6 (CaskConvolution) [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: 1062367460111450758 time 1.45203 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: 4337000649858996379 time 1.31277 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: 4501471010995462441 time 1.35475 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: 5137655947464784826 time 1.25747 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: 6645123197870846056 time 1.28205 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: -9137461792520977713 time 1.36909 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: -6092040395344634144 time 1.49709 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: -3456450830548107839 time 1.37114 [01/19/2021-17:50:36] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:36] [V] [TRT] Tactic: -410470605513481746 time 1.35885 [01/19/2021-17:50:36] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 1.25747 [01/19/2021-17:50:36] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/Relu6 (CudaConvolution) [01/19/2021-17:50:36] [V] [TRT] Tactic: 0 time 0.03072 [01/19/2021-17:50:36] [V] [TRT] Tactic: 1 time 1.00147 [01/19/2021-17:50:36] [V] [TRT] Tactic: 2 time 1.84013 [01/19/2021-17:50:36] [V] [TRT] Tactic: 5 time 14.252 [01/19/2021-17:50:36] [V] [TRT] Fastest Tactic: 0 Time: 0.03072 [01/19/2021-17:50:36] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:36] [V] [TRT] Tactic: -1 time 0.01024 [01/19/2021-17:50:36] [V] [TRT] Fastest Tactic: -1 Time: 0.01024 [01/19/2021-17:50:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [01/19/2021-17:50:36] [V] [TRT] [01/19/2021-17:50:36] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,69312) -> Float(1,19,361,23104) *************** [01/19/2021-17:50:36] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_6/project/Conv2D (LegacySASSConvolution) [01/19/2021-17:50:36] [V] [TRT] Tactic: 0 time 0.0256 [01/19/2021-17:50:36] [V] [TRT] Fastest Tactic: 0 Time: 0.0256 [01/19/2021-17:50:36] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_6/project/Conv2D (FusedConvActConvolution) [01/19/2021-17:50:36] [V] [TRT] Tactic: 8 time 0.043008 [01/19/2021-17:50:36] [V] [TRT] Tactic: 9 time 0.028672 [01/19/2021-17:50:36] [V] [TRT] Tactic: 11 time 0.01536 [01/19/2021-17:50:36] [V] [TRT] Tactic: 12 time 0.014336 [01/19/2021-17:50:36] [V] [TRT] Tactic: 17 time 0.01024 [01/19/2021-17:50:36] [V] [TRT] Tactic: 19 time 0.050176 [01/19/2021-17:50:36] [V] [TRT] Tactic: 20 time 0.03072 [01/19/2021-17:50:36] [V] [TRT] Tactic: 21 time 0.01024 [01/19/2021-17:50:36] [V] [TRT] Tactic: 22 time 0.018272 [01/19/2021-17:50:36] [V] [TRT] Tactic: 24 time 0.011264 [01/19/2021-17:50:36] [V] [TRT] Tactic: 27 time 0.014336 [01/19/2021-17:50:36] [V] [TRT] Tactic: 28 time 0.031744 [01/19/2021-17:50:36] [V] [TRT] Tactic: 31 time 0.01024 [01/19/2021-17:50:36] [V] [TRT] Tactic: 32 time 0.03072 [01/19/2021-17:50:36] [V] [TRT] Tactic: 34 time 0.028672 [01/19/2021-17:50:36] [V] [TRT] Tactic: 35 time 0.02048 [01/19/2021-17:50:36] [V] [TRT] Tactic: 40 time 0.028672 [01/19/2021-17:50:36] [V] [TRT] Tactic: 46 time 0.019456 [01/19/2021-17:50:36] [V] [TRT] Tactic: 50 time 0.019456 [01/19/2021-17:50:36] [V] [TRT] Tactic: 51 time 0.018432 [01/19/2021-17:50:36] [V] [TRT] Tactic: 53 time 0.01312 [01/19/2021-17:50:36] [V] [TRT] Tactic: 55 time 0.053248 [01/19/2021-17:50:36] [V] [TRT] Tactic: 59 time 0.026432 [01/19/2021-17:50:36] [V] [TRT] Tactic: 60 time 0.012288 [01/19/2021-17:50:36] [V] [TRT] Tactic: 61 time 0.014336 [01/19/2021-17:50:36] [V] [TRT] Tactic: 63 time 0.014336 [01/19/2021-17:50:36] [V] [TRT] Tactic: 64 time 0.011264 [01/19/2021-17:50:36] [V] [TRT] Tactic: 65 time 0.013312 [01/19/2021-17:50:36] [V] [TRT] Tactic: 68 time 0.028672 [01/19/2021-17:50:36] [V] [TRT] Tactic: 69 time 0.012288 [01/19/2021-17:50:36] [V] [TRT] Tactic: 70 time 0.012288 [01/19/2021-17:50:36] [V] [TRT] Tactic: 74 time 0.01024 [01/19/2021-17:50:36] [V] [TRT] Tactic: 75 time 0.019328 [01/19/2021-17:50:36] [V] [TRT] Tactic: 78 time 0.01024 [01/19/2021-17:50:36] [V] [TRT] Tactic: 79 time 0.016384 [01/19/2021-17:50:36] [V] [TRT] Tactic: 81 time 0.01024 [01/19/2021-17:50:36] [V] [TRT] Tactic: 82 time 0.01536 [01/19/2021-17:50:36] [V] [TRT] Tactic: 84 time 0.017408 [01/19/2021-17:50:36] [V] [TRT] Tactic: 85 time 0.014336 [01/19/2021-17:50:36] [V] [TRT] Tactic: 86 time 0.028672 [01/19/2021-17:50:36] [V] [TRT] Tactic: 87 time 0.018432 [01/19/2021-17:50:36] [V] [TRT] Tactic: 88 time 0.017408 [01/19/2021-17:50:36] [V] [TRT] Tactic: 89 time 0.011264 [01/19/2021-17:50:36] [V] [TRT] Tactic: 91 time 0.026624 [01/19/2021-17:50:36] [V] [TRT] Tactic: 94 time 0.012288 [01/19/2021-17:50:36] [V] [TRT] Tactic: 95 time 0.01024 [01/19/2021-17:50:36] [V] [TRT] Tactic: 97 time 0.016384 [01/19/2021-17:50:36] [V] [TRT] Tactic: 102 time 0.012192 [01/19/2021-17:50:36] [V] [TRT] Tactic: 103 time 0.017408 [01/19/2021-17:50:36] [V] [TRT] Tactic: 105 time 0.018368 [01/19/2021-17:50:36] [V] [TRT] Tactic: 106 time 0.01024 [01/19/2021-17:50:36] [V] [TRT] Tactic: 107 time 0.012288 [01/19/2021-17:50:36] [V] [TRT] Tactic: 108 time 0.018272 [01/19/2021-17:50:36] [V] [TRT] Tactic: 109 time 0.017408 [01/19/2021-17:50:36] [V] [TRT] Tactic: 111 time 0.011264 [01/19/2021-17:50:36] [V] [TRT] Tactic: 112 time 0.013312 [01/19/2021-17:50:36] [V] [TRT] Tactic: 114 time 0.024384 [01/19/2021-17:50:36] [V] [TRT] Tactic: 115 time 0.017408 [01/19/2021-17:50:36] [V] [TRT] Tactic: 117 time 0.012288 [01/19/2021-17:50:36] [V] [TRT] Tactic: 118 time 0.015232 [01/19/2021-17:50:36] [V] [TRT] Tactic: 124 time 0.014336 [01/19/2021-17:50:36] [V] [TRT] Tactic: 125 time 0.01024 [01/19/2021-17:50:36] [V] [TRT] Tactic: 126 time 0.014336 [01/19/2021-17:50:36] [V] [TRT] Tactic: 131 time 0.017408 [01/19/2021-17:50:36] [V] [TRT] Tactic: 132 time 0.012288 [01/19/2021-17:50:36] [V] [TRT] Tactic: 138 time 0.01024 [01/19/2021-17:50:36] [V] [TRT] Tactic: 145 time 0.01024 [01/19/2021-17:50:36] [V] [TRT] Tactic: 150 time 0.0152 [01/19/2021-17:50:36] [V] [TRT] Tactic: 155 time 0.028672 [01/19/2021-17:50:36] [V] [TRT] Tactic: 157 time 0.01024 [01/19/2021-17:50:36] [V] [TRT] Tactic: 160 time 0.018432 [01/19/2021-17:50:37] [V] [TRT] Tactic: 163 time 0.012288 [01/19/2021-17:50:37] [V] [TRT] Tactic: 166 time 0.019456 [01/19/2021-17:50:37] [V] [TRT] Fastest Tactic: 17 Time: 0.01024 [01/19/2021-17:50:37] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_6/project/Conv2D (CaskConvolution) [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_6/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: 1062367460111450758 time 0.023552 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_6/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: 4501471010995462441 time 0.023552 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_6/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: 5137655947464784826 time 0.018432 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_6/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: 5326823351883942011 time 0.023552 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_6/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: 6645123197870846056 time 0.019456 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_6/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: -6576203419454146580 time 0.02048 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_6/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: -3456450830548107839 time 0.02048 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_6/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: -410470605513481746 time 0.023392 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_6/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: -37215280111360163 time 0.017408 [01/19/2021-17:50:37] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.017408 [01/19/2021-17:50:37] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_6/project/Conv2D (CudaConvolution) [01/19/2021-17:50:37] [V] [TRT] Tactic: 0 time 0.021504 [01/19/2021-17:50:37] [V] [TRT] Tactic: 1 time 0.03072 [01/19/2021-17:50:37] [V] [TRT] Tactic: 2 time 0.062464 [01/19/2021-17:50:37] [V] [TRT] Tactic: 4 skipped. Scratch requested: 108675072, available: 16777216 [01/19/2021-17:50:37] [V] [TRT] Tactic: 5 time 0.077792 [01/19/2021-17:50:37] [V] [TRT] Fastest Tactic: 0 Time: 0.021504 [01/19/2021-17:50:37] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_6/project/Conv2D (CudaDepthwiseConvolution) [01/19/2021-17:50:37] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 17 [01/19/2021-17:50:37] [V] [TRT] [01/19/2021-17:50:37] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,23104) -> Float(1,19,361,138624) *************** [01/19/2021-17:50:37] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:37] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:37] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:37] [V] [TRT] Tactic: 8 time 0.026624 [01/19/2021-17:50:37] [V] [TRT] Tactic: 9 time 0.0256 [01/19/2021-17:50:37] [V] [TRT] Tactic: 11 time 0.0256 [01/19/2021-17:50:37] [V] [TRT] Tactic: 12 time 0.020352 [01/19/2021-17:50:37] [V] [TRT] Tactic: 17 time 0.0224 [01/19/2021-17:50:37] [V] [TRT] Tactic: 19 time 0.036736 [01/19/2021-17:50:37] [V] [TRT] Tactic: 20 time 0.024576 [01/19/2021-17:50:37] [V] [TRT] Tactic: 21 time 0.0256 [01/19/2021-17:50:37] [V] [TRT] Tactic: 22 time 0.021504 [01/19/2021-17:50:37] [V] [TRT] Tactic: 24 time 0.024576 [01/19/2021-17:50:37] [V] [TRT] Tactic: 27 time 0.0256 [01/19/2021-17:50:37] [V] [TRT] Tactic: 28 time 0.026624 [01/19/2021-17:50:37] [V] [TRT] Tactic: 31 time 0.025504 [01/19/2021-17:50:37] [V] [TRT] Tactic: 32 time 0.023552 [01/19/2021-17:50:37] [V] [TRT] Tactic: 34 time 0.022528 [01/19/2021-17:50:37] [V] [TRT] Tactic: 35 time 0.021504 [01/19/2021-17:50:37] [V] [TRT] Tactic: 40 time 0.022528 [01/19/2021-17:50:37] [V] [TRT] Tactic: 46 time 0.023552 [01/19/2021-17:50:37] [V] [TRT] Tactic: 50 time 0.023552 [01/19/2021-17:50:37] [V] [TRT] Tactic: 51 time 0.022528 [01/19/2021-17:50:37] [V] [TRT] Tactic: 53 time 0.021504 [01/19/2021-17:50:37] [V] [TRT] Tactic: 55 time 0.031744 [01/19/2021-17:50:37] [V] [TRT] Tactic: 59 time 0.022528 [01/19/2021-17:50:37] [V] [TRT] Tactic: 60 time 0.025504 [01/19/2021-17:50:37] [V] [TRT] Tactic: 61 time 0.022528 [01/19/2021-17:50:37] [V] [TRT] Tactic: 63 time 0.0256 [01/19/2021-17:50:37] [V] [TRT] Tactic: 64 time 0.027648 [01/19/2021-17:50:37] [V] [TRT] Tactic: 65 time 0.0256 [01/19/2021-17:50:37] [V] [TRT] Tactic: 68 time 0.023552 [01/19/2021-17:50:37] [V] [TRT] Tactic: 69 time 0.027648 [01/19/2021-17:50:37] [V] [TRT] Tactic: 70 time 0.0256 [01/19/2021-17:50:37] [V] [TRT] Tactic: 74 time 0.024576 [01/19/2021-17:50:37] [V] [TRT] Tactic: 75 time 0.023552 [01/19/2021-17:50:37] [V] [TRT] Tactic: 78 time 0.022528 [01/19/2021-17:50:37] [V] [TRT] Tactic: 79 time 0.02048 [01/19/2021-17:50:37] [V] [TRT] Tactic: 81 time 0.023552 [01/19/2021-17:50:37] [V] [TRT] Tactic: 82 time 0.0256 [01/19/2021-17:50:37] [V] [TRT] Tactic: 84 time 0.019456 [01/19/2021-17:50:37] [V] [TRT] Tactic: 85 time 0.022528 [01/19/2021-17:50:37] [V] [TRT] Tactic: 86 time 0.022528 [01/19/2021-17:50:37] [V] [TRT] Tactic: 87 time 0.026624 [01/19/2021-17:50:37] [V] [TRT] Tactic: 88 time 0.021504 [01/19/2021-17:50:37] [V] [TRT] Tactic: 89 time 0.02048 [01/19/2021-17:50:37] [V] [TRT] Tactic: 91 time 0.021504 [01/19/2021-17:50:37] [V] [TRT] Tactic: 94 time 0.021504 [01/19/2021-17:50:37] [V] [TRT] Tactic: 95 time 0.022528 [01/19/2021-17:50:37] [V] [TRT] Tactic: 97 time 0.019456 [01/19/2021-17:50:37] [V] [TRT] Tactic: 102 time 0.024576 [01/19/2021-17:50:37] [V] [TRT] Tactic: 103 time 0.021344 [01/19/2021-17:50:37] [V] [TRT] Tactic: 105 time 0.026624 [01/19/2021-17:50:37] [V] [TRT] Tactic: 106 time 0.0256 [01/19/2021-17:50:37] [V] [TRT] Tactic: 107 time 0.021504 [01/19/2021-17:50:37] [V] [TRT] Tactic: 108 time 0.027648 [01/19/2021-17:50:37] [V] [TRT] Tactic: 109 time 0.02048 [01/19/2021-17:50:37] [V] [TRT] Tactic: 111 time 0.019456 [01/19/2021-17:50:37] [V] [TRT] Tactic: 112 time 0.023552 [01/19/2021-17:50:37] [V] [TRT] Tactic: 114 time 0.022528 [01/19/2021-17:50:37] [V] [TRT] Tactic: 115 time 0.026624 [01/19/2021-17:50:37] [V] [TRT] Tactic: 117 time 0.021504 [01/19/2021-17:50:37] [V] [TRT] Tactic: 118 time 0.026624 [01/19/2021-17:50:37] [V] [TRT] Tactic: 124 time 0.028672 [01/19/2021-17:50:37] [V] [TRT] Tactic: 125 time 0.025472 [01/19/2021-17:50:37] [V] [TRT] Tactic: 126 time 0.026496 [01/19/2021-17:50:37] [V] [TRT] Tactic: 131 time 0.0256 [01/19/2021-17:50:37] [V] [TRT] Tactic: 132 time 0.022528 [01/19/2021-17:50:37] [V] [TRT] Tactic: 138 time 0.024576 [01/19/2021-17:50:37] [V] [TRT] Tactic: 145 time 0.024576 [01/19/2021-17:50:37] [V] [TRT] Tactic: 150 time 0.026624 [01/19/2021-17:50:37] [V] [TRT] Tactic: 155 time 0.022528 [01/19/2021-17:50:37] [V] [TRT] Tactic: 157 time 0.0256 [01/19/2021-17:50:37] [V] [TRT] Tactic: 160 time 0.021248 [01/19/2021-17:50:37] [V] [TRT] Tactic: 163 time 0.02048 [01/19/2021-17:50:37] [V] [TRT] Tactic: 166 time 0.023552 [01/19/2021-17:50:37] [V] [TRT] Fastest Tactic: 84 Time: 0.019456 [01/19/2021-17:50:37] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6 (CaskConvolution) [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: 1062367460111450758 time 0.01536 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: 4501471010995462441 time 0.013312 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: 5137655947464784826 time 0.013312 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: 5326823351883942011 time 0.013312 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: 6645123197870846056 time 0.013312 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: -6576203419454146580 time 0.014336 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: -3456450830548107839 time 0.014336 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: -410470605513481746 time 0.013312 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: -37215280111360163 time 0.013312 [01/19/2021-17:50:37] [V] [TRT] Fastest Tactic: 4501471010995462441 Time: 0.013312 [01/19/2021-17:50:37] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6 (CudaConvolution) [01/19/2021-17:50:37] [V] [TRT] Tactic: 0 time 0.026624 [01/19/2021-17:50:37] [V] [TRT] Tactic: 1 time 0.0256 [01/19/2021-17:50:37] [V] [TRT] Tactic: 2 time 0.04096 [01/19/2021-17:50:37] [V] [TRT] Tactic: 4 skipped. Scratch requested: 214564864, available: 16777216 [01/19/2021-17:50:37] [V] [TRT] Tactic: 5 time 0.11264 [01/19/2021-17:50:37] [V] [TRT] Fastest Tactic: 1 Time: 0.0256 [01/19/2021-17:50:37] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:37] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4501471010995462441 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:37] [V] [TRT] [01/19/2021-17:50:37] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,138624) -> Float(1,19,361,138624) *************** [01/19/2021-17:50:37] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:37] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:37] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:37] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:37] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6 (CaskConvolution) [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: 1062367460111450758 time 2.96346 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: 4337000649858996379 time 2.67878 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: 4501471010995462441 time 2.78733 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: 5137655947464784826 time 2.56 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: 6645123197870846056 time 2.6112 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: -9137461792520977713 time 2.82419 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: -6092040395344634144 time 3.08429 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: -3456450830548107839 time 2.77914 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: -410470605513481746 time 2.79245 [01/19/2021-17:50:37] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 2.56 [01/19/2021-17:50:37] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6 (CudaConvolution) [01/19/2021-17:50:37] [V] [TRT] Tactic: 0 time 0.021504 [01/19/2021-17:50:37] [V] [TRT] Tactic: 1 time 2.05312 [01/19/2021-17:50:37] [V] [TRT] Tactic: 2 time 3.8337 [01/19/2021-17:50:37] [V] [TRT] Tactic: 4 time 9.26925 [01/19/2021-17:50:37] [V] [TRT] Tactic: 5 time 13.4799 [01/19/2021-17:50:37] [V] [TRT] Tactic: 6 time 2.73613 [01/19/2021-17:50:37] [V] [TRT] Fastest Tactic: 0 Time: 0.021504 [01/19/2021-17:50:37] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:37] [V] [TRT] Tactic: -1 time 0.012288 [01/19/2021-17:50:37] [V] [TRT] Fastest Tactic: -1 Time: 0.012288 [01/19/2021-17:50:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [01/19/2021-17:50:37] [V] [TRT] [01/19/2021-17:50:37] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,138624), Float(1,19,361,23104) -> Float(1,19,361,23104) *************** [01/19/2021-17:50:37] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add (LegacySASSConvolution) [01/19/2021-17:50:37] [V] [TRT] Tactic: 0 time 0.045056 [01/19/2021-17:50:37] [V] [TRT] Fastest Tactic: 0 Time: 0.045056 [01/19/2021-17:50:37] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add (CaskConvolution) [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: 1062367460111450758 time 0.039936 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: 4501471010995462441 time 0.039936 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: 5137655947464784826 time 0.028672 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: 5326823351883942011 time 0.038912 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: 6645123197870846056 time 0.031744 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: -6576203419454146580 time 0.031744 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: -3456450830548107839 time 0.033792 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: -410470605513481746 time 0.038912 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: -37215280111360163 time 0.028672 [01/19/2021-17:50:37] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.028672 [01/19/2021-17:50:37] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add (CudaConvolution) [01/19/2021-17:50:37] [V] [TRT] Tactic: 0 time 0.036864 [01/19/2021-17:50:37] [V] [TRT] Tactic: 1 time 0.050176 [01/19/2021-17:50:37] [V] [TRT] Tactic: 2 time 0.08704 [01/19/2021-17:50:37] [V] [TRT] Tactic: 4 skipped. Scratch requested: 217350144, available: 16777216 [01/19/2021-17:50:37] [V] [TRT] Tactic: 5 time 0.1208 [01/19/2021-17:50:37] [V] [TRT] Fastest Tactic: 0 Time: 0.036864 [01/19/2021-17:50:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5137655947464784826 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:37] [V] [TRT] [01/19/2021-17:50:37] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,23104) -> Float(1,19,361,138624) *************** [01/19/2021-17:50:37] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:37] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:37] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:37] [V] [TRT] Tactic: 8 time 0.026624 [01/19/2021-17:50:37] [V] [TRT] Tactic: 9 time 0.0256 [01/19/2021-17:50:37] [V] [TRT] Tactic: 11 time 0.0256 [01/19/2021-17:50:37] [V] [TRT] Tactic: 12 time 0.020352 [01/19/2021-17:50:37] [V] [TRT] Tactic: 17 time 0.022528 [01/19/2021-17:50:37] [V] [TRT] Tactic: 19 time 0.03584 [01/19/2021-17:50:37] [V] [TRT] Tactic: 20 time 0.023552 [01/19/2021-17:50:37] [V] [TRT] Tactic: 21 time 0.0256 [01/19/2021-17:50:37] [V] [TRT] Tactic: 22 time 0.021504 [01/19/2021-17:50:37] [V] [TRT] Tactic: 24 time 0.023552 [01/19/2021-17:50:37] [V] [TRT] Tactic: 27 time 0.0264 [01/19/2021-17:50:37] [V] [TRT] Tactic: 28 time 0.026624 [01/19/2021-17:50:37] [V] [TRT] Tactic: 31 time 0.025472 [01/19/2021-17:50:37] [V] [TRT] Tactic: 32 time 0.023392 [01/19/2021-17:50:37] [V] [TRT] Tactic: 34 time 0.023552 [01/19/2021-17:50:37] [V] [TRT] Tactic: 35 time 0.0224 [01/19/2021-17:50:37] [V] [TRT] Tactic: 40 time 0.022528 [01/19/2021-17:50:37] [V] [TRT] Tactic: 46 time 0.024416 [01/19/2021-17:50:37] [V] [TRT] Tactic: 50 time 0.021504 [01/19/2021-17:50:37] [V] [TRT] Tactic: 51 time 0.022528 [01/19/2021-17:50:37] [V] [TRT] Tactic: 53 time 0.022528 [01/19/2021-17:50:37] [V] [TRT] Tactic: 55 time 0.032768 [01/19/2021-17:50:37] [V] [TRT] Tactic: 59 time 0.022528 [01/19/2021-17:50:37] [V] [TRT] Tactic: 60 time 0.023552 [01/19/2021-17:50:37] [V] [TRT] Tactic: 61 time 0.022528 [01/19/2021-17:50:37] [V] [TRT] Tactic: 63 time 0.0256 [01/19/2021-17:50:37] [V] [TRT] Tactic: 64 time 0.027648 [01/19/2021-17:50:37] [V] [TRT] Tactic: 65 time 0.024576 [01/19/2021-17:50:37] [V] [TRT] Tactic: 68 time 0.023552 [01/19/2021-17:50:37] [V] [TRT] Tactic: 69 time 0.027648 [01/19/2021-17:50:37] [V] [TRT] Tactic: 70 time 0.0256 [01/19/2021-17:50:37] [V] [TRT] Tactic: 74 time 0.024576 [01/19/2021-17:50:37] [V] [TRT] Tactic: 75 time 0.023552 [01/19/2021-17:50:37] [V] [TRT] Tactic: 78 time 0.0224 [01/19/2021-17:50:37] [V] [TRT] Tactic: 79 time 0.02048 [01/19/2021-17:50:37] [V] [TRT] Tactic: 81 time 0.023552 [01/19/2021-17:50:37] [V] [TRT] Tactic: 82 time 0.0256 [01/19/2021-17:50:37] [V] [TRT] Tactic: 84 time 0.019456 [01/19/2021-17:50:37] [V] [TRT] Tactic: 85 time 0.023392 [01/19/2021-17:50:37] [V] [TRT] Tactic: 86 time 0.022528 [01/19/2021-17:50:37] [V] [TRT] Tactic: 87 time 0.026624 [01/19/2021-17:50:37] [V] [TRT] Tactic: 88 time 0.021504 [01/19/2021-17:50:37] [V] [TRT] Tactic: 89 time 0.019456 [01/19/2021-17:50:37] [V] [TRT] Tactic: 91 time 0.021504 [01/19/2021-17:50:37] [V] [TRT] Tactic: 94 time 0.02048 [01/19/2021-17:50:37] [V] [TRT] Tactic: 95 time 0.022528 [01/19/2021-17:50:37] [V] [TRT] Tactic: 97 time 0.019456 [01/19/2021-17:50:37] [V] [TRT] Tactic: 102 time 0.024576 [01/19/2021-17:50:37] [V] [TRT] Tactic: 103 time 0.021504 [01/19/2021-17:50:37] [V] [TRT] Tactic: 105 time 0.026624 [01/19/2021-17:50:37] [V] [TRT] Tactic: 106 time 0.025472 [01/19/2021-17:50:37] [V] [TRT] Tactic: 107 time 0.021504 [01/19/2021-17:50:37] [V] [TRT] Tactic: 108 time 0.026624 [01/19/2021-17:50:37] [V] [TRT] Tactic: 109 time 0.02048 [01/19/2021-17:50:37] [V] [TRT] Tactic: 111 time 0.019456 [01/19/2021-17:50:37] [V] [TRT] Tactic: 112 time 0.023552 [01/19/2021-17:50:37] [V] [TRT] Tactic: 114 time 0.021504 [01/19/2021-17:50:37] [V] [TRT] Tactic: 115 time 0.0256 [01/19/2021-17:50:37] [V] [TRT] Tactic: 117 time 0.021504 [01/19/2021-17:50:37] [V] [TRT] Tactic: 118 time 0.028672 [01/19/2021-17:50:37] [V] [TRT] Tactic: 124 time 0.028672 [01/19/2021-17:50:37] [V] [TRT] Tactic: 125 time 0.024576 [01/19/2021-17:50:37] [V] [TRT] Tactic: 126 time 0.0256 [01/19/2021-17:50:37] [V] [TRT] Tactic: 131 time 0.0256 [01/19/2021-17:50:37] [V] [TRT] Tactic: 132 time 0.021504 [01/19/2021-17:50:37] [V] [TRT] Tactic: 138 time 0.025408 [01/19/2021-17:50:37] [V] [TRT] Tactic: 145 time 0.024576 [01/19/2021-17:50:37] [V] [TRT] Tactic: 150 time 0.026624 [01/19/2021-17:50:37] [V] [TRT] Tactic: 155 time 0.022528 [01/19/2021-17:50:37] [V] [TRT] Tactic: 157 time 0.0256 [01/19/2021-17:50:37] [V] [TRT] Tactic: 160 time 0.021504 [01/19/2021-17:50:37] [V] [TRT] Tactic: 163 time 0.021504 [01/19/2021-17:50:37] [V] [TRT] Tactic: 166 time 0.023552 [01/19/2021-17:50:37] [V] [TRT] Fastest Tactic: 84 Time: 0.019456 [01/19/2021-17:50:37] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Relu6 (CaskConvolution) [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: 1062367460111450758 time 0.016384 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: 4501471010995462441 time 0.013312 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: 5137655947464784826 time 0.013312 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: 5326823351883942011 time 0.013312 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: 6645123197870846056 time 0.013312 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: -6576203419454146580 time 0.014336 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: -3456450830548107839 time 0.014336 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: -410470605513481746 time 0.013312 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: -37215280111360163 time 0.013312 [01/19/2021-17:50:37] [V] [TRT] Fastest Tactic: 4501471010995462441 Time: 0.013312 [01/19/2021-17:50:37] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Relu6 (CudaConvolution) [01/19/2021-17:50:37] [V] [TRT] Tactic: 0 time 0.026624 [01/19/2021-17:50:37] [V] [TRT] Tactic: 1 time 0.0256 [01/19/2021-17:50:37] [V] [TRT] Tactic: 2 time 0.04096 [01/19/2021-17:50:37] [V] [TRT] Tactic: 4 skipped. Scratch requested: 214564864, available: 16777216 [01/19/2021-17:50:37] [V] [TRT] Tactic: 5 time 0.113664 [01/19/2021-17:50:37] [V] [TRT] Fastest Tactic: 1 Time: 0.0256 [01/19/2021-17:50:37] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:37] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4501471010995462441 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:37] [V] [TRT] [01/19/2021-17:50:37] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,138624) -> Float(1,19,361,138624) *************** [01/19/2021-17:50:37] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:37] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:37] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:37] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:37] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/Relu6 (CaskConvolution) [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: 1062367460111450758 time 2.98598 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: 4337000649858996379 time 2.67776 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: 4501471010995462441 time 2.80269 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: 5137655947464784826 time 2.56307 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: 6645123197870846056 time 2.61427 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: -9137461792520977713 time 2.81702 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: -6092040395344634144 time 3.05152 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: -3456450830548107839 time 2.81891 [01/19/2021-17:50:37] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:37] [V] [TRT] Tactic: -410470605513481746 time 2.76582 [01/19/2021-17:50:37] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 2.56307 [01/19/2021-17:50:37] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/Relu6 (CudaConvolution) [01/19/2021-17:50:37] [V] [TRT] Tactic: 0 time 0.021504 [01/19/2021-17:50:37] [V] [TRT] Tactic: 1 time 1.92819 [01/19/2021-17:50:37] [V] [TRT] Tactic: 2 time 3.7847 [01/19/2021-17:50:38] [V] [TRT] Tactic: 4 time 9.31123 [01/19/2021-17:50:38] [V] [TRT] Tactic: 5 time 12.8993 [01/19/2021-17:50:38] [V] [TRT] Tactic: 6 time 2.51904 [01/19/2021-17:50:38] [V] [TRT] Fastest Tactic: 0 Time: 0.021504 [01/19/2021-17:50:38] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:38] [V] [TRT] Tactic: -1 time 0.012288 [01/19/2021-17:50:38] [V] [TRT] Fastest Tactic: -1 Time: 0.012288 [01/19/2021-17:50:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [01/19/2021-17:50:38] [V] [TRT] [01/19/2021-17:50:38] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,138624), Float(1,19,361,23104) -> Float(1,19,361,23104) *************** [01/19/2021-17:50:38] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_8/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_8/add (LegacySASSConvolution) [01/19/2021-17:50:38] [V] [TRT] Tactic: 0 time 0.04608 [01/19/2021-17:50:38] [V] [TRT] Fastest Tactic: 0 Time: 0.04608 [01/19/2021-17:50:38] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_8/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_8/add (CaskConvolution) [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_8/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_8/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: 1062367460111450758 time 0.039936 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_8/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_8/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: 4501471010995462441 time 0.039936 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_8/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_8/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: 5137655947464784826 time 0.028672 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_8/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_8/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: 5326823351883942011 time 0.038912 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_8/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_8/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: 6645123197870846056 time 0.03072 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_8/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_8/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: -6576203419454146580 time 0.031744 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_8/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_8/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: -3456450830548107839 time 0.033792 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_8/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_8/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: -410470605513481746 time 0.038912 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_8/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_8/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: -37215280111360163 time 0.028672 [01/19/2021-17:50:38] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.028672 [01/19/2021-17:50:38] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_8/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_8/add (CudaConvolution) [01/19/2021-17:50:38] [V] [TRT] Tactic: 0 time 0.036864 [01/19/2021-17:50:38] [V] [TRT] Tactic: 1 time 0.0512 [01/19/2021-17:50:38] [V] [TRT] Tactic: 2 time 0.08704 [01/19/2021-17:50:38] [V] [TRT] Tactic: 4 skipped. Scratch requested: 217350144, available: 16777216 [01/19/2021-17:50:38] [V] [TRT] Tactic: 5 time 0.116736 [01/19/2021-17:50:38] [V] [TRT] Fastest Tactic: 0 Time: 0.036864 [01/19/2021-17:50:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5137655947464784826 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_8/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_8/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:38] [V] [TRT] [01/19/2021-17:50:38] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,23104) -> Float(1,19,361,138624) *************** [01/19/2021-17:50:38] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:38] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:38] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:38] [V] [TRT] Tactic: 8 time 0.027648 [01/19/2021-17:50:38] [V] [TRT] Tactic: 9 time 0.0256 [01/19/2021-17:50:38] [V] [TRT] Tactic: 11 time 0.0256 [01/19/2021-17:50:38] [V] [TRT] Tactic: 12 time 0.02048 [01/19/2021-17:50:38] [V] [TRT] Tactic: 17 time 0.022528 [01/19/2021-17:50:38] [V] [TRT] Tactic: 19 time 0.036864 [01/19/2021-17:50:38] [V] [TRT] Tactic: 20 time 0.023552 [01/19/2021-17:50:38] [V] [TRT] Tactic: 21 time 0.0256 [01/19/2021-17:50:38] [V] [TRT] Tactic: 22 time 0.021504 [01/19/2021-17:50:38] [V] [TRT] Tactic: 24 time 0.024576 [01/19/2021-17:50:38] [V] [TRT] Tactic: 27 time 0.0256 [01/19/2021-17:50:38] [V] [TRT] Tactic: 28 time 0.026624 [01/19/2021-17:50:38] [V] [TRT] Tactic: 31 time 0.0256 [01/19/2021-17:50:38] [V] [TRT] Tactic: 32 time 0.023552 [01/19/2021-17:50:38] [V] [TRT] Tactic: 34 time 0.022528 [01/19/2021-17:50:38] [V] [TRT] Tactic: 35 time 0.021504 [01/19/2021-17:50:38] [V] [TRT] Tactic: 40 time 0.022528 [01/19/2021-17:50:38] [V] [TRT] Tactic: 46 time 0.023552 [01/19/2021-17:50:38] [V] [TRT] Tactic: 50 time 0.023552 [01/19/2021-17:50:38] [V] [TRT] Tactic: 51 time 0.022528 [01/19/2021-17:50:38] [V] [TRT] Tactic: 53 time 0.023552 [01/19/2021-17:50:38] [V] [TRT] Tactic: 55 time 0.032768 [01/19/2021-17:50:38] [V] [TRT] Tactic: 59 time 0.022528 [01/19/2021-17:50:38] [V] [TRT] Tactic: 60 time 0.024576 [01/19/2021-17:50:38] [V] [TRT] Tactic: 61 time 0.022528 [01/19/2021-17:50:38] [V] [TRT] Tactic: 63 time 0.026624 [01/19/2021-17:50:38] [V] [TRT] Tactic: 64 time 0.027584 [01/19/2021-17:50:38] [V] [TRT] Tactic: 65 time 0.024576 [01/19/2021-17:50:38] [V] [TRT] Tactic: 68 time 0.023552 [01/19/2021-17:50:38] [V] [TRT] Tactic: 69 time 0.027648 [01/19/2021-17:50:38] [V] [TRT] Tactic: 70 time 0.0256 [01/19/2021-17:50:38] [V] [TRT] Tactic: 74 time 0.0256 [01/19/2021-17:50:38] [V] [TRT] Tactic: 75 time 0.023552 [01/19/2021-17:50:38] [V] [TRT] Tactic: 78 time 0.022368 [01/19/2021-17:50:38] [V] [TRT] Tactic: 79 time 0.02048 [01/19/2021-17:50:38] [V] [TRT] Tactic: 81 time 0.023552 [01/19/2021-17:50:38] [V] [TRT] Tactic: 82 time 0.025472 [01/19/2021-17:50:38] [V] [TRT] Tactic: 84 time 0.02048 [01/19/2021-17:50:38] [V] [TRT] Tactic: 85 time 0.023552 [01/19/2021-17:50:38] [V] [TRT] Tactic: 86 time 0.022528 [01/19/2021-17:50:38] [V] [TRT] Tactic: 87 time 0.026624 [01/19/2021-17:50:38] [V] [TRT] Tactic: 88 time 0.021504 [01/19/2021-17:50:38] [V] [TRT] Tactic: 89 time 0.02048 [01/19/2021-17:50:38] [V] [TRT] Tactic: 91 time 0.022528 [01/19/2021-17:50:38] [V] [TRT] Tactic: 94 time 0.021504 [01/19/2021-17:50:38] [V] [TRT] Tactic: 95 time 0.022528 [01/19/2021-17:50:38] [V] [TRT] Tactic: 97 time 0.019456 [01/19/2021-17:50:38] [V] [TRT] Tactic: 102 time 0.024576 [01/19/2021-17:50:38] [V] [TRT] Tactic: 103 time 0.021504 [01/19/2021-17:50:38] [V] [TRT] Tactic: 105 time 0.026624 [01/19/2021-17:50:38] [V] [TRT] Tactic: 106 time 0.0256 [01/19/2021-17:50:38] [V] [TRT] Tactic: 107 time 0.021504 [01/19/2021-17:50:38] [V] [TRT] Tactic: 108 time 0.027648 [01/19/2021-17:50:38] [V] [TRT] Tactic: 109 time 0.02048 [01/19/2021-17:50:38] [V] [TRT] Tactic: 111 time 0.019456 [01/19/2021-17:50:38] [V] [TRT] Tactic: 112 time 0.023552 [01/19/2021-17:50:38] [V] [TRT] Tactic: 114 time 0.022528 [01/19/2021-17:50:38] [V] [TRT] Tactic: 115 time 0.026624 [01/19/2021-17:50:38] [V] [TRT] Tactic: 117 time 0.021504 [01/19/2021-17:50:38] [V] [TRT] Tactic: 118 time 0.026624 [01/19/2021-17:50:38] [V] [TRT] Tactic: 124 time 0.028672 [01/19/2021-17:50:38] [V] [TRT] Tactic: 125 time 0.0256 [01/19/2021-17:50:38] [V] [TRT] Tactic: 126 time 0.0256 [01/19/2021-17:50:38] [V] [TRT] Tactic: 131 time 0.0256 [01/19/2021-17:50:38] [V] [TRT] Tactic: 132 time 0.021504 [01/19/2021-17:50:38] [V] [TRT] Tactic: 138 time 0.025472 [01/19/2021-17:50:38] [V] [TRT] Tactic: 145 time 0.025472 [01/19/2021-17:50:38] [V] [TRT] Tactic: 150 time 0.026464 [01/19/2021-17:50:38] [V] [TRT] Tactic: 155 time 0.022528 [01/19/2021-17:50:38] [V] [TRT] Tactic: 157 time 0.0256 [01/19/2021-17:50:38] [V] [TRT] Tactic: 160 time 0.021504 [01/19/2021-17:50:38] [V] [TRT] Tactic: 163 time 0.021504 [01/19/2021-17:50:38] [V] [TRT] Tactic: 166 time 0.023552 [01/19/2021-17:50:38] [V] [TRT] Fastest Tactic: 97 Time: 0.019456 [01/19/2021-17:50:38] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Relu6 (CaskConvolution) [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: 1062367460111450758 time 0.016384 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: 4501471010995462441 time 0.013312 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: 5137655947464784826 time 0.013312 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: 5326823351883942011 time 0.013312 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: 6645123197870846056 time 0.013312 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: -6576203419454146580 time 0.014336 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: -3456450830548107839 time 0.014336 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: -410470605513481746 time 0.013312 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: -37215280111360163 time 0.013312 [01/19/2021-17:50:38] [V] [TRT] Fastest Tactic: 4501471010995462441 Time: 0.013312 [01/19/2021-17:50:38] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Relu6 (CudaConvolution) [01/19/2021-17:50:38] [V] [TRT] Tactic: 0 time 0.026624 [01/19/2021-17:50:38] [V] [TRT] Tactic: 1 time 0.0256 [01/19/2021-17:50:38] [V] [TRT] Tactic: 2 time 0.041984 [01/19/2021-17:50:38] [V] [TRT] Tactic: 4 skipped. Scratch requested: 214564864, available: 16777216 [01/19/2021-17:50:38] [V] [TRT] Tactic: 5 time 0.111616 [01/19/2021-17:50:38] [V] [TRT] Fastest Tactic: 1 Time: 0.0256 [01/19/2021-17:50:38] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:38] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4501471010995462441 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:38] [V] [TRT] [01/19/2021-17:50:38] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,138624) -> Float(1,19,361,138624) *************** [01/19/2021-17:50:38] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:38] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:38] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:38] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:38] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/Relu6 (CaskConvolution) [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: 1062367460111450758 time 2.96448 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: 4337000649858996379 time 2.70131 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: 4501471010995462441 time 2.76787 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: 5137655947464784826 time 2.56102 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: 6645123197870846056 time 2.61222 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: -9137461792520977713 time 2.81498 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: -6092040395344634144 time 3.04947 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: -3456450830548107839 time 2.78221 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: -410470605513481746 time 2.79552 [01/19/2021-17:50:38] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 2.56102 [01/19/2021-17:50:38] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/Relu6 (CudaConvolution) [01/19/2021-17:50:38] [V] [TRT] Tactic: 0 time 0.021504 [01/19/2021-17:50:38] [V] [TRT] Tactic: 1 time 1.9968 [01/19/2021-17:50:38] [V] [TRT] Tactic: 2 time 3.82874 [01/19/2021-17:50:38] [V] [TRT] Tactic: 4 time 9.13818 [01/19/2021-17:50:38] [V] [TRT] Tactic: 5 time 13.1533 [01/19/2021-17:50:38] [V] [TRT] Tactic: 6 time 2.52416 [01/19/2021-17:50:38] [V] [TRT] Fastest Tactic: 0 Time: 0.021504 [01/19/2021-17:50:38] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:38] [V] [TRT] Tactic: -1 time 0.012288 [01/19/2021-17:50:38] [V] [TRT] Fastest Tactic: -1 Time: 0.012288 [01/19/2021-17:50:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [01/19/2021-17:50:38] [V] [TRT] [01/19/2021-17:50:38] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,138624), Float(1,19,361,23104) -> Float(1,19,361,23104) *************** [01/19/2021-17:50:38] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_9/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_9/add (LegacySASSConvolution) [01/19/2021-17:50:38] [V] [TRT] Tactic: 0 time 0.045056 [01/19/2021-17:50:38] [V] [TRT] Fastest Tactic: 0 Time: 0.045056 [01/19/2021-17:50:38] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_9/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_9/add (CaskConvolution) [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_9/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_9/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: 1062367460111450758 time 0.04096 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_9/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_9/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: 4501471010995462441 time 0.039936 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_9/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_9/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: 5137655947464784826 time 0.028672 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_9/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_9/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: 5326823351883942011 time 0.038912 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_9/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_9/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: 6645123197870846056 time 0.03072 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_9/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_9/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: -6576203419454146580 time 0.031744 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_9/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_9/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: -3456450830548107839 time 0.033792 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_9/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_9/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: -410470605513481746 time 0.038912 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_9/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_9/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: -37215280111360163 time 0.028672 [01/19/2021-17:50:38] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.028672 [01/19/2021-17:50:38] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_9/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_9/add (CudaConvolution) [01/19/2021-17:50:38] [V] [TRT] Tactic: 0 time 0.036864 [01/19/2021-17:50:38] [V] [TRT] Tactic: 1 time 0.0512 [01/19/2021-17:50:38] [V] [TRT] Tactic: 2 time 0.088064 [01/19/2021-17:50:38] [V] [TRT] Tactic: 4 skipped. Scratch requested: 217350144, available: 16777216 [01/19/2021-17:50:38] [V] [TRT] Tactic: 5 time 0.121056 [01/19/2021-17:50:38] [V] [TRT] Fastest Tactic: 0 Time: 0.036864 [01/19/2021-17:50:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5137655947464784826 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_9/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_9/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:38] [V] [TRT] [01/19/2021-17:50:38] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,23104) -> Float(1,19,361,138624) *************** [01/19/2021-17:50:38] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:38] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:38] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:38] [V] [TRT] Tactic: 8 time 0.027648 [01/19/2021-17:50:38] [V] [TRT] Tactic: 9 time 0.0256 [01/19/2021-17:50:38] [V] [TRT] Tactic: 11 time 0.026624 [01/19/2021-17:50:38] [V] [TRT] Tactic: 12 time 0.02048 [01/19/2021-17:50:38] [V] [TRT] Tactic: 17 time 0.022528 [01/19/2021-17:50:38] [V] [TRT] Tactic: 19 time 0.036864 [01/19/2021-17:50:38] [V] [TRT] Tactic: 20 time 0.024576 [01/19/2021-17:50:38] [V] [TRT] Tactic: 21 time 0.0256 [01/19/2021-17:50:38] [V] [TRT] Tactic: 22 time 0.021504 [01/19/2021-17:50:38] [V] [TRT] Tactic: 24 time 0.024576 [01/19/2021-17:50:38] [V] [TRT] Tactic: 27 time 0.0256 [01/19/2021-17:50:38] [V] [TRT] Tactic: 28 time 0.026624 [01/19/2021-17:50:38] [V] [TRT] Tactic: 31 time 0.0256 [01/19/2021-17:50:38] [V] [TRT] Tactic: 32 time 0.023552 [01/19/2021-17:50:38] [V] [TRT] Tactic: 34 time 0.023552 [01/19/2021-17:50:38] [V] [TRT] Tactic: 35 time 0.021504 [01/19/2021-17:50:38] [V] [TRT] Tactic: 40 time 0.022528 [01/19/2021-17:50:38] [V] [TRT] Tactic: 46 time 0.022528 [01/19/2021-17:50:38] [V] [TRT] Tactic: 50 time 0.023552 [01/19/2021-17:50:38] [V] [TRT] Tactic: 51 time 0.022528 [01/19/2021-17:50:38] [V] [TRT] Tactic: 53 time 0.0224 [01/19/2021-17:50:38] [V] [TRT] Tactic: 55 time 0.032768 [01/19/2021-17:50:38] [V] [TRT] Tactic: 59 time 0.022528 [01/19/2021-17:50:38] [V] [TRT] Tactic: 60 time 0.024576 [01/19/2021-17:50:38] [V] [TRT] Tactic: 61 time 0.023552 [01/19/2021-17:50:38] [V] [TRT] Tactic: 63 time 0.026624 [01/19/2021-17:50:38] [V] [TRT] Tactic: 64 time 0.027648 [01/19/2021-17:50:38] [V] [TRT] Tactic: 65 time 0.024576 [01/19/2021-17:50:38] [V] [TRT] Tactic: 68 time 0.023552 [01/19/2021-17:50:38] [V] [TRT] Tactic: 69 time 0.027648 [01/19/2021-17:50:38] [V] [TRT] Tactic: 70 time 0.0256 [01/19/2021-17:50:38] [V] [TRT] Tactic: 74 time 0.024576 [01/19/2021-17:50:38] [V] [TRT] Tactic: 75 time 0.023552 [01/19/2021-17:50:38] [V] [TRT] Tactic: 78 time 0.022528 [01/19/2021-17:50:38] [V] [TRT] Tactic: 79 time 0.02048 [01/19/2021-17:50:38] [V] [TRT] Tactic: 81 time 0.023552 [01/19/2021-17:50:38] [V] [TRT] Tactic: 82 time 0.0256 [01/19/2021-17:50:38] [V] [TRT] Tactic: 84 time 0.02048 [01/19/2021-17:50:38] [V] [TRT] Tactic: 85 time 0.022528 [01/19/2021-17:50:38] [V] [TRT] Tactic: 86 time 0.022528 [01/19/2021-17:50:38] [V] [TRT] Tactic: 87 time 0.026624 [01/19/2021-17:50:38] [V] [TRT] Tactic: 88 time 0.021504 [01/19/2021-17:50:38] [V] [TRT] Tactic: 89 time 0.019456 [01/19/2021-17:50:38] [V] [TRT] Tactic: 91 time 0.022528 [01/19/2021-17:50:38] [V] [TRT] Tactic: 94 time 0.021504 [01/19/2021-17:50:38] [V] [TRT] Tactic: 95 time 0.021504 [01/19/2021-17:50:38] [V] [TRT] Tactic: 97 time 0.019456 [01/19/2021-17:50:38] [V] [TRT] Tactic: 102 time 0.024576 [01/19/2021-17:50:38] [V] [TRT] Tactic: 103 time 0.021504 [01/19/2021-17:50:38] [V] [TRT] Tactic: 105 time 0.026624 [01/19/2021-17:50:38] [V] [TRT] Tactic: 106 time 0.0256 [01/19/2021-17:50:38] [V] [TRT] Tactic: 107 time 0.021504 [01/19/2021-17:50:38] [V] [TRT] Tactic: 108 time 0.026624 [01/19/2021-17:50:38] [V] [TRT] Tactic: 109 time 0.02048 [01/19/2021-17:50:38] [V] [TRT] Tactic: 111 time 0.019456 [01/19/2021-17:50:38] [V] [TRT] Tactic: 112 time 0.023552 [01/19/2021-17:50:38] [V] [TRT] Tactic: 114 time 0.022528 [01/19/2021-17:50:38] [V] [TRT] Tactic: 115 time 0.026624 [01/19/2021-17:50:38] [V] [TRT] Tactic: 117 time 0.021504 [01/19/2021-17:50:38] [V] [TRT] Tactic: 118 time 0.026624 [01/19/2021-17:50:38] [V] [TRT] Tactic: 124 time 0.028672 [01/19/2021-17:50:38] [V] [TRT] Tactic: 125 time 0.024576 [01/19/2021-17:50:38] [V] [TRT] Tactic: 126 time 0.0256 [01/19/2021-17:50:38] [V] [TRT] Tactic: 131 time 0.0256 [01/19/2021-17:50:38] [V] [TRT] Tactic: 132 time 0.021504 [01/19/2021-17:50:38] [V] [TRT] Tactic: 138 time 0.025472 [01/19/2021-17:50:38] [V] [TRT] Tactic: 145 time 0.025472 [01/19/2021-17:50:38] [V] [TRT] Tactic: 150 time 0.026624 [01/19/2021-17:50:38] [V] [TRT] Tactic: 155 time 0.022528 [01/19/2021-17:50:38] [V] [TRT] Tactic: 157 time 0.025472 [01/19/2021-17:50:38] [V] [TRT] Tactic: 160 time 0.021504 [01/19/2021-17:50:38] [V] [TRT] Tactic: 163 time 0.021504 [01/19/2021-17:50:38] [V] [TRT] Tactic: 166 time 0.023552 [01/19/2021-17:50:38] [V] [TRT] Fastest Tactic: 89 Time: 0.019456 [01/19/2021-17:50:38] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Relu6 (CaskConvolution) [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: 1062367460111450758 time 0.016384 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: 4501471010995462441 time 0.013312 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: 5137655947464784826 time 0.013312 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: 5326823351883942011 time 0.013312 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: 6645123197870846056 time 0.013312 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: -6576203419454146580 time 0.014336 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: -3456450830548107839 time 0.014336 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: -410470605513481746 time 0.013312 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: -37215280111360163 time 0.013312 [01/19/2021-17:50:38] [V] [TRT] Fastest Tactic: 4501471010995462441 Time: 0.013312 [01/19/2021-17:50:38] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Relu6 (CudaConvolution) [01/19/2021-17:50:38] [V] [TRT] Tactic: 0 time 0.026624 [01/19/2021-17:50:38] [V] [TRT] Tactic: 1 time 0.026624 [01/19/2021-17:50:38] [V] [TRT] Tactic: 2 time 0.041984 [01/19/2021-17:50:38] [V] [TRT] Tactic: 4 skipped. Scratch requested: 214564864, available: 16777216 [01/19/2021-17:50:38] [V] [TRT] Tactic: 5 time 0.111616 [01/19/2021-17:50:38] [V] [TRT] Fastest Tactic: 0 Time: 0.026624 [01/19/2021-17:50:38] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:38] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4501471010995462441 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:38] [V] [TRT] [01/19/2021-17:50:38] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,138624) -> Float(1,19,361,138624) *************** [01/19/2021-17:50:38] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:38] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:38] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:38] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:38] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/Relu6 (CaskConvolution) [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: 1062367460111450758 time 3.00544 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: 4337000649858996379 time 2.67773 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: 4501471010995462441 time 2.77094 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: 5137655947464784826 time 2.56102 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: 6645123197870846056 time 2.61222 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: -9137461792520977713 time 2.79859 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: -6092040395344634144 time 3.05664 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: -3456450830548107839 time 2.77606 [01/19/2021-17:50:38] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:38] [V] [TRT] Tactic: -410470605513481746 time 2.7945 [01/19/2021-17:50:38] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 2.56102 [01/19/2021-17:50:38] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/Relu6 (CudaConvolution) [01/19/2021-17:50:39] [V] [TRT] Tactic: 0 time 0.021504 [01/19/2021-17:50:39] [V] [TRT] Tactic: 1 time 1.90157 [01/19/2021-17:50:39] [V] [TRT] Tactic: 2 time 3.82669 [01/19/2021-17:50:39] [V] [TRT] Tactic: 4 time 9.89286 [01/19/2021-17:50:39] [V] [TRT] Tactic: 5 time 13.1909 [01/19/2021-17:50:39] [V] [TRT] Tactic: 6 time 2.90714 [01/19/2021-17:50:39] [V] [TRT] Fastest Tactic: 0 Time: 0.021504 [01/19/2021-17:50:39] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:39] [V] [TRT] Tactic: -1 time 0.013312 [01/19/2021-17:50:39] [V] [TRT] Fastest Tactic: -1 Time: 0.013312 [01/19/2021-17:50:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [01/19/2021-17:50:39] [V] [TRT] [01/19/2021-17:50:39] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,138624) -> Float(1,19,361,34656) *************** [01/19/2021-17:50:39] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D (LegacySASSConvolution) [01/19/2021-17:50:39] [V] [TRT] Tactic: 0 time 0.036864 [01/19/2021-17:50:39] [V] [TRT] Fastest Tactic: 0 Time: 0.036864 [01/19/2021-17:50:39] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D (FusedConvActConvolution) [01/19/2021-17:50:39] [V] [TRT] Tactic: 8 time 0.080896 [01/19/2021-17:50:39] [V] [TRT] Tactic: 9 time 0.053248 [01/19/2021-17:50:39] [V] [TRT] Tactic: 11 time 0.0256 [01/19/2021-17:50:39] [V] [TRT] Tactic: 12 time 0.022528 [01/19/2021-17:50:39] [V] [TRT] Tactic: 17 time 0.023552 [01/19/2021-17:50:39] [V] [TRT] Tactic: 19 time 0.091136 [01/19/2021-17:50:39] [V] [TRT] Tactic: 20 time 0.055296 [01/19/2021-17:50:39] [V] [TRT] Tactic: 21 time 0.023552 [01/19/2021-17:50:39] [V] [TRT] Tactic: 22 time 0.031616 [01/19/2021-17:50:39] [V] [TRT] Tactic: 24 time 0.018432 [01/19/2021-17:50:39] [V] [TRT] Tactic: 27 time 0.024544 [01/19/2021-17:50:39] [V] [TRT] Tactic: 28 time 0.054272 [01/19/2021-17:50:39] [V] [TRT] Tactic: 31 time 0.022528 [01/19/2021-17:50:39] [V] [TRT] Tactic: 32 time 0.055296 [01/19/2021-17:50:39] [V] [TRT] Tactic: 34 time 0.052224 [01/19/2021-17:50:39] [V] [TRT] Tactic: 35 time 0.033792 [01/19/2021-17:50:39] [V] [TRT] Tactic: 40 time 0.0512 [01/19/2021-17:50:39] [V] [TRT] Tactic: 46 time 0.032768 [01/19/2021-17:50:39] [V] [TRT] Tactic: 50 time 0.031744 [01/19/2021-17:50:39] [V] [TRT] Tactic: 51 time 0.031744 [01/19/2021-17:50:39] [V] [TRT] Tactic: 53 time 0.023552 [01/19/2021-17:50:39] [V] [TRT] Tactic: 55 time 0.099328 [01/19/2021-17:50:39] [V] [TRT] Tactic: 59 time 0.048128 [01/19/2021-17:50:39] [V] [TRT] Tactic: 60 time 0.02048 [01/19/2021-17:50:39] [V] [TRT] Tactic: 61 time 0.022528 [01/19/2021-17:50:39] [V] [TRT] Tactic: 63 time 0.024576 [01/19/2021-17:50:39] [V] [TRT] Tactic: 64 time 0.025568 [01/19/2021-17:50:39] [V] [TRT] Tactic: 65 time 0.022528 [01/19/2021-17:50:39] [V] [TRT] Tactic: 68 time 0.052224 [01/19/2021-17:50:39] [V] [TRT] Tactic: 69 time 0.024576 [01/19/2021-17:50:39] [V] [TRT] Tactic: 70 time 0.0256 [01/19/2021-17:50:39] [V] [TRT] Tactic: 74 time 0.017408 [01/19/2021-17:50:39] [V] [TRT] Tactic: 75 time 0.038912 [01/19/2021-17:50:39] [V] [TRT] Tactic: 78 time 0.023552 [01/19/2021-17:50:39] [V] [TRT] Tactic: 79 time 0.029696 [01/19/2021-17:50:39] [V] [TRT] Tactic: 81 time 0.0256 [01/19/2021-17:50:39] [V] [TRT] Tactic: 82 time 0.026624 [01/19/2021-17:50:39] [V] [TRT] Tactic: 84 time 0.029696 [01/19/2021-17:50:39] [V] [TRT] Tactic: 85 time 0.023552 [01/19/2021-17:50:39] [V] [TRT] Tactic: 86 time 0.052224 [01/19/2021-17:50:39] [V] [TRT] Tactic: 87 time 0.031744 [01/19/2021-17:50:39] [V] [TRT] Tactic: 88 time 0.03072 [01/19/2021-17:50:39] [V] [TRT] Tactic: 89 time 0.018432 [01/19/2021-17:50:39] [V] [TRT] Tactic: 91 time 0.049152 [01/19/2021-17:50:39] [V] [TRT] Tactic: 94 time 0.021504 [01/19/2021-17:50:39] [V] [TRT] Tactic: 95 time 0.023552 [01/19/2021-17:50:39] [V] [TRT] Tactic: 97 time 0.027648 [01/19/2021-17:50:39] [V] [TRT] Tactic: 102 time 0.019456 [01/19/2021-17:50:39] [V] [TRT] Tactic: 103 time 0.03072 [01/19/2021-17:50:39] [V] [TRT] Tactic: 105 time 0.031712 [01/19/2021-17:50:39] [V] [TRT] Tactic: 106 time 0.022528 [01/19/2021-17:50:39] [V] [TRT] Tactic: 107 time 0.022528 [01/19/2021-17:50:39] [V] [TRT] Tactic: 108 time 0.031744 [01/19/2021-17:50:39] [V] [TRT] Tactic: 109 time 0.03072 [01/19/2021-17:50:39] [V] [TRT] Tactic: 111 time 0.018432 [01/19/2021-17:50:39] [V] [TRT] Tactic: 112 time 0.022528 [01/19/2021-17:50:39] [V] [TRT] Tactic: 114 time 0.04608 [01/19/2021-17:50:39] [V] [TRT] Tactic: 115 time 0.03072 [01/19/2021-17:50:39] [V] [TRT] Tactic: 117 time 0.02048 [01/19/2021-17:50:39] [V] [TRT] Tactic: 118 time 0.0256 [01/19/2021-17:50:39] [V] [TRT] Tactic: 124 time 0.0256 [01/19/2021-17:50:39] [V] [TRT] Tactic: 125 time 0.017408 [01/19/2021-17:50:39] [V] [TRT] Tactic: 126 time 0.0256 [01/19/2021-17:50:39] [V] [TRT] Tactic: 131 time 0.03072 [01/19/2021-17:50:39] [V] [TRT] Tactic: 132 time 0.022528 [01/19/2021-17:50:39] [V] [TRT] Tactic: 138 time 0.022528 [01/19/2021-17:50:39] [V] [TRT] Tactic: 145 time 0.017408 [01/19/2021-17:50:39] [V] [TRT] Tactic: 150 time 0.024576 [01/19/2021-17:50:39] [V] [TRT] Tactic: 155 time 0.0512 [01/19/2021-17:50:39] [V] [TRT] Tactic: 157 time 0.019456 [01/19/2021-17:50:39] [V] [TRT] Tactic: 160 time 0.032768 [01/19/2021-17:50:39] [V] [TRT] Tactic: 163 time 0.02048 [01/19/2021-17:50:39] [V] [TRT] Tactic: 166 time 0.038912 [01/19/2021-17:50:39] [V] [TRT] Fastest Tactic: 74 Time: 0.017408 [01/19/2021-17:50:39] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D (CaskConvolution) [01/19/2021-17:50:39] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:39] [V] [TRT] Tactic: 1062367460111450758 time 0.039936 [01/19/2021-17:50:39] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:39] [V] [TRT] Tactic: 4501471010995462441 time 0.039936 [01/19/2021-17:50:39] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:39] [V] [TRT] Tactic: 5137655947464784826 time 0.028672 [01/19/2021-17:50:39] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:39] [V] [TRT] Tactic: 5326823351883942011 time 0.038912 [01/19/2021-17:50:39] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:39] [V] [TRT] Tactic: 6645123197870846056 time 0.03072 [01/19/2021-17:50:39] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:39] [V] [TRT] Tactic: -6576203419454146580 time 0.031744 [01/19/2021-17:50:39] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:39] [V] [TRT] Tactic: -3456450830548107839 time 0.032768 [01/19/2021-17:50:39] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:39] [V] [TRT] Tactic: -410470605513481746 time 0.037888 [01/19/2021-17:50:39] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:39] [V] [TRT] Tactic: -37215280111360163 time 0.027648 [01/19/2021-17:50:39] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.027648 [01/19/2021-17:50:39] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D (CudaConvolution) [01/19/2021-17:50:39] [V] [TRT] Tactic: 0 time 0.036864 [01/19/2021-17:50:39] [V] [TRT] Tactic: 1 time 0.041984 [01/19/2021-17:50:39] [V] [TRT] Tactic: 2 time 0.089088 [01/19/2021-17:50:39] [V] [TRT] Tactic: 4 skipped. Scratch requested: 324354048, available: 16777216 [01/19/2021-17:50:39] [V] [TRT] Tactic: 5 time 0.137216 [01/19/2021-17:50:39] [V] [TRT] Fastest Tactic: 0 Time: 0.036864 [01/19/2021-17:50:39] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D (CudaDepthwiseConvolution) [01/19/2021-17:50:39] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 74 [01/19/2021-17:50:39] [V] [TRT] [01/19/2021-17:50:39] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,34656) -> Float(1,19,361,207936) *************** [01/19/2021-17:50:39] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:39] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:39] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:39] [V] [TRT] Tactic: 8 time 0.039936 [01/19/2021-17:50:39] [V] [TRT] Tactic: 9 time 0.041984 [01/19/2021-17:50:39] [V] [TRT] Tactic: 11 time 0.037888 [01/19/2021-17:50:39] [V] [TRT] Tactic: 12 time 0.034816 [01/19/2021-17:50:39] [V] [TRT] Tactic: 17 time 0.03584 [01/19/2021-17:50:39] [V] [TRT] Tactic: 19 time 0.073728 [01/19/2021-17:50:39] [V] [TRT] Tactic: 20 time 0.036864 [01/19/2021-17:50:39] [V] [TRT] Tactic: 21 time 0.041984 [01/19/2021-17:50:39] [V] [TRT] Tactic: 22 time 0.036864 [01/19/2021-17:50:39] [V] [TRT] Tactic: 24 time 0.04096 [01/19/2021-17:50:39] [V] [TRT] Tactic: 27 time 0.038912 [01/19/2021-17:50:39] [V] [TRT] Tactic: 28 time 0.037888 [01/19/2021-17:50:39] [V] [TRT] Tactic: 31 time 0.04096 [01/19/2021-17:50:39] [V] [TRT] Tactic: 32 time 0.033792 [01/19/2021-17:50:39] [V] [TRT] Tactic: 34 time 0.03584 [01/19/2021-17:50:39] [V] [TRT] Tactic: 35 time 0.038912 [01/19/2021-17:50:39] [V] [TRT] Tactic: 40 time 0.032768 [01/19/2021-17:50:39] [V] [TRT] Tactic: 46 time 0.033792 [01/19/2021-17:50:39] [V] [TRT] Tactic: 50 time 0.036864 [01/19/2021-17:50:39] [V] [TRT] Tactic: 51 time 0.037792 [01/19/2021-17:50:39] [V] [TRT] Tactic: 53 time 0.033792 [01/19/2021-17:50:39] [V] [TRT] Tactic: 55 time 0.045056 [01/19/2021-17:50:39] [V] [TRT] Tactic: 59 time 0.034816 [01/19/2021-17:50:39] [V] [TRT] Tactic: 60 time 0.037888 [01/19/2021-17:50:39] [V] [TRT] Tactic: 61 time 0.03584 [01/19/2021-17:50:39] [V] [TRT] Tactic: 63 time 0.038912 [01/19/2021-17:50:39] [V] [TRT] Tactic: 64 time 0.045056 [01/19/2021-17:50:39] [V] [TRT] Tactic: 65 time 0.04096 [01/19/2021-17:50:39] [V] [TRT] Tactic: 68 time 0.034816 [01/19/2021-17:50:39] [V] [TRT] Tactic: 69 time 0.04608 [01/19/2021-17:50:39] [V] [TRT] Tactic: 70 time 0.04096 [01/19/2021-17:50:39] [V] [TRT] Tactic: 74 time 0.039904 [01/19/2021-17:50:39] [V] [TRT] Tactic: 75 time 0.045056 [01/19/2021-17:50:39] [V] [TRT] Tactic: 78 time 0.033792 [01/19/2021-17:50:39] [V] [TRT] Tactic: 79 time 0.03584 [01/19/2021-17:50:39] [V] [TRT] Tactic: 81 time 0.037888 [01/19/2021-17:50:39] [V] [TRT] Tactic: 82 time 0.038912 [01/19/2021-17:50:39] [V] [TRT] Tactic: 84 time 0.033792 [01/19/2021-17:50:39] [V] [TRT] Tactic: 85 time 0.034816 [01/19/2021-17:50:39] [V] [TRT] Tactic: 86 time 0.033792 [01/19/2021-17:50:39] [V] [TRT] Tactic: 87 time 0.048128 [01/19/2021-17:50:39] [V] [TRT] Tactic: 88 time 0.036864 [01/19/2021-17:50:39] [V] [TRT] Tactic: 89 time 0.029696 [01/19/2021-17:50:39] [V] [TRT] Tactic: 91 time 0.033792 [01/19/2021-17:50:39] [V] [TRT] Tactic: 94 time 0.032768 [01/19/2021-17:50:39] [V] [TRT] Tactic: 95 time 0.03584 [01/19/2021-17:50:39] [V] [TRT] Tactic: 97 time 0.032768 [01/19/2021-17:50:39] [V] [TRT] Tactic: 102 time 0.038912 [01/19/2021-17:50:39] [V] [TRT] Tactic: 103 time 0.037888 [01/19/2021-17:50:39] [V] [TRT] Tactic: 105 time 0.045056 [01/19/2021-17:50:39] [V] [TRT] Tactic: 106 time 0.04096 [01/19/2021-17:50:39] [V] [TRT] Tactic: 107 time 0.032768 [01/19/2021-17:50:39] [V] [TRT] Tactic: 108 time 0.049152 [01/19/2021-17:50:39] [V] [TRT] Tactic: 109 time 0.036864 [01/19/2021-17:50:39] [V] [TRT] Tactic: 111 time 0.029696 [01/19/2021-17:50:39] [V] [TRT] Tactic: 112 time 0.03584 [01/19/2021-17:50:39] [V] [TRT] Tactic: 114 time 0.039936 [01/19/2021-17:50:39] [V] [TRT] Tactic: 115 time 0.044032 [01/19/2021-17:50:39] [V] [TRT] Tactic: 117 time 0.032768 [01/19/2021-17:50:39] [V] [TRT] Tactic: 118 time 0.037888 [01/19/2021-17:50:39] [V] [TRT] Tactic: 124 time 0.049152 [01/19/2021-17:50:39] [V] [TRT] Tactic: 125 time 0.039936 [01/19/2021-17:50:39] [V] [TRT] Tactic: 126 time 0.037888 [01/19/2021-17:50:39] [V] [TRT] Tactic: 131 time 0.041984 [01/19/2021-17:50:39] [V] [TRT] Tactic: 132 time 0.03584 [01/19/2021-17:50:39] [V] [TRT] Tactic: 138 time 0.04096 [01/19/2021-17:50:39] [V] [TRT] Tactic: 145 time 0.039936 [01/19/2021-17:50:39] [V] [TRT] Tactic: 150 time 0.038912 [01/19/2021-17:50:39] [V] [TRT] Tactic: 155 time 0.031744 [01/19/2021-17:50:39] [V] [TRT] Tactic: 157 time 0.043008 [01/19/2021-17:50:39] [V] [TRT] Tactic: 160 time 0.038912 [01/19/2021-17:50:39] [V] [TRT] Tactic: 163 time 0.031744 [01/19/2021-17:50:39] [V] [TRT] Tactic: 166 time 0.04608 [01/19/2021-17:50:39] [V] [TRT] Fastest Tactic: 89 Time: 0.029696 [01/19/2021-17:50:39] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6 (CaskConvolution) [01/19/2021-17:50:39] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:39] [V] [TRT] Tactic: 1062367460111450758 time 0.019456 [01/19/2021-17:50:39] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:39] [V] [TRT] Tactic: 4501471010995462441 time 0.016384 [01/19/2021-17:50:39] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:39] [V] [TRT] Tactic: 5137655947464784826 time 0.016384 [01/19/2021-17:50:39] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:39] [V] [TRT] Tactic: 5326823351883942011 time 0.016384 [01/19/2021-17:50:39] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:39] [V] [TRT] Tactic: 6645123197870846056 time 0.016384 [01/19/2021-17:50:39] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:39] [V] [TRT] Tactic: -6576203419454146580 time 0.017408 [01/19/2021-17:50:39] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:39] [V] [TRT] Tactic: -3456450830548107839 time 0.018432 [01/19/2021-17:50:39] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:39] [V] [TRT] Tactic: -410470605513481746 time 0.016384 [01/19/2021-17:50:39] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:39] [V] [TRT] Tactic: -37215280111360163 time 0.016384 [01/19/2021-17:50:39] [V] [TRT] Fastest Tactic: 4501471010995462441 Time: 0.016384 [01/19/2021-17:50:39] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6 (CudaConvolution) [01/19/2021-17:50:39] [V] [TRT] Tactic: 0 time 0.04096 [01/19/2021-17:50:39] [V] [TRT] Tactic: 1 time 0.031744 [01/19/2021-17:50:39] [V] [TRT] Tactic: 2 time 0.06144 [01/19/2021-17:50:39] [V] [TRT] Tactic: 4 skipped. Scratch requested: 482353152, available: 16777216 [01/19/2021-17:50:39] [V] [TRT] Tactic: 5 time 0.186368 [01/19/2021-17:50:39] [V] [TRT] Fastest Tactic: 1 Time: 0.031744 [01/19/2021-17:50:39] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:39] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4501471010995462441 [01/19/2021-17:50:39] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:39] [V] [TRT] [01/19/2021-17:50:39] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,207936) -> Float(1,19,361,207936) *************** [01/19/2021-17:50:39] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:39] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:39] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:39] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:39] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6 (CaskConvolution) [01/19/2021-17:50:39] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:39] [V] [TRT] Tactic: 1062367460111450758 time 4.49536 [01/19/2021-17:50:39] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [01/19/2021-17:50:39] [V] [TRT] Tactic: 4337000649858996379 time 4.05197 [01/19/2021-17:50:39] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:39] [V] [TRT] Tactic: 4501471010995462441 time 4.1984 [01/19/2021-17:50:39] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:39] [V] [TRT] Tactic: 5137655947464784826 time 3.90451 [01/19/2021-17:50:39] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:39] [V] [TRT] Tactic: 6645123197870846056 time 3.96493 [01/19/2021-17:50:39] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [01/19/2021-17:50:39] [V] [TRT] Tactic: -9137461792520977713 time 4.22605 [01/19/2021-17:50:39] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [01/19/2021-17:50:39] [V] [TRT] Tactic: -6092040395344634144 time 4.6121 [01/19/2021-17:50:39] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:39] [V] [TRT] Tactic: -3456450830548107839 time 4.20147 [01/19/2021-17:50:39] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:39] [V] [TRT] Tactic: -410470605513481746 time 4.19328 [01/19/2021-17:50:39] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 3.90451 [01/19/2021-17:50:39] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6 (CudaConvolution) [01/19/2021-17:50:39] [V] [TRT] Tactic: 0 time 0.028672 [01/19/2021-17:50:39] [V] [TRT] Tactic: 1 time 2.91328 [01/19/2021-17:50:39] [V] [TRT] Tactic: 2 time 5.8327 [01/19/2021-17:50:39] [V] [TRT] Tactic: 4 time 13.8004 [01/19/2021-17:50:39] [V] [TRT] Tactic: 5 time 19.5256 [01/19/2021-17:50:39] [V] [TRT] Tactic: 6 time 3.84384 [01/19/2021-17:50:39] [V] [TRT] Fastest Tactic: 0 Time: 0.028672 [01/19/2021-17:50:39] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:39] [V] [TRT] Tactic: -1 time 0.016384 [01/19/2021-17:50:39] [V] [TRT] Fastest Tactic: -1 Time: 0.016384 [01/19/2021-17:50:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [01/19/2021-17:50:39] [V] [TRT] [01/19/2021-17:50:39] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,207936), Float(1,19,361,34656) -> Float(1,19,361,34656) *************** [01/19/2021-17:50:39] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add (LegacySASSConvolution) [01/19/2021-17:50:39] [V] [TRT] Tactic: 0 time 0.053248 [01/19/2021-17:50:39] [V] [TRT] Fastest Tactic: 0 Time: 0.053248 [01/19/2021-17:50:39] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add (CaskConvolution) [01/19/2021-17:50:39] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:39] [V] [TRT] Tactic: 1062367460111450758 time 0.05632 [01/19/2021-17:50:39] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:39] [V] [TRT] Tactic: 4501471010995462441 time 0.05632 [01/19/2021-17:50:39] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:39] [V] [TRT] Tactic: 5137655947464784826 time 0.039936 [01/19/2021-17:50:39] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:39] [V] [TRT] Tactic: 5326823351883942011 time 0.054272 [01/19/2021-17:50:39] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:39] [V] [TRT] Tactic: 6645123197870846056 time 0.043008 [01/19/2021-17:50:39] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:39] [V] [TRT] Tactic: -6576203419454146580 time 0.043008 [01/19/2021-17:50:39] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: -3456450830548107839 time 0.04608 [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: -410470605513481746 time 0.054272 [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: -37215280111360163 time 0.037888 [01/19/2021-17:50:40] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.037888 [01/19/2021-17:50:40] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add (CudaConvolution) [01/19/2021-17:50:40] [V] [TRT] Tactic: 0 time 0.055296 [01/19/2021-17:50:40] [V] [TRT] Tactic: 1 time 0.060416 [01/19/2021-17:50:40] [V] [TRT] Tactic: 2 time 0.113664 [01/19/2021-17:50:40] [V] [TRT] Tactic: 4 skipped. Scratch requested: 486531072, available: 16777216 [01/19/2021-17:50:40] [V] [TRT] Tactic: 5 time 0.19456 [01/19/2021-17:50:40] [V] [TRT] Fastest Tactic: 0 Time: 0.055296 [01/19/2021-17:50:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163 [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:40] [V] [TRT] [01/19/2021-17:50:40] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,34656) -> Float(1,19,361,207936) *************** [01/19/2021-17:50:40] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:40] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:40] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:40] [V] [TRT] Tactic: 8 time 0.039936 [01/19/2021-17:50:40] [V] [TRT] Tactic: 9 time 0.039936 [01/19/2021-17:50:40] [V] [TRT] Tactic: 11 time 0.038912 [01/19/2021-17:50:40] [V] [TRT] Tactic: 12 time 0.034816 [01/19/2021-17:50:40] [V] [TRT] Tactic: 17 time 0.03584 [01/19/2021-17:50:40] [V] [TRT] Tactic: 19 time 0.072704 [01/19/2021-17:50:40] [V] [TRT] Tactic: 20 time 0.034816 [01/19/2021-17:50:40] [V] [TRT] Tactic: 21 time 0.041984 [01/19/2021-17:50:40] [V] [TRT] Tactic: 22 time 0.036864 [01/19/2021-17:50:40] [V] [TRT] Tactic: 24 time 0.039936 [01/19/2021-17:50:40] [V] [TRT] Tactic: 27 time 0.037888 [01/19/2021-17:50:40] [V] [TRT] Tactic: 28 time 0.037888 [01/19/2021-17:50:40] [V] [TRT] Tactic: 31 time 0.04096 [01/19/2021-17:50:40] [V] [TRT] Tactic: 32 time 0.033792 [01/19/2021-17:50:40] [V] [TRT] Tactic: 34 time 0.03584 [01/19/2021-17:50:40] [V] [TRT] Tactic: 35 time 0.038912 [01/19/2021-17:50:40] [V] [TRT] Tactic: 40 time 0.031744 [01/19/2021-17:50:40] [V] [TRT] Tactic: 46 time 0.034816 [01/19/2021-17:50:40] [V] [TRT] Tactic: 50 time 0.036864 [01/19/2021-17:50:40] [V] [TRT] Tactic: 51 time 0.036864 [01/19/2021-17:50:40] [V] [TRT] Tactic: 53 time 0.033792 [01/19/2021-17:50:40] [V] [TRT] Tactic: 55 time 0.04608 [01/19/2021-17:50:40] [V] [TRT] Tactic: 59 time 0.034816 [01/19/2021-17:50:40] [V] [TRT] Tactic: 60 time 0.037888 [01/19/2021-17:50:40] [V] [TRT] Tactic: 61 time 0.034816 [01/19/2021-17:50:40] [V] [TRT] Tactic: 63 time 0.039936 [01/19/2021-17:50:40] [V] [TRT] Tactic: 64 time 0.044032 [01/19/2021-17:50:40] [V] [TRT] Tactic: 65 time 0.041984 [01/19/2021-17:50:40] [V] [TRT] Tactic: 68 time 0.03584 [01/19/2021-17:50:40] [V] [TRT] Tactic: 69 time 0.04608 [01/19/2021-17:50:40] [V] [TRT] Tactic: 70 time 0.04096 [01/19/2021-17:50:40] [V] [TRT] Tactic: 74 time 0.039936 [01/19/2021-17:50:40] [V] [TRT] Tactic: 75 time 0.044032 [01/19/2021-17:50:40] [V] [TRT] Tactic: 78 time 0.03376 [01/19/2021-17:50:40] [V] [TRT] Tactic: 79 time 0.03584 [01/19/2021-17:50:40] [V] [TRT] Tactic: 81 time 0.037888 [01/19/2021-17:50:40] [V] [TRT] Tactic: 82 time 0.038912 [01/19/2021-17:50:40] [V] [TRT] Tactic: 84 time 0.034816 [01/19/2021-17:50:40] [V] [TRT] Tactic: 85 time 0.03584 [01/19/2021-17:50:40] [V] [TRT] Tactic: 86 time 0.033792 [01/19/2021-17:50:40] [V] [TRT] Tactic: 87 time 0.048128 [01/19/2021-17:50:40] [V] [TRT] Tactic: 88 time 0.03584 [01/19/2021-17:50:40] [V] [TRT] Tactic: 89 time 0.03072 [01/19/2021-17:50:40] [V] [TRT] Tactic: 91 time 0.033792 [01/19/2021-17:50:40] [V] [TRT] Tactic: 94 time 0.032768 [01/19/2021-17:50:40] [V] [TRT] Tactic: 95 time 0.03584 [01/19/2021-17:50:40] [V] [TRT] Tactic: 97 time 0.032768 [01/19/2021-17:50:40] [V] [TRT] Tactic: 102 time 0.038912 [01/19/2021-17:50:40] [V] [TRT] Tactic: 103 time 0.038912 [01/19/2021-17:50:40] [V] [TRT] Tactic: 105 time 0.045056 [01/19/2021-17:50:40] [V] [TRT] Tactic: 106 time 0.04096 [01/19/2021-17:50:40] [V] [TRT] Tactic: 107 time 0.032768 [01/19/2021-17:50:40] [V] [TRT] Tactic: 108 time 0.049152 [01/19/2021-17:50:40] [V] [TRT] Tactic: 109 time 0.036864 [01/19/2021-17:50:40] [V] [TRT] Tactic: 111 time 0.03072 [01/19/2021-17:50:40] [V] [TRT] Tactic: 112 time 0.03584 [01/19/2021-17:50:40] [V] [TRT] Tactic: 114 time 0.039936 [01/19/2021-17:50:40] [V] [TRT] Tactic: 115 time 0.044032 [01/19/2021-17:50:40] [V] [TRT] Tactic: 117 time 0.032768 [01/19/2021-17:50:40] [V] [TRT] Tactic: 118 time 0.037888 [01/19/2021-17:50:40] [V] [TRT] Tactic: 124 time 0.050176 [01/19/2021-17:50:40] [V] [TRT] Tactic: 125 time 0.039936 [01/19/2021-17:50:40] [V] [TRT] Tactic: 126 time 0.037888 [01/19/2021-17:50:40] [V] [TRT] Tactic: 131 time 0.043008 [01/19/2021-17:50:40] [V] [TRT] Tactic: 132 time 0.03584 [01/19/2021-17:50:40] [V] [TRT] Tactic: 138 time 0.04096 [01/19/2021-17:50:40] [V] [TRT] Tactic: 145 time 0.039936 [01/19/2021-17:50:40] [V] [TRT] Tactic: 150 time 0.039936 [01/19/2021-17:50:40] [V] [TRT] Tactic: 155 time 0.032768 [01/19/2021-17:50:40] [V] [TRT] Tactic: 157 time 0.043008 [01/19/2021-17:50:40] [V] [TRT] Tactic: 160 time 0.038912 [01/19/2021-17:50:40] [V] [TRT] Tactic: 163 time 0.031744 [01/19/2021-17:50:40] [V] [TRT] Tactic: 166 time 0.04608 [01/19/2021-17:50:40] [V] [TRT] Fastest Tactic: 89 Time: 0.03072 [01/19/2021-17:50:40] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Relu6 (CaskConvolution) [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: 1062367460111450758 time 0.018432 [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: 4501471010995462441 time 0.016384 [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: 5137655947464784826 time 0.016384 [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: 5326823351883942011 time 0.016384 [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: 6645123197870846056 time 0.016384 [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: -6576203419454146580 time 0.017408 [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: -3456450830548107839 time 0.017408 [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: -410470605513481746 time 0.016384 [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: -37215280111360163 time 0.016384 [01/19/2021-17:50:40] [V] [TRT] Fastest Tactic: 4501471010995462441 Time: 0.016384 [01/19/2021-17:50:40] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Relu6 (CudaConvolution) [01/19/2021-17:50:40] [V] [TRT] Tactic: 0 time 0.04096 [01/19/2021-17:50:40] [V] [TRT] Tactic: 1 time 0.031744 [01/19/2021-17:50:40] [V] [TRT] Tactic: 2 time 0.06144 [01/19/2021-17:50:40] [V] [TRT] Tactic: 4 skipped. Scratch requested: 482353152, available: 16777216 [01/19/2021-17:50:40] [V] [TRT] Tactic: 5 time 0.187392 [01/19/2021-17:50:40] [V] [TRT] Fastest Tactic: 1 Time: 0.031744 [01/19/2021-17:50:40] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:40] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4501471010995462441 [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:40] [V] [TRT] [01/19/2021-17:50:40] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,207936) -> Float(1,19,361,207936) *************** [01/19/2021-17:50:40] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:40] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:40] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:40] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:40] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/Relu6 (CaskConvolution) [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: 1062367460111450758 time 4.50048 [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: 4337000649858996379 time 4.05504 [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: 4501471010995462441 time 4.20237 [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: 5137655947464784826 time 3.90246 [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: 6645123197870846056 time 3.98029 [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: -9137461792520977713 time 4.23014 [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: -6092040395344634144 time 4.62438 [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: -3456450830548107839 time 4.21683 [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: -410470605513481746 time 4.21069 [01/19/2021-17:50:40] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 3.90246 [01/19/2021-17:50:40] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/Relu6 (CudaConvolution) [01/19/2021-17:50:40] [V] [TRT] Tactic: 0 time 0.029696 [01/19/2021-17:50:40] [V] [TRT] Tactic: 1 time 2.92659 [01/19/2021-17:50:40] [V] [TRT] Tactic: 2 time 5.75488 [01/19/2021-17:50:40] [V] [TRT] Tactic: 4 time 13.7789 [01/19/2021-17:50:40] [V] [TRT] Tactic: 5 time 19.2512 [01/19/2021-17:50:40] [V] [TRT] Tactic: 6 time 3.90861 [01/19/2021-17:50:40] [V] [TRT] Fastest Tactic: 0 Time: 0.029696 [01/19/2021-17:50:40] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:40] [V] [TRT] Tactic: -1 time 0.016384 [01/19/2021-17:50:40] [V] [TRT] Fastest Tactic: -1 Time: 0.016384 [01/19/2021-17:50:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [01/19/2021-17:50:40] [V] [TRT] [01/19/2021-17:50:40] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,207936), Float(1,19,361,34656) -> Float(1,19,361,34656) *************** [01/19/2021-17:50:40] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_12/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_12/add (LegacySASSConvolution) [01/19/2021-17:50:40] [V] [TRT] Tactic: 0 time 0.052224 [01/19/2021-17:50:40] [V] [TRT] Fastest Tactic: 0 Time: 0.052224 [01/19/2021-17:50:40] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_12/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_12/add (CaskConvolution) [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_12/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_12/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: 1062367460111450758 time 0.05632 [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_12/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_12/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: 4501471010995462441 time 0.055296 [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_12/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_12/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: 5137655947464784826 time 0.038912 [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_12/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_12/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: 5326823351883942011 time 0.054272 [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_12/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_12/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: 6645123197870846056 time 0.042912 [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_12/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_12/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: -6576203419454146580 time 0.043008 [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_12/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_12/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: -3456450830548107839 time 0.04608 [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_12/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_12/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: -410470605513481746 time 0.054272 [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_12/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_12/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: -37215280111360163 time 0.037888 [01/19/2021-17:50:40] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.037888 [01/19/2021-17:50:40] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_12/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_12/add (CudaConvolution) [01/19/2021-17:50:40] [V] [TRT] Tactic: 0 time 0.055296 [01/19/2021-17:50:40] [V] [TRT] Tactic: 1 time 0.059392 [01/19/2021-17:50:40] [V] [TRT] Tactic: 2 time 0.117984 [01/19/2021-17:50:40] [V] [TRT] Tactic: 4 skipped. Scratch requested: 486531072, available: 16777216 [01/19/2021-17:50:40] [V] [TRT] Tactic: 5 time 0.193408 [01/19/2021-17:50:40] [V] [TRT] Fastest Tactic: 0 Time: 0.055296 [01/19/2021-17:50:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163 [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_12/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_12/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:40] [V] [TRT] [01/19/2021-17:50:40] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,34656) -> Float(1,19,361,207936) *************** [01/19/2021-17:50:40] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:40] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:40] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:40] [V] [TRT] Tactic: 8 time 0.039936 [01/19/2021-17:50:40] [V] [TRT] Tactic: 9 time 0.04096 [01/19/2021-17:50:40] [V] [TRT] Tactic: 11 time 0.037888 [01/19/2021-17:50:40] [V] [TRT] Tactic: 12 time 0.034816 [01/19/2021-17:50:40] [V] [TRT] Tactic: 17 time 0.03584 [01/19/2021-17:50:40] [V] [TRT] Tactic: 19 time 0.073728 [01/19/2021-17:50:40] [V] [TRT] Tactic: 20 time 0.034816 [01/19/2021-17:50:40] [V] [TRT] Tactic: 21 time 0.041984 [01/19/2021-17:50:40] [V] [TRT] Tactic: 22 time 0.03584 [01/19/2021-17:50:40] [V] [TRT] Tactic: 24 time 0.04096 [01/19/2021-17:50:40] [V] [TRT] Tactic: 27 time 0.037888 [01/19/2021-17:50:40] [V] [TRT] Tactic: 28 time 0.037888 [01/19/2021-17:50:40] [V] [TRT] Tactic: 31 time 0.04096 [01/19/2021-17:50:40] [V] [TRT] Tactic: 32 time 0.033792 [01/19/2021-17:50:40] [V] [TRT] Tactic: 34 time 0.03584 [01/19/2021-17:50:40] [V] [TRT] Tactic: 35 time 0.038912 [01/19/2021-17:50:40] [V] [TRT] Tactic: 40 time 0.031744 [01/19/2021-17:50:40] [V] [TRT] Tactic: 46 time 0.033792 [01/19/2021-17:50:40] [V] [TRT] Tactic: 50 time 0.036864 [01/19/2021-17:50:40] [V] [TRT] Tactic: 51 time 0.036864 [01/19/2021-17:50:40] [V] [TRT] Tactic: 53 time 0.033792 [01/19/2021-17:50:40] [V] [TRT] Tactic: 55 time 0.04608 [01/19/2021-17:50:40] [V] [TRT] Tactic: 59 time 0.03584 [01/19/2021-17:50:40] [V] [TRT] Tactic: 60 time 0.037888 [01/19/2021-17:50:40] [V] [TRT] Tactic: 61 time 0.034816 [01/19/2021-17:50:40] [V] [TRT] Tactic: 63 time 0.039936 [01/19/2021-17:50:40] [V] [TRT] Tactic: 64 time 0.044032 [01/19/2021-17:50:40] [V] [TRT] Tactic: 65 time 0.041984 [01/19/2021-17:50:40] [V] [TRT] Tactic: 68 time 0.036864 [01/19/2021-17:50:40] [V] [TRT] Tactic: 69 time 0.047104 [01/19/2021-17:50:40] [V] [TRT] Tactic: 70 time 0.04096 [01/19/2021-17:50:40] [V] [TRT] Tactic: 74 time 0.039936 [01/19/2021-17:50:40] [V] [TRT] Tactic: 75 time 0.04496 [01/19/2021-17:50:40] [V] [TRT] Tactic: 78 time 0.033792 [01/19/2021-17:50:40] [V] [TRT] Tactic: 79 time 0.034816 [01/19/2021-17:50:40] [V] [TRT] Tactic: 81 time 0.037888 [01/19/2021-17:50:40] [V] [TRT] Tactic: 82 time 0.037888 [01/19/2021-17:50:40] [V] [TRT] Tactic: 84 time 0.033792 [01/19/2021-17:50:40] [V] [TRT] Tactic: 85 time 0.034816 [01/19/2021-17:50:40] [V] [TRT] Tactic: 86 time 0.033792 [01/19/2021-17:50:40] [V] [TRT] Tactic: 87 time 0.048032 [01/19/2021-17:50:40] [V] [TRT] Tactic: 88 time 0.036864 [01/19/2021-17:50:40] [V] [TRT] Tactic: 89 time 0.03072 [01/19/2021-17:50:40] [V] [TRT] Tactic: 91 time 0.033792 [01/19/2021-17:50:40] [V] [TRT] Tactic: 94 time 0.032768 [01/19/2021-17:50:40] [V] [TRT] Tactic: 95 time 0.03584 [01/19/2021-17:50:40] [V] [TRT] Tactic: 97 time 0.032768 [01/19/2021-17:50:40] [V] [TRT] Tactic: 102 time 0.038912 [01/19/2021-17:50:40] [V] [TRT] Tactic: 103 time 0.037888 [01/19/2021-17:50:40] [V] [TRT] Tactic: 105 time 0.045056 [01/19/2021-17:50:40] [V] [TRT] Tactic: 106 time 0.04096 [01/19/2021-17:50:40] [V] [TRT] Tactic: 107 time 0.032768 [01/19/2021-17:50:40] [V] [TRT] Tactic: 108 time 0.049152 [01/19/2021-17:50:40] [V] [TRT] Tactic: 109 time 0.036864 [01/19/2021-17:50:40] [V] [TRT] Tactic: 111 time 0.03072 [01/19/2021-17:50:40] [V] [TRT] Tactic: 112 time 0.03584 [01/19/2021-17:50:40] [V] [TRT] Tactic: 114 time 0.039936 [01/19/2021-17:50:40] [V] [TRT] Tactic: 115 time 0.044032 [01/19/2021-17:50:40] [V] [TRT] Tactic: 117 time 0.032768 [01/19/2021-17:50:40] [V] [TRT] Tactic: 118 time 0.037888 [01/19/2021-17:50:40] [V] [TRT] Tactic: 124 time 0.050176 [01/19/2021-17:50:40] [V] [TRT] Tactic: 125 time 0.039936 [01/19/2021-17:50:40] [V] [TRT] Tactic: 126 time 0.038912 [01/19/2021-17:50:40] [V] [TRT] Tactic: 131 time 0.04288 [01/19/2021-17:50:40] [V] [TRT] Tactic: 132 time 0.034816 [01/19/2021-17:50:40] [V] [TRT] Tactic: 138 time 0.04096 [01/19/2021-17:50:40] [V] [TRT] Tactic: 145 time 0.038912 [01/19/2021-17:50:40] [V] [TRT] Tactic: 150 time 0.038912 [01/19/2021-17:50:40] [V] [TRT] Tactic: 155 time 0.032768 [01/19/2021-17:50:40] [V] [TRT] Tactic: 157 time 0.041984 [01/19/2021-17:50:40] [V] [TRT] Tactic: 160 time 0.038912 [01/19/2021-17:50:40] [V] [TRT] Tactic: 163 time 0.031744 [01/19/2021-17:50:40] [V] [TRT] Tactic: 166 time 0.04608 [01/19/2021-17:50:40] [V] [TRT] Fastest Tactic: 89 Time: 0.03072 [01/19/2021-17:50:40] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6 (CaskConvolution) [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: 1062367460111450758 time 0.019456 [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: 4501471010995462441 time 0.016384 [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: 5137655947464784826 time 0.016384 [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: 5326823351883942011 time 0.016384 [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: 6645123197870846056 time 0.016384 [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: -6576203419454146580 time 0.017408 [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: -3456450830548107839 time 0.017408 [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: -410470605513481746 time 0.016384 [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:40] [V] [TRT] Tactic: -37215280111360163 time 0.016384 [01/19/2021-17:50:40] [V] [TRT] Fastest Tactic: 4501471010995462441 Time: 0.016384 [01/19/2021-17:50:40] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6 (CudaConvolution) [01/19/2021-17:50:40] [V] [TRT] Tactic: 0 time 0.039936 [01/19/2021-17:50:40] [V] [TRT] Tactic: 1 time 0.031744 [01/19/2021-17:50:40] [V] [TRT] Tactic: 2 time 0.06144 [01/19/2021-17:50:40] [V] [TRT] Tactic: 4 skipped. Scratch requested: 482353152, available: 16777216 [01/19/2021-17:50:40] [V] [TRT] Tactic: 5 time 0.181248 [01/19/2021-17:50:40] [V] [TRT] Fastest Tactic: 1 Time: 0.031744 [01/19/2021-17:50:40] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:40] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4501471010995462441 [01/19/2021-17:50:40] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:40] [V] [TRT] [01/19/2021-17:50:40] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,207936) -> Float(1,19,361,102885) *************** [01/19/2021-17:50:40] [V] [TRT] --------------- Timing Runner: BoxPredictor_0/ClassPredictor/Conv2D || BoxPredictor_0/BoxEncodingPredictor/Conv2D (LegacySASSConvolution) [01/19/2021-17:50:40] [V] [TRT] Tactic: 0 time 0.653312 [01/19/2021-17:50:40] [V] [TRT] Tactic: 1 time 0.24064 [01/19/2021-17:50:40] [V] [TRT] Fastest Tactic: 1 Time: 0.24064 [01/19/2021-17:50:40] [V] [TRT] --------------- Timing Runner: BoxPredictor_0/ClassPredictor/Conv2D || BoxPredictor_0/BoxEncodingPredictor/Conv2D (FusedConvActConvolution) [01/19/2021-17:50:40] [V] [TRT] Tactic: 7 time 0.34816 [01/19/2021-17:50:40] [V] [TRT] Tactic: 15 time 0.293888 [01/19/2021-17:50:40] [V] [TRT] Tactic: 25 time 0.331584 [01/19/2021-17:50:40] [V] [TRT] Tactic: 33 time 0.344064 [01/19/2021-17:50:40] [V] [TRT] Tactic: 36 time 0.533504 [01/19/2021-17:50:40] [V] [TRT] Tactic: 39 time 0.308224 [01/19/2021-17:50:40] [V] [TRT] Tactic: 45 time 0.29776 [01/19/2021-17:50:41] [V] [TRT] Tactic: 54 time 0.294912 [01/19/2021-17:50:41] [V] [TRT] Tactic: 76 time 0.27728 [01/19/2021-17:50:41] [V] [TRT] Tactic: 93 time 0.3328 [01/19/2021-17:50:41] [V] [TRT] Tactic: 98 time 0.273408 [01/19/2021-17:50:41] [V] [TRT] Tactic: 119 time 0.325632 [01/19/2021-17:50:41] [V] [TRT] Tactic: 130 time 0.35328 [01/19/2021-17:50:41] [V] [TRT] Tactic: 134 time 0.270336 [01/19/2021-17:50:41] [V] [TRT] Tactic: 137 time 0.272384 [01/19/2021-17:50:41] [V] [TRT] Tactic: 139 time 0.293888 [01/19/2021-17:50:41] [V] [TRT] Tactic: 151 time 0.295936 [01/19/2021-17:50:41] [V] [TRT] Tactic: 152 time 0.256 [01/19/2021-17:50:41] [V] [TRT] Tactic: 159 time 0.267264 [01/19/2021-17:50:41] [V] [TRT] Tactic: 162 time 0.308224 [01/19/2021-17:50:41] [V] [TRT] Fastest Tactic: 152 Time: 0.256 [01/19/2021-17:50:41] [V] [TRT] --------------- Timing Runner: BoxPredictor_0/ClassPredictor/Conv2D || BoxPredictor_0/BoxEncodingPredictor/Conv2D (CaskConvolution) [01/19/2021-17:50:41] [V] [TRT] BoxPredictor_0/ClassPredictor/Conv2D || BoxPredictor_0/BoxEncodingPredictor/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:41] [V] [TRT] Tactic: 1062367460111450758 time 0.591872 [01/19/2021-17:50:41] [V] [TRT] BoxPredictor_0/ClassPredictor/Conv2D || BoxPredictor_0/BoxEncodingPredictor/Conv2D (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [01/19/2021-17:50:41] [V] [TRT] Tactic: 3827454225649558724 time 0.203776 [01/19/2021-17:50:41] [V] [TRT] BoxPredictor_0/ClassPredictor/Conv2D || BoxPredictor_0/BoxEncodingPredictor/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [01/19/2021-17:50:41] [V] [TRT] Tactic: 4337000649858996379 time 0.466944 [01/19/2021-17:50:41] [V] [TRT] BoxPredictor_0/ClassPredictor/Conv2D || BoxPredictor_0/BoxEncodingPredictor/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:41] [V] [TRT] Tactic: 4501471010995462441 time 0.502784 [01/19/2021-17:50:41] [V] [TRT] BoxPredictor_0/ClassPredictor/Conv2D || BoxPredictor_0/BoxEncodingPredictor/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:41] [V] [TRT] Tactic: 5137655947464784826 time 0.4096 [01/19/2021-17:50:41] [V] [TRT] BoxPredictor_0/ClassPredictor/Conv2D || BoxPredictor_0/BoxEncodingPredictor/Conv2D (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [01/19/2021-17:50:41] [V] [TRT] Tactic: 5921334924264294896 time 0.218112 [01/19/2021-17:50:41] [V] [TRT] BoxPredictor_0/ClassPredictor/Conv2D || BoxPredictor_0/BoxEncodingPredictor/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:41] [V] [TRT] Tactic: 6645123197870846056 time 0.442368 [01/19/2021-17:50:41] [V] [TRT] BoxPredictor_0/ClassPredictor/Conv2D || BoxPredictor_0/BoxEncodingPredictor/Conv2D (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [01/19/2021-17:50:41] [V] [TRT] Tactic: 7852627285308570038 time 0.226304 [01/19/2021-17:50:41] [V] [TRT] BoxPredictor_0/ClassPredictor/Conv2D || BoxPredictor_0/BoxEncodingPredictor/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [01/19/2021-17:50:41] [V] [TRT] Tactic: -9137461792520977713 time 0.526336 [01/19/2021-17:50:41] [V] [TRT] BoxPredictor_0/ClassPredictor/Conv2D || BoxPredictor_0/BoxEncodingPredictor/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [01/19/2021-17:50:41] [V] [TRT] Tactic: -6092040395344634144 time 0.620544 [01/19/2021-17:50:41] [V] [TRT] BoxPredictor_0/ClassPredictor/Conv2D || BoxPredictor_0/BoxEncodingPredictor/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:41] [V] [TRT] Tactic: -3456450830548107839 time 0.444416 [01/19/2021-17:50:41] [V] [TRT] BoxPredictor_0/ClassPredictor/Conv2D || BoxPredictor_0/BoxEncodingPredictor/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:41] [V] [TRT] Tactic: -410470605513481746 time 0.480256 [01/19/2021-17:50:41] [V] [TRT] Fastest Tactic: 3827454225649558724 Time: 0.203776 [01/19/2021-17:50:41] [V] [TRT] --------------- Timing Runner: BoxPredictor_0/ClassPredictor/Conv2D || BoxPredictor_0/BoxEncodingPredictor/Conv2D (CudaConvolution) [01/19/2021-17:50:41] [V] [TRT] Tactic: 0 time 0.576512 [01/19/2021-17:50:41] [V] [TRT] Tactic: 1 time 0.671744 [01/19/2021-17:50:41] [V] [TRT] Tactic: 2 time 0.461824 [01/19/2021-17:50:41] [V] [TRT] Tactic: 4 skipped. Scratch requested: 1439772160, available: 16777216 [01/19/2021-17:50:41] [V] [TRT] Tactic: 5 skipped. Scratch requested: 718196224, available: 16777216 [01/19/2021-17:50:41] [V] [TRT] Tactic: 6 time 0.297984 [01/19/2021-17:50:41] [V] [TRT] Fastest Tactic: 6 Time: 0.297984 [01/19/2021-17:50:41] [V] [TRT] --------------- Timing Runner: BoxPredictor_0/ClassPredictor/Conv2D || BoxPredictor_0/BoxEncodingPredictor/Conv2D (CudaDepthwiseConvolution) [01/19/2021-17:50:41] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3827454225649558724 [01/19/2021-17:50:41] [V] [TRT] BoxPredictor_0/ClassPredictor/Conv2D || BoxPredictor_0/BoxEncodingPredictor/Conv2D (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [01/19/2021-17:50:41] [V] [TRT] [01/19/2021-17:50:41] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:41] [V] [TRT] Tactic: 0 time 0.012288 [01/19/2021-17:50:41] [V] [TRT] Fastest Tactic: 0 Time: 0.012288 [01/19/2021-17:50:41] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:41] [V] [TRT] Tactic: 0 time 0.012288 [01/19/2021-17:50:41] [V] [TRT] Fastest Tactic: 0 Time: 0.012288 [01/19/2021-17:50:41] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:41] [V] [TRT] Tactic: 0 time 0.009216 [01/19/2021-17:50:41] [V] [TRT] Fastest Tactic: 0 Time: 0.009216 [01/19/2021-17:50:41] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,102885) -> Float(1,1,91,98553) *************** [01/19/2021-17:50:41] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 404) [Shuffle] + BoxPredictor_0/Reshape_1 (Shuffle) [01/19/2021-17:50:41] [V] [TRT] Tactic: 0 time 0.008192 [01/19/2021-17:50:41] [V] [TRT] Fastest Tactic: 0 Time: 0.008192 [01/19/2021-17:50:41] [V] [TRT] *************** Autotuning format combination: Float(1,19,361:32,3249) -> Float(1,1,91:32,3094) *************** [01/19/2021-17:50:41] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 404) [Shuffle] + BoxPredictor_0/Reshape_1 (Shuffle) [01/19/2021-17:50:41] [V] [TRT] Tactic: 0 time 0.012288 [01/19/2021-17:50:41] [V] [TRT] Fastest Tactic: 0 Time: 0.012288 [01/19/2021-17:50:41] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,207936) -> Float(1,10,100,57600) *************** [01/19/2021-17:50:41] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:41] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:41] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:41] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:41] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6 (CaskConvolution) [01/19/2021-17:50:41] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:41] [V] [TRT] Tactic: 1062367460111450758 time 4.30285 [01/19/2021-17:50:41] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [01/19/2021-17:50:41] [V] [TRT] Tactic: 4337000649858996379 time 3.98848 [01/19/2021-17:50:41] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:41] [V] [TRT] Tactic: 4501471010995462441 time 4.09702 [01/19/2021-17:50:41] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:41] [V] [TRT] Tactic: 5137655947464784826 time 3.9721 [01/19/2021-17:50:41] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:41] [V] [TRT] Tactic: 6645123197870846056 time 3.85741 [01/19/2021-17:50:41] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [01/19/2021-17:50:41] [V] [TRT] Tactic: -9137461792520977713 time 4.13901 [01/19/2021-17:50:41] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [01/19/2021-17:50:41] [V] [TRT] Tactic: -6092040395344634144 time 4.43792 [01/19/2021-17:50:41] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:41] [V] [TRT] Tactic: -3456450830548107839 time 4.00691 [01/19/2021-17:50:41] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:41] [V] [TRT] Tactic: -410470605513481746 time 4.10522 [01/19/2021-17:50:41] [V] [TRT] Fastest Tactic: 6645123197870846056 Time: 3.85741 [01/19/2021-17:50:41] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6 (CudaConvolution) [01/19/2021-17:50:41] [V] [TRT] Tactic: 0 time 0.01536 [01/19/2021-17:50:41] [V] [TRT] Tactic: 1 time 2.90099 [01/19/2021-17:50:41] [V] [TRT] Tactic: 2 time 5.86342 [01/19/2021-17:50:41] [V] [TRT] Tactic: 5 time 19.3167 [01/19/2021-17:50:41] [V] [TRT] Fastest Tactic: 0 Time: 0.01536 [01/19/2021-17:50:41] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:41] [V] [TRT] Tactic: -1 time 0.011264 [01/19/2021-17:50:41] [V] [TRT] Fastest Tactic: -1 Time: 0.011264 [01/19/2021-17:50:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [01/19/2021-17:50:41] [V] [TRT] [01/19/2021-17:50:41] [V] [TRT] *************** Autotuning format combination: Float(1,10,100,57600) -> Float(1,10,100,16000) *************** [01/19/2021-17:50:41] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D (LegacySASSConvolution) [01/19/2021-17:50:41] [V] [TRT] Tactic: 0 time 0.063488 [01/19/2021-17:50:41] [V] [TRT] Fastest Tactic: 0 Time: 0.063488 [01/19/2021-17:50:41] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D (FusedConvActConvolution) [01/19/2021-17:50:41] [V] [TRT] Tactic: 8 time 0.114688 [01/19/2021-17:50:41] [V] [TRT] Tactic: 9 time 0.073728 [01/19/2021-17:50:41] [V] [TRT] Tactic: 11 time 0.03072 [01/19/2021-17:50:41] [V] [TRT] Tactic: 12 time 0.026624 [01/19/2021-17:50:41] [V] [TRT] Tactic: 17 time 0.017408 [01/19/2021-17:50:41] [V] [TRT] Tactic: 19 time 0.130048 [01/19/2021-17:50:41] [V] [TRT] Tactic: 20 time 0.0768 [01/19/2021-17:50:41] [V] [TRT] Tactic: 21 time 0.017408 [01/19/2021-17:50:41] [V] [TRT] Tactic: 22 time 0.044032 [01/19/2021-17:50:41] [V] [TRT] Tactic: 24 time 0.02048 [01/19/2021-17:50:41] [V] [TRT] Tactic: 27 time 0.028672 [01/19/2021-17:50:41] [V] [TRT] Tactic: 28 time 0.079872 [01/19/2021-17:50:41] [V] [TRT] Tactic: 31 time 0.016384 [01/19/2021-17:50:41] [V] [TRT] Tactic: 32 time 0.077824 [01/19/2021-17:50:41] [V] [TRT] Tactic: 34 time 0.070656 [01/19/2021-17:50:41] [V] [TRT] Tactic: 35 time 0.04608 [01/19/2021-17:50:41] [V] [TRT] Tactic: 40 time 0.07168 [01/19/2021-17:50:41] [V] [TRT] Tactic: 46 time 0.04096 [01/19/2021-17:50:41] [V] [TRT] Tactic: 50 time 0.043904 [01/19/2021-17:50:41] [V] [TRT] Tactic: 51 time 0.038912 [01/19/2021-17:50:41] [V] [TRT] Tactic: 53 time 0.023552 [01/19/2021-17:50:41] [V] [TRT] Tactic: 55 time 0.144384 [01/19/2021-17:50:41] [V] [TRT] Tactic: 59 time 0.063488 [01/19/2021-17:50:41] [V] [TRT] Tactic: 60 time 0.018432 [01/19/2021-17:50:41] [V] [TRT] Tactic: 61 time 0.028672 [01/19/2021-17:50:41] [V] [TRT] Tactic: 63 time 0.03072 [01/19/2021-17:50:41] [V] [TRT] Tactic: 64 time 0.018432 [01/19/2021-17:50:41] [V] [TRT] Tactic: 65 time 0.029696 [01/19/2021-17:50:41] [V] [TRT] Tactic: 68 time 0.074752 [01/19/2021-17:50:41] [V] [TRT] Tactic: 69 time 0.021504 [01/19/2021-17:50:41] [V] [TRT] Tactic: 70 time 0.021504 [01/19/2021-17:50:41] [V] [TRT] Tactic: 74 time 0.019456 [01/19/2021-17:50:41] [V] [TRT] Tactic: 75 time 0.043008 [01/19/2021-17:50:41] [V] [TRT] Tactic: 78 time 0.017408 [01/19/2021-17:50:41] [V] [TRT] Tactic: 79 time 0.036864 [01/19/2021-17:50:41] [V] [TRT] Tactic: 81 time 0.017408 [01/19/2021-17:50:41] [V] [TRT] Tactic: 82 time 0.031744 [01/19/2021-17:50:41] [V] [TRT] Tactic: 84 time 0.041984 [01/19/2021-17:50:41] [V] [TRT] Tactic: 85 time 0.029696 [01/19/2021-17:50:41] [V] [TRT] Tactic: 86 time 0.07168 [01/19/2021-17:50:41] [V] [TRT] Tactic: 87 time 0.039936 [01/19/2021-17:50:41] [V] [TRT] Tactic: 88 time 0.038912 [01/19/2021-17:50:41] [V] [TRT] Tactic: 89 time 0.022528 [01/19/2021-17:50:41] [V] [TRT] Tactic: 91 time 0.067584 [01/19/2021-17:50:41] [V] [TRT] Tactic: 94 time 0.022528 [01/19/2021-17:50:41] [V] [TRT] Tactic: 95 time 0.017408 [01/19/2021-17:50:41] [V] [TRT] Tactic: 97 time 0.036864 [01/19/2021-17:50:41] [V] [TRT] Tactic: 102 time 0.02048 [01/19/2021-17:50:41] [V] [TRT] Tactic: 103 time 0.037888 [01/19/2021-17:50:41] [V] [TRT] Tactic: 105 time 0.038912 [01/19/2021-17:50:41] [V] [TRT] Tactic: 106 time 0.016384 [01/19/2021-17:50:41] [V] [TRT] Tactic: 107 time 0.023552 [01/19/2021-17:50:41] [V] [TRT] Tactic: 108 time 0.04096 [01/19/2021-17:50:41] [V] [TRT] Tactic: 109 time 0.039936 [01/19/2021-17:50:41] [V] [TRT] Tactic: 111 time 0.022528 [01/19/2021-17:50:41] [V] [TRT] Tactic: 112 time 0.027648 [01/19/2021-17:50:41] [V] [TRT] Tactic: 114 time 0.060416 [01/19/2021-17:50:41] [V] [TRT] Tactic: 115 time 0.038912 [01/19/2021-17:50:41] [V] [TRT] Tactic: 117 time 0.0256 [01/19/2021-17:50:41] [V] [TRT] Tactic: 118 time 0.03072 [01/19/2021-17:50:41] [V] [TRT] Tactic: 124 time 0.028544 [01/19/2021-17:50:41] [V] [TRT] Tactic: 125 time 0.019456 [01/19/2021-17:50:41] [V] [TRT] Tactic: 126 time 0.03072 [01/19/2021-17:50:41] [V] [TRT] Tactic: 131 time 0.038912 [01/19/2021-17:50:41] [V] [TRT] Tactic: 132 time 0.023456 [01/19/2021-17:50:41] [V] [TRT] Tactic: 138 time 0.016384 [01/19/2021-17:50:41] [V] [TRT] Tactic: 145 time 0.019456 [01/19/2021-17:50:41] [V] [TRT] Tactic: 150 time 0.03072 [01/19/2021-17:50:41] [V] [TRT] Tactic: 155 time 0.072704 [01/19/2021-17:50:41] [V] [TRT] Tactic: 157 time 0.018432 [01/19/2021-17:50:41] [V] [TRT] Tactic: 160 time 0.044032 [01/19/2021-17:50:41] [V] [TRT] Tactic: 163 time 0.0256 [01/19/2021-17:50:41] [V] [TRT] Tactic: 166 time 0.043008 [01/19/2021-17:50:41] [V] [TRT] Fastest Tactic: 31 Time: 0.016384 [01/19/2021-17:50:41] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D (CaskConvolution) [01/19/2021-17:50:41] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:41] [V] [TRT] Tactic: 1062367460111450758 time 0.055296 [01/19/2021-17:50:41] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:41] [V] [TRT] Tactic: 4501471010995462441 time 0.055296 [01/19/2021-17:50:41] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:41] [V] [TRT] Tactic: 5137655947464784826 time 0.03888 [01/19/2021-17:50:41] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:41] [V] [TRT] Tactic: 5326823351883942011 time 0.054272 [01/19/2021-17:50:41] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:41] [V] [TRT] Tactic: 6645123197870846056 time 0.041984 [01/19/2021-17:50:41] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:41] [V] [TRT] Tactic: -6576203419454146580 time 0.043008 [01/19/2021-17:50:41] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:41] [V] [TRT] Tactic: -3456450830548107839 time 0.045056 [01/19/2021-17:50:41] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:41] [V] [TRT] Tactic: -410470605513481746 time 0.053248 [01/19/2021-17:50:41] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:41] [V] [TRT] Tactic: -37215280111360163 time 0.037888 [01/19/2021-17:50:41] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.037888 [01/19/2021-17:50:41] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D (CudaConvolution) [01/19/2021-17:50:41] [V] [TRT] Tactic: 0 time 0.050176 [01/19/2021-17:50:41] [V] [TRT] Tactic: 1 time 0.067584 [01/19/2021-17:50:41] [V] [TRT] Tactic: 2 time 0.089088 [01/19/2021-17:50:41] [V] [TRT] Tactic: 4 skipped. Scratch requested: 214032384, available: 16777216 [01/19/2021-17:50:41] [V] [TRT] Tactic: 5 time 0.242688 [01/19/2021-17:50:41] [V] [TRT] Fastest Tactic: 0 Time: 0.050176 [01/19/2021-17:50:41] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D (CudaDepthwiseConvolution) [01/19/2021-17:50:41] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 31 [01/19/2021-17:50:41] [V] [TRT] [01/19/2021-17:50:41] [V] [TRT] *************** Autotuning format combination: Float(1,10,100,16000) -> Float(1,10,100,96000) *************** [01/19/2021-17:50:41] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:41] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:41] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:41] [V] [TRT] Tactic: 8 time 0.044032 [01/19/2021-17:50:41] [V] [TRT] Tactic: 9 time 0.036864 [01/19/2021-17:50:41] [V] [TRT] Tactic: 11 time 0.022528 [01/19/2021-17:50:41] [V] [TRT] Tactic: 12 time 0.023552 [01/19/2021-17:50:41] [V] [TRT] Tactic: 17 time 0.0256 [01/19/2021-17:50:41] [V] [TRT] Tactic: 19 time 0.06656 [01/19/2021-17:50:41] [V] [TRT] Tactic: 20 time 0.031744 [01/19/2021-17:50:41] [V] [TRT] Tactic: 21 time 0.0256 [01/19/2021-17:50:41] [V] [TRT] Tactic: 22 time 0.0256 [01/19/2021-17:50:41] [V] [TRT] Tactic: 24 time 0.0256 [01/19/2021-17:50:41] [V] [TRT] Tactic: 27 time 0.024576 [01/19/2021-17:50:41] [V] [TRT] Tactic: 28 time 0.033792 [01/19/2021-17:50:41] [V] [TRT] Tactic: 31 time 0.033792 [01/19/2021-17:50:41] [V] [TRT] Tactic: 32 time 0.031744 [01/19/2021-17:50:41] [V] [TRT] Tactic: 34 time 0.031744 [01/19/2021-17:50:41] [V] [TRT] Tactic: 35 time 0.023552 [01/19/2021-17:50:41] [V] [TRT] Tactic: 40 time 0.029696 [01/19/2021-17:50:41] [V] [TRT] Tactic: 46 time 0.03072 [01/19/2021-17:50:41] [V] [TRT] Tactic: 50 time 0.0256 [01/19/2021-17:50:41] [V] [TRT] Tactic: 51 time 0.0256 [01/19/2021-17:50:41] [V] [TRT] Tactic: 53 time 0.024576 [01/19/2021-17:50:41] [V] [TRT] Tactic: 55 time 0.0512 [01/19/2021-17:50:41] [V] [TRT] Tactic: 59 time 0.029696 [01/19/2021-17:50:41] [V] [TRT] Tactic: 60 time 0.024576 [01/19/2021-17:50:41] [V] [TRT] Tactic: 61 time 0.028672 [01/19/2021-17:50:41] [V] [TRT] Tactic: 63 time 0.03584 [01/19/2021-17:50:41] [V] [TRT] Tactic: 64 time 0.036864 [01/19/2021-17:50:41] [V] [TRT] Tactic: 65 time 0.024576 [01/19/2021-17:50:41] [V] [TRT] Tactic: 68 time 0.03072 [01/19/2021-17:50:41] [V] [TRT] Tactic: 69 time 0.039936 [01/19/2021-17:50:41] [V] [TRT] Tactic: 70 time 0.031744 [01/19/2021-17:50:41] [V] [TRT] Tactic: 74 time 0.032768 [01/19/2021-17:50:41] [V] [TRT] Tactic: 75 time 0.0256 [01/19/2021-17:50:41] [V] [TRT] Tactic: 78 time 0.024576 [01/19/2021-17:50:41] [V] [TRT] Tactic: 79 time 0.023552 [01/19/2021-17:50:41] [V] [TRT] Tactic: 81 time 0.026624 [01/19/2021-17:50:41] [V] [TRT] Tactic: 82 time 0.033792 [01/19/2021-17:50:41] [V] [TRT] Tactic: 84 time 0.03072 [01/19/2021-17:50:41] [V] [TRT] Tactic: 85 time 0.028672 [01/19/2021-17:50:41] [V] [TRT] Tactic: 86 time 0.03072 [01/19/2021-17:50:41] [V] [TRT] Tactic: 87 time 0.038912 [01/19/2021-17:50:41] [V] [TRT] Tactic: 88 time 0.0256 [01/19/2021-17:50:41] [V] [TRT] Tactic: 89 time 0.023552 [01/19/2021-17:50:41] [V] [TRT] Tactic: 91 time 0.029696 [01/19/2021-17:50:41] [V] [TRT] Tactic: 94 time 0.023552 [01/19/2021-17:50:41] [V] [TRT] Tactic: 95 time 0.0256 [01/19/2021-17:50:41] [V] [TRT] Tactic: 97 time 0.026624 [01/19/2021-17:50:41] [V] [TRT] Tactic: 102 time 0.03072 [01/19/2021-17:50:41] [V] [TRT] Tactic: 103 time 0.024576 [01/19/2021-17:50:41] [V] [TRT] Tactic: 105 time 0.036864 [01/19/2021-17:50:41] [V] [TRT] Tactic: 106 time 0.033792 [01/19/2021-17:50:41] [V] [TRT] Tactic: 107 time 0.024576 [01/19/2021-17:50:41] [V] [TRT] Tactic: 108 time 0.041984 [01/19/2021-17:50:41] [V] [TRT] Tactic: 109 time 0.0256 [01/19/2021-17:50:41] [V] [TRT] Tactic: 111 time 0.023552 [01/19/2021-17:50:41] [V] [TRT] Tactic: 112 time 0.0256 [01/19/2021-17:50:41] [V] [TRT] Tactic: 114 time 0.027648 [01/19/2021-17:50:41] [V] [TRT] Tactic: 115 time 0.035712 [01/19/2021-17:50:41] [V] [TRT] Tactic: 117 time 0.024576 [01/19/2021-17:50:41] [V] [TRT] Tactic: 118 time 0.022528 [01/19/2021-17:50:41] [V] [TRT] Tactic: 124 time 0.036864 [01/19/2021-17:50:41] [V] [TRT] Tactic: 125 time 0.033792 [01/19/2021-17:50:42] [V] [TRT] Tactic: 126 time 0.033792 [01/19/2021-17:50:42] [V] [TRT] Tactic: 131 time 0.034816 [01/19/2021-17:50:42] [V] [TRT] Tactic: 132 time 0.024576 [01/19/2021-17:50:42] [V] [TRT] Tactic: 138 time 0.033792 [01/19/2021-17:50:42] [V] [TRT] Tactic: 145 time 0.032768 [01/19/2021-17:50:42] [V] [TRT] Tactic: 150 time 0.036864 [01/19/2021-17:50:42] [V] [TRT] Tactic: 155 time 0.029568 [01/19/2021-17:50:42] [V] [TRT] Tactic: 157 time 0.034816 [01/19/2021-17:50:42] [V] [TRT] Tactic: 160 time 0.026624 [01/19/2021-17:50:42] [V] [TRT] Tactic: 163 time 0.024576 [01/19/2021-17:50:42] [V] [TRT] Tactic: 166 time 0.0256 [01/19/2021-17:50:42] [V] [TRT] Fastest Tactic: 11 Time: 0.022528 [01/19/2021-17:50:42] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6 (CaskConvolution) [01/19/2021-17:50:42] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:42] [V] [TRT] Tactic: 1062367460111450758 time 0.021504 [01/19/2021-17:50:42] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:42] [V] [TRT] Tactic: 4501471010995462441 time 0.021504 [01/19/2021-17:50:42] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:42] [V] [TRT] Tactic: 5137655947464784826 time 0.016384 [01/19/2021-17:50:42] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:42] [V] [TRT] Tactic: 5326823351883942011 time 0.02048 [01/19/2021-17:50:42] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:42] [V] [TRT] Tactic: 6645123197870846056 time 0.017408 [01/19/2021-17:50:42] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:42] [V] [TRT] Tactic: -6576203419454146580 time 0.018432 [01/19/2021-17:50:42] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:42] [V] [TRT] Tactic: -3456450830548107839 time 0.018432 [01/19/2021-17:50:42] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:42] [V] [TRT] Tactic: -410470605513481746 time 0.02048 [01/19/2021-17:50:42] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:42] [V] [TRT] Tactic: -37215280111360163 time 0.016384 [01/19/2021-17:50:42] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.016384 [01/19/2021-17:50:42] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6 (CudaConvolution) [01/19/2021-17:50:42] [V] [TRT] Tactic: 0 time 0.031744 [01/19/2021-17:50:42] [V] [TRT] Tactic: 1 time 0.032768 [01/19/2021-17:50:42] [V] [TRT] Tactic: 2 time 0.065536 [01/19/2021-17:50:42] [V] [TRT] Tactic: 4 skipped. Scratch requested: 354877440, available: 16777216 [01/19/2021-17:50:42] [V] [TRT] Tactic: 5 skipped. Scratch requested: 22413312, available: 16777216 [01/19/2021-17:50:42] [V] [TRT] Fastest Tactic: 0 Time: 0.031744 [01/19/2021-17:50:42] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:42] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5137655947464784826 [01/19/2021-17:50:42] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:42] [V] [TRT] [01/19/2021-17:50:42] [V] [TRT] *************** Autotuning format combination: Float(1,10,100,96000) -> Float(1,10,100,96000) *************** [01/19/2021-17:50:42] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:42] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:42] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:42] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:42] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6 (CaskConvolution) [01/19/2021-17:50:42] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:42] [V] [TRT] Tactic: 1062367460111450758 time 7.47622 [01/19/2021-17:50:42] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [01/19/2021-17:50:42] [V] [TRT] Tactic: 4337000649858996379 time 6.62221 [01/19/2021-17:50:42] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:42] [V] [TRT] Tactic: 4501471010995462441 time 7.13421 [01/19/2021-17:50:42] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:42] [V] [TRT] Tactic: 5137655947464784826 time 6.25357 [01/19/2021-17:50:42] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:42] [V] [TRT] Tactic: 6645123197870846056 time 6.43174 [01/19/2021-17:50:42] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [01/19/2021-17:50:42] [V] [TRT] Tactic: -9137461792520977713 time 6.90688 [01/19/2021-17:50:42] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [01/19/2021-17:50:42] [V] [TRT] Tactic: -6092040395344634144 time 7.67488 [01/19/2021-17:50:42] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:42] [V] [TRT] Tactic: -3456450830548107839 time 6.86384 [01/19/2021-17:50:42] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:42] [V] [TRT] Tactic: -410470605513481746 time 6.89459 [01/19/2021-17:50:42] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 6.25357 [01/19/2021-17:50:42] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6 (CudaConvolution) [01/19/2021-17:50:42] [V] [TRT] Tactic: 0 time 0.019456 [01/19/2021-17:50:42] [V] [TRT] Tactic: 1 time 4.2711 [01/19/2021-17:50:42] [V] [TRT] Tactic: 2 time 9.87933 [01/19/2021-17:50:42] [V] [TRT] Tactic: 4 time 19.2481 [01/19/2021-17:50:42] [V] [TRT] Tactic: 5 time 33.2042 [01/19/2021-17:50:42] [V] [TRT] Tactic: 6 time 7.72608 [01/19/2021-17:50:42] [V] [TRT] Fastest Tactic: 0 Time: 0.019456 [01/19/2021-17:50:42] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:42] [V] [TRT] Tactic: -1 time 0.01536 [01/19/2021-17:50:42] [V] [TRT] Fastest Tactic: -1 Time: 0.01536 [01/19/2021-17:50:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [01/19/2021-17:50:42] [V] [TRT] [01/19/2021-17:50:42] [V] [TRT] *************** Autotuning format combination: Float(1,10,100,96000), Float(1,10,100,16000) -> Float(1,10,100,16000) *************** [01/19/2021-17:50:42] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add (LegacySASSConvolution) [01/19/2021-17:50:42] [V] [TRT] Tactic: 0 time 0.1024 [01/19/2021-17:50:42] [V] [TRT] Fastest Tactic: 0 Time: 0.1024 [01/19/2021-17:50:42] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add (CaskConvolution) [01/19/2021-17:50:42] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:42] [V] [TRT] Tactic: 1062367460111450758 time 0.088064 [01/19/2021-17:50:42] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:42] [V] [TRT] Tactic: 4501471010995462441 time 0.08704 [01/19/2021-17:50:42] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:42] [V] [TRT] Tactic: 5137655947464784826 time 0.059392 [01/19/2021-17:50:42] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:42] [V] [TRT] Tactic: 5326823351883942011 time 0.088064 [01/19/2021-17:50:42] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:42] [V] [TRT] Tactic: 6645123197870846056 time 0.064512 [01/19/2021-17:50:42] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:42] [V] [TRT] Tactic: -6576203419454146580 time 0.06656 [01/19/2021-17:50:42] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:42] [V] [TRT] Tactic: -3456450830548107839 time 0.070656 [01/19/2021-17:50:42] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:42] [V] [TRT] Tactic: -410470605513481746 time 0.083968 [01/19/2021-17:50:42] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:42] [V] [TRT] Tactic: -37215280111360163 time 0.058368 [01/19/2021-17:50:42] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.058368 [01/19/2021-17:50:42] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add (CudaConvolution) [01/19/2021-17:50:42] [V] [TRT] Tactic: 0 time 0.079872 [01/19/2021-17:50:42] [V] [TRT] Tactic: 1 time 0.10752 [01/19/2021-17:50:42] [V] [TRT] Tactic: 2 time 0.104448 [01/19/2021-17:50:42] [V] [TRT] Tactic: 4 skipped. Scratch requested: 356720640, available: 16777216 [01/19/2021-17:50:42] [V] [TRT] Tactic: 5 skipped. Scratch requested: 22413312, available: 16777216 [01/19/2021-17:50:42] [V] [TRT] Fastest Tactic: 0 Time: 0.079872 [01/19/2021-17:50:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163 [01/19/2021-17:50:42] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:42] [V] [TRT] [01/19/2021-17:50:42] [V] [TRT] *************** Autotuning format combination: Float(1,10,100,16000) -> Float(1,10,100,96000) *************** [01/19/2021-17:50:42] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:42] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:42] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:42] [V] [TRT] Tactic: 8 time 0.044032 [01/19/2021-17:50:42] [V] [TRT] Tactic: 9 time 0.036864 [01/19/2021-17:50:42] [V] [TRT] Tactic: 11 time 0.022528 [01/19/2021-17:50:42] [V] [TRT] Tactic: 12 time 0.024576 [01/19/2021-17:50:42] [V] [TRT] Tactic: 17 time 0.026624 [01/19/2021-17:50:42] [V] [TRT] Tactic: 19 time 0.067584 [01/19/2021-17:50:42] [V] [TRT] Tactic: 20 time 0.031744 [01/19/2021-17:50:42] [V] [TRT] Tactic: 21 time 0.0256 [01/19/2021-17:50:42] [V] [TRT] Tactic: 22 time 0.0256 [01/19/2021-17:50:42] [V] [TRT] Tactic: 24 time 0.0256 [01/19/2021-17:50:42] [V] [TRT] Tactic: 27 time 0.024576 [01/19/2021-17:50:42] [V] [TRT] Tactic: 28 time 0.033792 [01/19/2021-17:50:42] [V] [TRT] Tactic: 31 time 0.033792 [01/19/2021-17:50:42] [V] [TRT] Tactic: 32 time 0.031744 [01/19/2021-17:50:42] [V] [TRT] Tactic: 34 time 0.031744 [01/19/2021-17:50:42] [V] [TRT] Tactic: 35 time 0.023552 [01/19/2021-17:50:42] [V] [TRT] Tactic: 40 time 0.029696 [01/19/2021-17:50:42] [V] [TRT] Tactic: 46 time 0.028672 [01/19/2021-17:50:42] [V] [TRT] Tactic: 50 time 0.024576 [01/19/2021-17:50:42] [V] [TRT] Tactic: 51 time 0.0256 [01/19/2021-17:50:42] [V] [TRT] Tactic: 53 time 0.024576 [01/19/2021-17:50:42] [V] [TRT] Tactic: 55 time 0.0512 [01/19/2021-17:50:42] [V] [TRT] Tactic: 59 time 0.029696 [01/19/2021-17:50:42] [V] [TRT] Tactic: 60 time 0.024576 [01/19/2021-17:50:42] [V] [TRT] Tactic: 61 time 0.028672 [01/19/2021-17:50:42] [V] [TRT] Tactic: 63 time 0.036864 [01/19/2021-17:50:42] [V] [TRT] Tactic: 64 time 0.036864 [01/19/2021-17:50:42] [V] [TRT] Tactic: 65 time 0.024576 [01/19/2021-17:50:42] [V] [TRT] Tactic: 68 time 0.031744 [01/19/2021-17:50:42] [V] [TRT] Tactic: 69 time 0.04096 [01/19/2021-17:50:42] [V] [TRT] Tactic: 70 time 0.031744 [01/19/2021-17:50:42] [V] [TRT] Tactic: 74 time 0.032768 [01/19/2021-17:50:42] [V] [TRT] Tactic: 75 time 0.0256 [01/19/2021-17:50:42] [V] [TRT] Tactic: 78 time 0.024576 [01/19/2021-17:50:42] [V] [TRT] Tactic: 79 time 0.023552 [01/19/2021-17:50:42] [V] [TRT] Tactic: 81 time 0.026624 [01/19/2021-17:50:42] [V] [TRT] Tactic: 82 time 0.033792 [01/19/2021-17:50:42] [V] [TRT] Tactic: 84 time 0.029696 [01/19/2021-17:50:42] [V] [TRT] Tactic: 85 time 0.028672 [01/19/2021-17:50:42] [V] [TRT] Tactic: 86 time 0.03072 [01/19/2021-17:50:42] [V] [TRT] Tactic: 87 time 0.038912 [01/19/2021-17:50:42] [V] [TRT] Tactic: 88 time 0.0256 [01/19/2021-17:50:42] [V] [TRT] Tactic: 89 time 0.023552 [01/19/2021-17:50:42] [V] [TRT] Tactic: 91 time 0.028672 [01/19/2021-17:50:42] [V] [TRT] Tactic: 94 time 0.023552 [01/19/2021-17:50:42] [V] [TRT] Tactic: 95 time 0.026624 [01/19/2021-17:50:42] [V] [TRT] Tactic: 97 time 0.026624 [01/19/2021-17:50:42] [V] [TRT] Tactic: 102 time 0.029696 [01/19/2021-17:50:42] [V] [TRT] Tactic: 103 time 0.024576 [01/19/2021-17:50:42] [V] [TRT] Tactic: 105 time 0.036864 [01/19/2021-17:50:42] [V] [TRT] Tactic: 106 time 0.033792 [01/19/2021-17:50:42] [V] [TRT] Tactic: 107 time 0.024576 [01/19/2021-17:50:42] [V] [TRT] Tactic: 108 time 0.04096 [01/19/2021-17:50:42] [V] [TRT] Tactic: 109 time 0.026624 [01/19/2021-17:50:42] [V] [TRT] Tactic: 111 time 0.023552 [01/19/2021-17:50:42] [V] [TRT] Tactic: 112 time 0.026624 [01/19/2021-17:50:42] [V] [TRT] Tactic: 114 time 0.028672 [01/19/2021-17:50:42] [V] [TRT] Tactic: 115 time 0.03584 [01/19/2021-17:50:42] [V] [TRT] Tactic: 117 time 0.024576 [01/19/2021-17:50:42] [V] [TRT] Tactic: 118 time 0.022528 [01/19/2021-17:50:42] [V] [TRT] Tactic: 124 time 0.036864 [01/19/2021-17:50:42] [V] [TRT] Tactic: 125 time 0.033792 [01/19/2021-17:50:42] [V] [TRT] Tactic: 126 time 0.033792 [01/19/2021-17:50:42] [V] [TRT] Tactic: 131 time 0.034816 [01/19/2021-17:50:42] [V] [TRT] Tactic: 132 time 0.023552 [01/19/2021-17:50:42] [V] [TRT] Tactic: 138 time 0.033792 [01/19/2021-17:50:42] [V] [TRT] Tactic: 145 time 0.032768 [01/19/2021-17:50:42] [V] [TRT] Tactic: 150 time 0.03584 [01/19/2021-17:50:42] [V] [TRT] Tactic: 155 time 0.029696 [01/19/2021-17:50:42] [V] [TRT] Tactic: 157 time 0.034816 [01/19/2021-17:50:42] [V] [TRT] Tactic: 160 time 0.0256 [01/19/2021-17:50:43] [V] [TRT] Tactic: 163 time 0.023552 [01/19/2021-17:50:43] [V] [TRT] Tactic: 166 time 0.0256 [01/19/2021-17:50:43] [V] [TRT] Fastest Tactic: 11 Time: 0.022528 [01/19/2021-17:50:43] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Relu6 (CaskConvolution) [01/19/2021-17:50:43] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:43] [V] [TRT] Tactic: 1062367460111450758 time 0.021504 [01/19/2021-17:50:43] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:43] [V] [TRT] Tactic: 4501471010995462441 time 0.021504 [01/19/2021-17:50:43] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:43] [V] [TRT] Tactic: 5137655947464784826 time 0.016384 [01/19/2021-17:50:43] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:43] [V] [TRT] Tactic: 5326823351883942011 time 0.02048 [01/19/2021-17:50:43] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:43] [V] [TRT] Tactic: 6645123197870846056 time 0.017408 [01/19/2021-17:50:43] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:43] [V] [TRT] Tactic: -6576203419454146580 time 0.018432 [01/19/2021-17:50:43] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:43] [V] [TRT] Tactic: -3456450830548107839 time 0.019456 [01/19/2021-17:50:43] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:43] [V] [TRT] Tactic: -410470605513481746 time 0.02048 [01/19/2021-17:50:43] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:43] [V] [TRT] Tactic: -37215280111360163 time 0.016384 [01/19/2021-17:50:43] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.016384 [01/19/2021-17:50:43] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Relu6 (CudaConvolution) [01/19/2021-17:50:43] [V] [TRT] Tactic: 0 time 0.031744 [01/19/2021-17:50:43] [V] [TRT] Tactic: 1 time 0.032768 [01/19/2021-17:50:43] [V] [TRT] Tactic: 2 time 0.065536 [01/19/2021-17:50:43] [V] [TRT] Tactic: 4 skipped. Scratch requested: 354877440, available: 16777216 [01/19/2021-17:50:43] [V] [TRT] Tactic: 5 skipped. Scratch requested: 22413312, available: 16777216 [01/19/2021-17:50:43] [V] [TRT] Fastest Tactic: 0 Time: 0.031744 [01/19/2021-17:50:43] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:43] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5137655947464784826 [01/19/2021-17:50:43] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:43] [V] [TRT] [01/19/2021-17:50:43] [V] [TRT] *************** Autotuning format combination: Float(1,10,100,96000) -> Float(1,10,100,96000) *************** [01/19/2021-17:50:43] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:43] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:43] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:43] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:43] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/Relu6 (CaskConvolution) [01/19/2021-17:50:43] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:43] [V] [TRT] Tactic: 1062367460111450758 time 7.28474 [01/19/2021-17:50:43] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [01/19/2021-17:50:43] [V] [TRT] Tactic: 4337000649858996379 time 6.62426 [01/19/2021-17:50:43] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:43] [V] [TRT] Tactic: 4501471010995462441 time 6.96525 [01/19/2021-17:50:43] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:43] [V] [TRT] Tactic: 5137655947464784826 time 6.25357 [01/19/2021-17:50:43] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:43] [V] [TRT] Tactic: 6645123197870846056 time 6.52186 [01/19/2021-17:50:43] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [01/19/2021-17:50:43] [V] [TRT] Tactic: -9137461792520977713 time 7.01747 [01/19/2021-17:50:43] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [01/19/2021-17:50:43] [V] [TRT] Tactic: -6092040395344634144 time 7.424 [01/19/2021-17:50:43] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:43] [V] [TRT] Tactic: -3456450830548107839 time 6.7287 [01/19/2021-17:50:43] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:43] [V] [TRT] Tactic: -410470605513481746 time 6.77478 [01/19/2021-17:50:43] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 6.25357 [01/19/2021-17:50:43] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/Relu6 (CudaConvolution) [01/19/2021-17:50:43] [V] [TRT] Tactic: 0 time 0.019456 [01/19/2021-17:50:43] [V] [TRT] Tactic: 1 time 4.89472 [01/19/2021-17:50:43] [V] [TRT] Tactic: 2 time 9.93363 [01/19/2021-17:50:43] [V] [TRT] Tactic: 4 time 19.2807 [01/19/2021-17:50:43] [V] [TRT] Tactic: 5 time 33.0711 [01/19/2021-17:50:43] [V] [TRT] Tactic: 6 time 7.18643 [01/19/2021-17:50:43] [V] [TRT] Fastest Tactic: 0 Time: 0.019456 [01/19/2021-17:50:43] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:43] [V] [TRT] Tactic: -1 time 0.01536 [01/19/2021-17:50:43] [V] [TRT] Fastest Tactic: -1 Time: 0.01536 [01/19/2021-17:50:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [01/19/2021-17:50:43] [V] [TRT] [01/19/2021-17:50:43] [V] [TRT] *************** Autotuning format combination: Float(1,10,100,96000), Float(1,10,100,16000) -> Float(1,10,100,16000) *************** [01/19/2021-17:50:43] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_15/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/add (LegacySASSConvolution) [01/19/2021-17:50:43] [V] [TRT] Tactic: 0 time 0.1024 [01/19/2021-17:50:43] [V] [TRT] Fastest Tactic: 0 Time: 0.1024 [01/19/2021-17:50:43] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_15/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/add (CaskConvolution) [01/19/2021-17:50:43] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_15/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:43] [V] [TRT] Tactic: 1062367460111450758 time 0.088064 [01/19/2021-17:50:43] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_15/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:43] [V] [TRT] Tactic: 4501471010995462441 time 0.088064 [01/19/2021-17:50:43] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_15/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:43] [V] [TRT] Tactic: 5137655947464784826 time 0.060416 [01/19/2021-17:50:43] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_15/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:43] [V] [TRT] Tactic: 5326823351883942011 time 0.084992 [01/19/2021-17:50:43] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_15/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:43] [V] [TRT] Tactic: 6645123197870846056 time 0.065536 [01/19/2021-17:50:43] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_15/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:43] [V] [TRT] Tactic: -6576203419454146580 time 0.065536 [01/19/2021-17:50:43] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_15/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:43] [V] [TRT] Tactic: -3456450830548107839 time 0.070656 [01/19/2021-17:50:43] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_15/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/add (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:43] [V] [TRT] Tactic: -410470605513481746 time 0.083968 [01/19/2021-17:50:43] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_15/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:43] [V] [TRT] Tactic: -37215280111360163 time 0.058368 [01/19/2021-17:50:43] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.058368 [01/19/2021-17:50:43] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_15/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/add (CudaConvolution) [01/19/2021-17:50:43] [V] [TRT] Tactic: 0 time 0.079872 [01/19/2021-17:50:43] [V] [TRT] Tactic: 1 time 0.10752 [01/19/2021-17:50:43] [V] [TRT] Tactic: 2 time 0.105472 [01/19/2021-17:50:43] [V] [TRT] Tactic: 4 skipped. Scratch requested: 356720640, available: 16777216 [01/19/2021-17:50:43] [V] [TRT] Tactic: 5 skipped. Scratch requested: 22413312, available: 16777216 [01/19/2021-17:50:43] [V] [TRT] Fastest Tactic: 0 Time: 0.079872 [01/19/2021-17:50:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163 [01/19/2021-17:50:43] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_15/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:43] [V] [TRT] [01/19/2021-17:50:43] [V] [TRT] *************** Autotuning format combination: Float(1,10,100,16000) -> Float(1,10,100,96000) *************** [01/19/2021-17:50:43] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:43] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:43] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:43] [V] [TRT] Tactic: 8 time 0.044032 [01/19/2021-17:50:43] [V] [TRT] Tactic: 9 time 0.037888 [01/19/2021-17:50:43] [V] [TRT] Tactic: 11 time 0.022528 [01/19/2021-17:50:43] [V] [TRT] Tactic: 12 time 0.024512 [01/19/2021-17:50:43] [V] [TRT] Tactic: 17 time 0.0256 [01/19/2021-17:50:43] [V] [TRT] Tactic: 19 time 0.06656 [01/19/2021-17:50:43] [V] [TRT] Tactic: 20 time 0.031744 [01/19/2021-17:50:43] [V] [TRT] Tactic: 21 time 0.0256 [01/19/2021-17:50:43] [V] [TRT] Tactic: 22 time 0.026624 [01/19/2021-17:50:43] [V] [TRT] Tactic: 24 time 0.0256 [01/19/2021-17:50:43] [V] [TRT] Tactic: 27 time 0.024576 [01/19/2021-17:50:43] [V] [TRT] Tactic: 28 time 0.033792 [01/19/2021-17:50:43] [V] [TRT] Tactic: 31 time 0.033792 [01/19/2021-17:50:43] [V] [TRT] Tactic: 32 time 0.031744 [01/19/2021-17:50:43] [V] [TRT] Tactic: 34 time 0.031744 [01/19/2021-17:50:43] [V] [TRT] Tactic: 35 time 0.023552 [01/19/2021-17:50:43] [V] [TRT] Tactic: 40 time 0.029696 [01/19/2021-17:50:43] [V] [TRT] Tactic: 46 time 0.028672 [01/19/2021-17:50:43] [V] [TRT] Tactic: 50 time 0.0256 [01/19/2021-17:50:43] [V] [TRT] Tactic: 51 time 0.0256 [01/19/2021-17:50:43] [V] [TRT] Tactic: 53 time 0.0256 [01/19/2021-17:50:43] [V] [TRT] Tactic: 55 time 0.050176 [01/19/2021-17:50:43] [V] [TRT] Tactic: 59 time 0.029696 [01/19/2021-17:50:43] [V] [TRT] Tactic: 60 time 0.024576 [01/19/2021-17:50:43] [V] [TRT] Tactic: 61 time 0.0296 [01/19/2021-17:50:43] [V] [TRT] Tactic: 63 time 0.03584 [01/19/2021-17:50:43] [V] [TRT] Tactic: 64 time 0.036864 [01/19/2021-17:50:43] [V] [TRT] Tactic: 65 time 0.024576 [01/19/2021-17:50:43] [V] [TRT] Tactic: 68 time 0.03072 [01/19/2021-17:50:43] [V] [TRT] Tactic: 69 time 0.04096 [01/19/2021-17:50:43] [V] [TRT] Tactic: 70 time 0.031744 [01/19/2021-17:50:43] [V] [TRT] Tactic: 74 time 0.033792 [01/19/2021-17:50:43] [V] [TRT] Tactic: 75 time 0.0256 [01/19/2021-17:50:43] [V] [TRT] Tactic: 78 time 0.024576 [01/19/2021-17:50:43] [V] [TRT] Tactic: 79 time 0.023552 [01/19/2021-17:50:43] [V] [TRT] Tactic: 81 time 0.026624 [01/19/2021-17:50:43] [V] [TRT] Tactic: 82 time 0.033792 [01/19/2021-17:50:43] [V] [TRT] Tactic: 84 time 0.029696 [01/19/2021-17:50:43] [V] [TRT] Tactic: 85 time 0.028672 [01/19/2021-17:50:43] [V] [TRT] Tactic: 86 time 0.031744 [01/19/2021-17:50:43] [V] [TRT] Tactic: 87 time 0.038912 [01/19/2021-17:50:43] [V] [TRT] Tactic: 88 time 0.024576 [01/19/2021-17:50:43] [V] [TRT] Tactic: 89 time 0.023552 [01/19/2021-17:50:43] [V] [TRT] Tactic: 91 time 0.029696 [01/19/2021-17:50:43] [V] [TRT] Tactic: 94 time 0.023424 [01/19/2021-17:50:43] [V] [TRT] Tactic: 95 time 0.0256 [01/19/2021-17:50:43] [V] [TRT] Tactic: 97 time 0.0256 [01/19/2021-17:50:43] [V] [TRT] Tactic: 102 time 0.03072 [01/19/2021-17:50:43] [V] [TRT] Tactic: 103 time 0.024576 [01/19/2021-17:50:43] [V] [TRT] Tactic: 105 time 0.037888 [01/19/2021-17:50:43] [V] [TRT] Tactic: 106 time 0.033792 [01/19/2021-17:50:43] [V] [TRT] Tactic: 107 time 0.024576 [01/19/2021-17:50:43] [V] [TRT] Tactic: 108 time 0.04096 [01/19/2021-17:50:43] [V] [TRT] Tactic: 109 time 0.024576 [01/19/2021-17:50:43] [V] [TRT] Tactic: 111 time 0.023552 [01/19/2021-17:50:43] [V] [TRT] Tactic: 112 time 0.026624 [01/19/2021-17:50:43] [V] [TRT] Tactic: 114 time 0.028672 [01/19/2021-17:50:43] [V] [TRT] Tactic: 115 time 0.03584 [01/19/2021-17:50:43] [V] [TRT] Tactic: 117 time 0.024576 [01/19/2021-17:50:43] [V] [TRT] Tactic: 118 time 0.022528 [01/19/2021-17:50:43] [V] [TRT] Tactic: 124 time 0.036864 [01/19/2021-17:50:43] [V] [TRT] Tactic: 125 time 0.033792 [01/19/2021-17:50:43] [V] [TRT] Tactic: 126 time 0.033792 [01/19/2021-17:50:43] [V] [TRT] Tactic: 131 time 0.03584 [01/19/2021-17:50:43] [V] [TRT] Tactic: 132 time 0.023552 [01/19/2021-17:50:43] [V] [TRT] Tactic: 138 time 0.033792 [01/19/2021-17:50:43] [V] [TRT] Tactic: 145 time 0.032768 [01/19/2021-17:50:43] [V] [TRT] Tactic: 150 time 0.03584 [01/19/2021-17:50:43] [V] [TRT] Tactic: 155 time 0.029696 [01/19/2021-17:50:43] [V] [TRT] Tactic: 157 time 0.034816 [01/19/2021-17:50:43] [V] [TRT] Tactic: 160 time 0.026624 [01/19/2021-17:50:43] [V] [TRT] Tactic: 163 time 0.023552 [01/19/2021-17:50:43] [V] [TRT] Tactic: 166 time 0.0256 [01/19/2021-17:50:43] [V] [TRT] Fastest Tactic: 11 Time: 0.022528 [01/19/2021-17:50:43] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Relu6 (CaskConvolution) [01/19/2021-17:50:43] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:43] [V] [TRT] Tactic: 1062367460111450758 time 0.021504 [01/19/2021-17:50:43] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:43] [V] [TRT] Tactic: 4501471010995462441 time 0.021504 [01/19/2021-17:50:43] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:43] [V] [TRT] Tactic: 5137655947464784826 time 0.016384 [01/19/2021-17:50:43] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:43] [V] [TRT] Tactic: 5326823351883942011 time 0.02048 [01/19/2021-17:50:43] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:43] [V] [TRT] Tactic: 6645123197870846056 time 0.018432 [01/19/2021-17:50:43] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:43] [V] [TRT] Tactic: -6576203419454146580 time 0.018432 [01/19/2021-17:50:43] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:43] [V] [TRT] Tactic: -3456450830548107839 time 0.018432 [01/19/2021-17:50:43] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:43] [V] [TRT] Tactic: -410470605513481746 time 0.02048 [01/19/2021-17:50:43] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:44] [V] [TRT] Tactic: -37215280111360163 time 0.016384 [01/19/2021-17:50:44] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.016384 [01/19/2021-17:50:44] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Relu6 (CudaConvolution) [01/19/2021-17:50:44] [V] [TRT] Tactic: 0 time 0.031744 [01/19/2021-17:50:44] [V] [TRT] Tactic: 1 time 0.032768 [01/19/2021-17:50:44] [V] [TRT] Tactic: 2 time 0.06656 [01/19/2021-17:50:44] [V] [TRT] Tactic: 4 skipped. Scratch requested: 354877440, available: 16777216 [01/19/2021-17:50:44] [V] [TRT] Tactic: 5 skipped. Scratch requested: 22413312, available: 16777216 [01/19/2021-17:50:44] [V] [TRT] Fastest Tactic: 0 Time: 0.031744 [01/19/2021-17:50:44] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:44] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5137655947464784826 [01/19/2021-17:50:44] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:44] [V] [TRT] [01/19/2021-17:50:44] [V] [TRT] *************** Autotuning format combination: Float(1,10,100,96000) -> Float(1,10,100,96000) *************** [01/19/2021-17:50:44] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:44] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:44] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:44] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:44] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/Relu6 (CaskConvolution) [01/19/2021-17:50:44] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:44] [V] [TRT] Tactic: 1062367460111450758 time 7.42912 [01/19/2021-17:50:44] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [01/19/2021-17:50:44] [V] [TRT] Tactic: 4337000649858996379 time 6.62323 [01/19/2021-17:50:44] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:44] [V] [TRT] Tactic: 4501471010995462441 time 6.95296 [01/19/2021-17:50:44] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:44] [V] [TRT] Tactic: 5137655947464784826 time 6.26074 [01/19/2021-17:50:44] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:44] [V] [TRT] Tactic: 6645123197870846056 time 6.51674 [01/19/2021-17:50:44] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [01/19/2021-17:50:44] [V] [TRT] Tactic: -9137461792520977713 time 6.90278 [01/19/2021-17:50:44] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [01/19/2021-17:50:44] [V] [TRT] Tactic: -6092040395344634144 time 7.4967 [01/19/2021-17:50:44] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:44] [V] [TRT] Tactic: -3456450830548107839 time 6.67837 [01/19/2021-17:50:44] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:44] [V] [TRT] Tactic: -410470605513481746 time 7.06355 [01/19/2021-17:50:44] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 6.26074 [01/19/2021-17:50:44] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/Relu6 (CudaConvolution) [01/19/2021-17:50:44] [V] [TRT] Tactic: 0 time 0.019456 [01/19/2021-17:50:44] [V] [TRT] Tactic: 1 time 4.77594 [01/19/2021-17:50:44] [V] [TRT] Tactic: 2 time 10.0301 [01/19/2021-17:50:44] [V] [TRT] Tactic: 4 time 19.3311 [01/19/2021-17:50:44] [V] [TRT] Tactic: 5 time 33.11 [01/19/2021-17:50:44] [V] [TRT] Tactic: 6 time 6.92634 [01/19/2021-17:50:44] [V] [TRT] Fastest Tactic: 0 Time: 0.019456 [01/19/2021-17:50:44] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:44] [V] [TRT] Tactic: -1 time 0.01536 [01/19/2021-17:50:44] [V] [TRT] Fastest Tactic: -1 Time: 0.01536 [01/19/2021-17:50:44] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [01/19/2021-17:50:44] [V] [TRT] [01/19/2021-17:50:44] [V] [TRT] *************** Autotuning format combination: Float(1,10,100,96000) -> Float(1,10,100,32000) *************** [01/19/2021-17:50:44] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D (LegacySASSConvolution) [01/19/2021-17:50:44] [V] [TRT] Tactic: 0 time 0.101376 [01/19/2021-17:50:44] [V] [TRT] Fastest Tactic: 0 Time: 0.101376 [01/19/2021-17:50:44] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D (FusedConvActConvolution) [01/19/2021-17:50:44] [V] [TRT] Tactic: 8 time 0.191488 [01/19/2021-17:50:44] [V] [TRT] Tactic: 9 time 0.119808 [01/19/2021-17:50:44] [V] [TRT] Tactic: 11 time 0.050176 [01/19/2021-17:50:44] [V] [TRT] Tactic: 12 time 0.043008 [01/19/2021-17:50:44] [V] [TRT] Tactic: 17 time 0.044032 [01/19/2021-17:50:44] [V] [TRT] Tactic: 19 time 0.224256 [01/19/2021-17:50:44] [V] [TRT] Tactic: 20 time 0.131072 [01/19/2021-17:50:44] [V] [TRT] Tactic: 21 time 0.044928 [01/19/2021-17:50:44] [V] [TRT] Tactic: 22 time 0.067584 [01/19/2021-17:50:44] [V] [TRT] Tactic: 24 time 0.03584 [01/19/2021-17:50:44] [V] [TRT] Tactic: 27 time 0.049024 [01/19/2021-17:50:44] [V] [TRT] Tactic: 28 time 0.126976 [01/19/2021-17:50:44] [V] [TRT] Tactic: 31 time 0.044032 [01/19/2021-17:50:44] [V] [TRT] Tactic: 32 time 0.128 [01/19/2021-17:50:44] [V] [TRT] Tactic: 34 time 0.116736 [01/19/2021-17:50:44] [V] [TRT] Tactic: 35 time 0.072704 [01/19/2021-17:50:44] [V] [TRT] Tactic: 40 time 0.115712 [01/19/2021-17:50:44] [V] [TRT] Tactic: 46 time 0.065408 [01/19/2021-17:50:44] [V] [TRT] Tactic: 50 time 0.067584 [01/19/2021-17:50:44] [V] [TRT] Tactic: 51 time 0.063488 [01/19/2021-17:50:44] [V] [TRT] Tactic: 53 time 0.043008 [01/19/2021-17:50:44] [V] [TRT] Tactic: 55 time 0.234496 [01/19/2021-17:50:44] [V] [TRT] Tactic: 59 time 0.104448 [01/19/2021-17:50:44] [V] [TRT] Tactic: 60 time 0.032768 [01/19/2021-17:50:44] [V] [TRT] Tactic: 61 time 0.045056 [01/19/2021-17:50:44] [V] [TRT] Tactic: 63 time 0.050176 [01/19/2021-17:50:44] [V] [TRT] Tactic: 64 time 0.0512 [01/19/2021-17:50:44] [V] [TRT] Tactic: 65 time 0.04608 [01/19/2021-17:50:44] [V] [TRT] Tactic: 68 time 0.118784 [01/19/2021-17:50:44] [V] [TRT] Tactic: 69 time 0.068608 [01/19/2021-17:50:44] [V] [TRT] Tactic: 70 time 0.050176 [01/19/2021-17:50:44] [V] [TRT] Tactic: 74 time 0.04096 [01/19/2021-17:50:44] [V] [TRT] Tactic: 75 time 0.084992 [01/19/2021-17:50:44] [V] [TRT] Tactic: 78 time 0.03072 [01/19/2021-17:50:44] [V] [TRT] Tactic: 79 time 0.062464 [01/19/2021-17:50:44] [V] [TRT] Tactic: 81 time 0.045056 [01/19/2021-17:50:44] [V] [TRT] Tactic: 82 time 0.054272 [01/19/2021-17:50:44] [V] [TRT] Tactic: 84 time 0.068608 [01/19/2021-17:50:44] [V] [TRT] Tactic: 85 time 0.045056 [01/19/2021-17:50:44] [V] [TRT] Tactic: 86 time 0.118784 [01/19/2021-17:50:44] [V] [TRT] Tactic: 87 time 0.068608 [01/19/2021-17:50:44] [V] [TRT] Tactic: 88 time 0.064512 [01/19/2021-17:50:44] [V] [TRT] Tactic: 89 time 0.033792 [01/19/2021-17:50:44] [V] [TRT] Tactic: 91 time 0.114688 [01/19/2021-17:50:44] [V] [TRT] Tactic: 94 time 0.039936 [01/19/2021-17:50:44] [V] [TRT] Tactic: 95 time 0.044928 [01/19/2021-17:50:44] [V] [TRT] Tactic: 97 time 0.058368 [01/19/2021-17:50:44] [V] [TRT] Tactic: 102 time 0.039936 [01/19/2021-17:50:44] [V] [TRT] Tactic: 103 time 0.062464 [01/19/2021-17:50:44] [V] [TRT] Tactic: 105 time 0.068512 [01/19/2021-17:50:44] [V] [TRT] Tactic: 106 time 0.043936 [01/19/2021-17:50:44] [V] [TRT] Tactic: 107 time 0.043008 [01/19/2021-17:50:44] [V] [TRT] Tactic: 108 time 0.069632 [01/19/2021-17:50:44] [V] [TRT] Tactic: 109 time 0.065536 [01/19/2021-17:50:44] [V] [TRT] Tactic: 111 time 0.033792 [01/19/2021-17:50:44] [V] [TRT] Tactic: 112 time 0.045056 [01/19/2021-17:50:44] [V] [TRT] Tactic: 114 time 0.1024 [01/19/2021-17:50:44] [V] [TRT] Tactic: 115 time 0.068608 [01/19/2021-17:50:44] [V] [TRT] Tactic: 117 time 0.039936 [01/19/2021-17:50:44] [V] [TRT] Tactic: 118 time 0.050176 [01/19/2021-17:50:44] [V] [TRT] Tactic: 124 time 0.057344 [01/19/2021-17:50:44] [V] [TRT] Tactic: 125 time 0.04096 [01/19/2021-17:50:44] [V] [TRT] Tactic: 126 time 0.054272 [01/19/2021-17:50:44] [V] [TRT] Tactic: 131 time 0.06656 [01/19/2021-17:50:44] [V] [TRT] Tactic: 132 time 0.04096 [01/19/2021-17:50:44] [V] [TRT] Tactic: 138 time 0.044032 [01/19/2021-17:50:44] [V] [TRT] Tactic: 145 time 0.04096 [01/19/2021-17:50:44] [V] [TRT] Tactic: 150 time 0.050176 [01/19/2021-17:50:44] [V] [TRT] Tactic: 155 time 0.115712 [01/19/2021-17:50:44] [V] [TRT] Tactic: 157 time 0.059392 [01/19/2021-17:50:44] [V] [TRT] Tactic: 160 time 0.07168 [01/19/2021-17:50:44] [V] [TRT] Tactic: 163 time 0.039936 [01/19/2021-17:50:44] [V] [TRT] Tactic: 166 time 0.086016 [01/19/2021-17:50:44] [V] [TRT] Fastest Tactic: 78 Time: 0.03072 [01/19/2021-17:50:44] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D (CaskConvolution) [01/19/2021-17:50:44] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:44] [V] [TRT] Tactic: 1062367460111450758 time 0.08704 [01/19/2021-17:50:44] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:44] [V] [TRT] Tactic: 4501471010995462441 time 0.08704 [01/19/2021-17:50:44] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:44] [V] [TRT] Tactic: 5137655947464784826 time 0.059392 [01/19/2021-17:50:44] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:45] [V] [TRT] Tactic: 5326823351883942011 time 0.084992 [01/19/2021-17:50:45] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:45] [V] [TRT] Tactic: 6645123197870846056 time 0.064512 [01/19/2021-17:50:45] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:45] [V] [TRT] Tactic: -6576203419454146580 time 0.065536 [01/19/2021-17:50:45] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:45] [V] [TRT] Tactic: -3456450830548107839 time 0.069632 [01/19/2021-17:50:45] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:45] [V] [TRT] Tactic: -410470605513481746 time 0.083968 [01/19/2021-17:50:45] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:45] [V] [TRT] Tactic: -37215280111360163 time 0.057344 [01/19/2021-17:50:45] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.057344 [01/19/2021-17:50:45] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D (CudaConvolution) [01/19/2021-17:50:45] [V] [TRT] Tactic: 0 time 0.08192 [01/19/2021-17:50:45] [V] [TRT] Tactic: 1 time 0.106496 [01/19/2021-17:50:45] [V] [TRT] Tactic: 2 time 0.131072 [01/19/2021-17:50:45] [V] [TRT] Tactic: 4 skipped. Scratch requested: 711229440, available: 16777216 [01/19/2021-17:50:45] [V] [TRT] Tactic: 5 skipped. Scratch requested: 43520512, available: 16777216 [01/19/2021-17:50:45] [V] [TRT] Fastest Tactic: 0 Time: 0.08192 [01/19/2021-17:50:45] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D (CudaDepthwiseConvolution) [01/19/2021-17:50:45] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 78 [01/19/2021-17:50:45] [V] [TRT] [01/19/2021-17:50:45] [V] [TRT] *************** Autotuning format combination: Float(1,10,100,32000) -> Float(1,10,100,128000) *************** [01/19/2021-17:50:45] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/Conv_1/Conv2D + FeatureExtractor/MobilenetV2/Conv_1/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:45] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:45] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/Conv_1/Conv2D + FeatureExtractor/MobilenetV2/Conv_1/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:45] [V] [TRT] Tactic: 8 time 0.113664 [01/19/2021-17:50:45] [V] [TRT] Tactic: 9 time 0.072704 [01/19/2021-17:50:45] [V] [TRT] Tactic: 11 time 0.058368 [01/19/2021-17:50:45] [V] [TRT] Tactic: 12 time 0.048128 [01/19/2021-17:50:45] [V] [TRT] Tactic: 17 time 0.057344 [01/19/2021-17:50:45] [V] [TRT] Tactic: 19 time 0.16896 [01/19/2021-17:50:45] [V] [TRT] Tactic: 20 time 0.074752 [01/19/2021-17:50:45] [V] [TRT] Tactic: 21 time 0.066432 [01/19/2021-17:50:45] [V] [TRT] Tactic: 22 time 0.045984 [01/19/2021-17:50:45] [V] [TRT] Tactic: 24 time 0.059392 [01/19/2021-17:50:45] [V] [TRT] Tactic: 27 time 0.062464 [01/19/2021-17:50:45] [V] [TRT] Tactic: 28 time 0.075776 [01/19/2021-17:50:45] [V] [TRT] Tactic: 31 time 0.070656 [01/19/2021-17:50:45] [V] [TRT] Tactic: 32 time 0.075776 [01/19/2021-17:50:45] [V] [TRT] Tactic: 34 time 0.073728 [01/19/2021-17:50:45] [V] [TRT] Tactic: 35 time 0.050176 [01/19/2021-17:50:45] [V] [TRT] Tactic: 40 time 0.07168 [01/19/2021-17:50:45] [V] [TRT] Tactic: 46 time 0.07168 [01/19/2021-17:50:45] [V] [TRT] Tactic: 50 time 0.047104 [01/19/2021-17:50:45] [V] [TRT] Tactic: 51 time 0.054272 [01/19/2021-17:50:45] [V] [TRT] Tactic: 53 time 0.053248 [01/19/2021-17:50:45] [V] [TRT] Tactic: 55 time 0.130048 [01/19/2021-17:50:45] [V] [TRT] Tactic: 59 time 0.067584 [01/19/2021-17:50:45] [V] [TRT] Tactic: 60 time 0.050176 [01/19/2021-17:50:45] [V] [TRT] Tactic: 61 time 0.06144 [01/19/2021-17:50:45] [V] [TRT] Tactic: 63 time 0.068608 [01/19/2021-17:50:45] [V] [TRT] Tactic: 64 time 0.077824 [01/19/2021-17:50:45] [V] [TRT] Tactic: 65 time 0.06144 [01/19/2021-17:50:45] [V] [TRT] Tactic: 68 time 0.072704 [01/19/2021-17:50:45] [V] [TRT] Tactic: 69 time 0.084992 [01/19/2021-17:50:45] [V] [TRT] Tactic: 70 time 0.072704 [01/19/2021-17:50:45] [V] [TRT] Tactic: 74 time 0.070656 [01/19/2021-17:50:45] [V] [TRT] Tactic: 75 time 0.054272 [01/19/2021-17:50:45] [V] [TRT] Tactic: 78 time 0.053248 [01/19/2021-17:50:45] [V] [TRT] Tactic: 79 time 0.050176 [01/19/2021-17:50:45] [V] [TRT] Tactic: 81 time 0.060416 [01/19/2021-17:50:45] [V] [TRT] Tactic: 82 time 0.065536 [01/19/2021-17:50:45] [V] [TRT] Tactic: 84 time 0.074752 [01/19/2021-17:50:45] [V] [TRT] Tactic: 85 time 0.062464 [01/19/2021-17:50:45] [V] [TRT] Tactic: 86 time 0.07168 [01/19/2021-17:50:45] [V] [TRT] Tactic: 87 time 0.08192 [01/19/2021-17:50:45] [V] [TRT] Tactic: 88 time 0.054144 [01/19/2021-17:50:45] [V] [TRT] Tactic: 89 time 0.0512 [01/19/2021-17:50:45] [V] [TRT] Tactic: 91 time 0.070656 [01/19/2021-17:50:45] [V] [TRT] Tactic: 94 time 0.048128 [01/19/2021-17:50:45] [V] [TRT] Tactic: 95 time 0.057344 [01/19/2021-17:50:45] [V] [TRT] Tactic: 97 time 0.069632 [01/19/2021-17:50:45] [V] [TRT] Tactic: 102 time 0.058368 [01/19/2021-17:50:45] [V] [TRT] Tactic: 103 time 0.0512 [01/19/2021-17:50:45] [V] [TRT] Tactic: 105 time 0.093184 [01/19/2021-17:50:45] [V] [TRT] Tactic: 106 time 0.07168 [01/19/2021-17:50:45] [V] [TRT] Tactic: 107 time 0.052224 [01/19/2021-17:50:45] [V] [TRT] Tactic: 108 time 0.086016 [01/19/2021-17:50:45] [V] [TRT] Tactic: 109 time 0.0512 [01/19/2021-17:50:45] [V] [TRT] Tactic: 111 time 0.0512 [01/19/2021-17:50:45] [V] [TRT] Tactic: 112 time 0.067584 [01/19/2021-17:50:45] [V] [TRT] Tactic: 114 time 0.069632 [01/19/2021-17:50:45] [V] [TRT] Tactic: 115 time 0.091136 [01/19/2021-17:50:45] [V] [TRT] Tactic: 117 time 0.0512 [01/19/2021-17:50:45] [V] [TRT] Tactic: 118 time 0.057344 [01/19/2021-17:50:45] [V] [TRT] Tactic: 124 time 0.084992 [01/19/2021-17:50:45] [V] [TRT] Tactic: 125 time 0.068608 [01/19/2021-17:50:45] [V] [TRT] Tactic: 126 time 0.063488 [01/19/2021-17:50:45] [V] [TRT] Tactic: 131 time 0.07168 [01/19/2021-17:50:45] [V] [TRT] Tactic: 132 time 0.048128 [01/19/2021-17:50:45] [V] [TRT] Tactic: 138 time 0.07168 [01/19/2021-17:50:45] [V] [TRT] Tactic: 145 time 0.068608 [01/19/2021-17:50:45] [V] [TRT] Tactic: 150 time 0.068608 [01/19/2021-17:50:45] [V] [TRT] Tactic: 155 time 0.072704 [01/19/2021-17:50:45] [V] [TRT] Tactic: 157 time 0.077824 [01/19/2021-17:50:45] [V] [TRT] Tactic: 160 time 0.055296 [01/19/2021-17:50:45] [V] [TRT] Tactic: 163 time 0.0512 [01/19/2021-17:50:45] [V] [TRT] Tactic: 166 time 0.055296 [01/19/2021-17:50:45] [V] [TRT] Fastest Tactic: 22 Time: 0.045984 [01/19/2021-17:50:45] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/Conv_1/Conv2D + FeatureExtractor/MobilenetV2/Conv_1/Relu6 (CaskConvolution) [01/19/2021-17:50:45] [V] [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + FeatureExtractor/MobilenetV2/Conv_1/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:45] [V] [TRT] Tactic: 1062367460111450758 time 0.050176 [01/19/2021-17:50:45] [V] [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + FeatureExtractor/MobilenetV2/Conv_1/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:45] [V] [TRT] Tactic: 4501471010995462441 time 0.045056 [01/19/2021-17:50:45] [V] [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + FeatureExtractor/MobilenetV2/Conv_1/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:45] [V] [TRT] Tactic: 5137655947464784826 time 0.039936 [01/19/2021-17:50:45] [V] [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + FeatureExtractor/MobilenetV2/Conv_1/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:45] [V] [TRT] Tactic: 5326823351883942011 time 0.04608 [01/19/2021-17:50:45] [V] [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + FeatureExtractor/MobilenetV2/Conv_1/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:45] [V] [TRT] Tactic: 6645123197870846056 time 0.041984 [01/19/2021-17:50:45] [V] [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + FeatureExtractor/MobilenetV2/Conv_1/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:45] [V] [TRT] Tactic: -6576203419454146580 time 0.043008 [01/19/2021-17:50:45] [V] [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + FeatureExtractor/MobilenetV2/Conv_1/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:45] [V] [TRT] Tactic: -3456450830548107839 time 0.04608 [01/19/2021-17:50:45] [V] [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + FeatureExtractor/MobilenetV2/Conv_1/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:45] [V] [TRT] Tactic: -410470605513481746 time 0.043008 [01/19/2021-17:50:45] [V] [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + FeatureExtractor/MobilenetV2/Conv_1/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:45] [V] [TRT] Tactic: -37215280111360163 time 0.038944 [01/19/2021-17:50:45] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.038944 [01/19/2021-17:50:45] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/Conv_1/Conv2D + FeatureExtractor/MobilenetV2/Conv_1/Relu6 (CudaConvolution) [01/19/2021-17:50:45] [V] [TRT] Tactic: 0 time 0.062464 [01/19/2021-17:50:45] [V] [TRT] Tactic: 1 time 0.054272 [01/19/2021-17:50:45] [V] [TRT] Tactic: 2 time 0.140288 [01/19/2021-17:50:45] [V] [TRT] Tactic: 4 skipped. Scratch requested: 946094080, available: 16777216 [01/19/2021-17:50:45] [V] [TRT] Tactic: 5 skipped. Scratch requested: 57882112, available: 16777216 [01/19/2021-17:50:45] [V] [TRT] Fastest Tactic: 1 Time: 0.054272 [01/19/2021-17:50:45] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/Conv_1/Conv2D + FeatureExtractor/MobilenetV2/Conv_1/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:45] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163 [01/19/2021-17:50:45] [V] [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + FeatureExtractor/MobilenetV2/Conv_1/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:45] [V] [TRT] [01/19/2021-17:50:45] [V] [TRT] *************** Autotuning format combination: Float(1,10,100,128000) -> Float(1,10,100,57000) *************** [01/19/2021-17:50:45] [V] [TRT] --------------- Timing Runner: BoxPredictor_1/ClassPredictor/Conv2D || BoxPredictor_1/BoxEncodingPredictor/Conv2D (LegacySASSConvolution) [01/19/2021-17:50:45] [V] [TRT] Tactic: 0 time 1.35168 [01/19/2021-17:50:45] [V] [TRT] Tactic: 1 time 0.475136 [01/19/2021-17:50:45] [V] [TRT] Fastest Tactic: 1 Time: 0.475136 [01/19/2021-17:50:45] [V] [TRT] --------------- Timing Runner: BoxPredictor_1/ClassPredictor/Conv2D || BoxPredictor_1/BoxEncodingPredictor/Conv2D (FusedConvActConvolution) [01/19/2021-17:50:45] [V] [TRT] Tactic: 7 time 0.661504 [01/19/2021-17:50:45] [V] [TRT] Tactic: 10 time 0.5336 [01/19/2021-17:50:45] [V] [TRT] Tactic: 14 time 0.502784 [01/19/2021-17:50:45] [V] [TRT] Tactic: 15 time 0.549888 [01/19/2021-17:50:45] [V] [TRT] Tactic: 25 time 0.410624 [01/19/2021-17:50:45] [V] [TRT] Tactic: 26 time 0.499712 [01/19/2021-17:50:45] [V] [TRT] Tactic: 29 time 0.816128 [01/19/2021-17:50:45] [V] [TRT] Tactic: 30 time 0.769024 [01/19/2021-17:50:45] [V] [TRT] Tactic: 33 time 0.658432 [01/19/2021-17:50:45] [V] [TRT] Tactic: 36 time 0.802816 [01/19/2021-17:50:45] [V] [TRT] Tactic: 39 time 0.52736 [01/19/2021-17:50:45] [V] [TRT] Tactic: 41 time 0.62464 [01/19/2021-17:50:45] [V] [TRT] Tactic: 45 time 0.661504 [01/19/2021-17:50:45] [V] [TRT] Tactic: 47 time 0.43088 [01/19/2021-17:50:45] [V] [TRT] Tactic: 54 time 0.625664 [01/19/2021-17:50:45] [V] [TRT] Tactic: 66 time 0.88576 [01/19/2021-17:50:45] [V] [TRT] Tactic: 76 time 0.5632 [01/19/2021-17:50:46] [V] [TRT] Tactic: 90 time 0.815104 [01/19/2021-17:50:46] [V] [TRT] Tactic: 93 time 0.613376 [01/19/2021-17:50:46] [V] [TRT] Tactic: 98 time 0.631808 [01/19/2021-17:50:46] [V] [TRT] Tactic: 104 time 0.702464 [01/19/2021-17:50:46] [V] [TRT] Tactic: 110 time 0.55808 [01/19/2021-17:50:46] [V] [TRT] Tactic: 119 time 0.541696 [01/19/2021-17:50:46] [V] [TRT] Tactic: 121 time 0.577536 [01/19/2021-17:50:46] [V] [TRT] Tactic: 130 time 0.750592 [01/19/2021-17:50:46] [V] [TRT] Tactic: 134 time 0.606208 [01/19/2021-17:50:46] [V] [TRT] Tactic: 136 time 0.816128 [01/19/2021-17:50:46] [V] [TRT] Tactic: 137 time 0.584704 [01/19/2021-17:50:46] [V] [TRT] Tactic: 139 time 0.62976 [01/19/2021-17:50:46] [V] [TRT] Tactic: 144 time 0.873472 [01/19/2021-17:50:46] [V] [TRT] Tactic: 151 time 0.64 [01/19/2021-17:50:46] [V] [TRT] Tactic: 152 time 0.485376 [01/19/2021-17:50:46] [V] [TRT] Tactic: 153 time 0.887808 [01/19/2021-17:50:46] [V] [TRT] Tactic: 156 time 0.816128 [01/19/2021-17:50:46] [V] [TRT] Tactic: 159 time 0.376832 [01/19/2021-17:50:46] [V] [TRT] Tactic: 162 time 0.540672 [01/19/2021-17:50:46] [V] [TRT] Tactic: 164 time 0.571392 [01/19/2021-17:50:46] [V] [TRT] Fastest Tactic: 159 Time: 0.376832 [01/19/2021-17:50:46] [V] [TRT] --------------- Timing Runner: BoxPredictor_1/ClassPredictor/Conv2D || BoxPredictor_1/BoxEncodingPredictor/Conv2D (CaskConvolution) [01/19/2021-17:50:46] [V] [TRT] BoxPredictor_1/ClassPredictor/Conv2D || BoxPredictor_1/BoxEncodingPredictor/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:46] [V] [TRT] Tactic: 1062367460111450758 time 1.37728 [01/19/2021-17:50:46] [V] [TRT] BoxPredictor_1/ClassPredictor/Conv2D || BoxPredictor_1/BoxEncodingPredictor/Conv2D (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [01/19/2021-17:50:46] [V] [TRT] Tactic: 3827454225649558724 time 0.401408 [01/19/2021-17:50:46] [V] [TRT] BoxPredictor_1/ClassPredictor/Conv2D || BoxPredictor_1/BoxEncodingPredictor/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [01/19/2021-17:50:46] [V] [TRT] Tactic: 4337000649858996379 time 1.10285 [01/19/2021-17:50:46] [V] [TRT] BoxPredictor_1/ClassPredictor/Conv2D || BoxPredictor_1/BoxEncodingPredictor/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:46] [V] [TRT] Tactic: 4501471010995462441 time 1.29229 [01/19/2021-17:50:46] [V] [TRT] BoxPredictor_1/ClassPredictor/Conv2D || BoxPredictor_1/BoxEncodingPredictor/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:46] [V] [TRT] Tactic: 5137655947464784826 time 0.914432 [01/19/2021-17:50:46] [V] [TRT] BoxPredictor_1/ClassPredictor/Conv2D || BoxPredictor_1/BoxEncodingPredictor/Conv2D (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [01/19/2021-17:50:46] [V] [TRT] Tactic: 5921334924264294896 time 0.411648 [01/19/2021-17:50:46] [V] [TRT] BoxPredictor_1/ClassPredictor/Conv2D || BoxPredictor_1/BoxEncodingPredictor/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:46] [V] [TRT] Tactic: 6645123197870846056 time 1.03254 [01/19/2021-17:50:46] [V] [TRT] BoxPredictor_1/ClassPredictor/Conv2D || BoxPredictor_1/BoxEncodingPredictor/Conv2D (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [01/19/2021-17:50:46] [V] [TRT] Tactic: 7852627285308570038 time 0.415744 [01/19/2021-17:50:46] [V] [TRT] BoxPredictor_1/ClassPredictor/Conv2D || BoxPredictor_1/BoxEncodingPredictor/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [01/19/2021-17:50:46] [V] [TRT] Tactic: -9137461792520977713 time 1.34963 [01/19/2021-17:50:46] [V] [TRT] BoxPredictor_1/ClassPredictor/Conv2D || BoxPredictor_1/BoxEncodingPredictor/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [01/19/2021-17:50:46] [V] [TRT] Tactic: -6092040395344634144 time 1.4039 [01/19/2021-17:50:46] [V] [TRT] BoxPredictor_1/ClassPredictor/Conv2D || BoxPredictor_1/BoxEncodingPredictor/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:46] [V] [TRT] Tactic: -3456450830548107839 time 1.00966 [01/19/2021-17:50:46] [V] [TRT] BoxPredictor_1/ClassPredictor/Conv2D || BoxPredictor_1/BoxEncodingPredictor/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:46] [V] [TRT] Tactic: -410470605513481746 time 1.21446 [01/19/2021-17:50:46] [V] [TRT] Fastest Tactic: 3827454225649558724 Time: 0.401408 [01/19/2021-17:50:46] [V] [TRT] --------------- Timing Runner: BoxPredictor_1/ClassPredictor/Conv2D || BoxPredictor_1/BoxEncodingPredictor/Conv2D (CudaConvolution) [01/19/2021-17:50:46] [V] [TRT] Tactic: 0 time 1.24826 [01/19/2021-17:50:46] [V] [TRT] Tactic: 1 time 1.31789 [01/19/2021-17:50:46] [V] [TRT] Tactic: 2 time 0.821248 [01/19/2021-17:50:46] [V] [TRT] Tactic: 4 skipped. Scratch requested: 1710213120, available: 16777216 [01/19/2021-17:50:46] [V] [TRT] Tactic: 5 skipped. Scratch requested: 3183294976, available: 16777216 [01/19/2021-17:50:46] [V] [TRT] Tactic: 6 skipped. Scratch requested: 73454080, available: 16777216 [01/19/2021-17:50:46] [V] [TRT] Fastest Tactic: 2 Time: 0.821248 [01/19/2021-17:50:46] [V] [TRT] --------------- Timing Runner: BoxPredictor_1/ClassPredictor/Conv2D || BoxPredictor_1/BoxEncodingPredictor/Conv2D (CudaDepthwiseConvolution) [01/19/2021-17:50:46] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 159 [01/19/2021-17:50:46] [V] [TRT] [01/19/2021-17:50:46] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:46] [V] [TRT] Tactic: 0 time 0.008192 [01/19/2021-17:50:46] [V] [TRT] Fastest Tactic: 0 Time: 0.008192 [01/19/2021-17:50:46] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:46] [V] [TRT] Tactic: 0 time 0.008192 [01/19/2021-17:50:46] [V] [TRT] Fastest Tactic: 0 Time: 0.008192 [01/19/2021-17:50:46] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:46] [V] [TRT] Tactic: 0 time 0.006144 [01/19/2021-17:50:46] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [01/19/2021-17:50:46] [V] [TRT] *************** Autotuning format combination: Float(1,10,100,57000) -> Float(1,1,91,54600) *************** [01/19/2021-17:50:46] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 533) [Shuffle] + BoxPredictor_1/Reshape_1 (Shuffle) [01/19/2021-17:50:46] [V] [TRT] Tactic: 0 time 0.006144 [01/19/2021-17:50:46] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [01/19/2021-17:50:46] [V] [TRT] *************** Autotuning format combination: Float(1,10,100:32,1800) -> Float(1,1,91:32,1729) *************** [01/19/2021-17:50:46] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 533) [Shuffle] + BoxPredictor_1/Reshape_1 (Shuffle) [01/19/2021-17:50:46] [V] [TRT] Tactic: 0 time 0.008192 [01/19/2021-17:50:46] [V] [TRT] Fastest Tactic: 0 Time: 0.008192 [01/19/2021-17:50:46] [V] [TRT] *************** Autotuning format combination: Float(1,10,100,128000) -> Float(1,10,100,25600) *************** [01/19/2021-17:50:46] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:46] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:46] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:46] [V] [TRT] Tactic: 8 time 0.251904 [01/19/2021-17:50:46] [V] [TRT] Tactic: 9 time 0.1536 [01/19/2021-17:50:46] [V] [TRT] Tactic: 11 time 0.063488 [01/19/2021-17:50:46] [V] [TRT] Tactic: 12 time 0.0512 [01/19/2021-17:50:46] [V] [TRT] Tactic: 17 time 0.039936 [01/19/2021-17:50:46] [V] [TRT] Tactic: 19 time 0.30208 [01/19/2021-17:50:46] [V] [TRT] Tactic: 20 time 0.16384 [01/19/2021-17:50:47] [V] [TRT] Tactic: 21 time 0.054272 [01/19/2021-17:50:47] [V] [TRT] Tactic: 22 time 0.08704 [01/19/2021-17:50:47] [V] [TRT] Tactic: 24 time 0.044032 [01/19/2021-17:50:47] [V] [TRT] Tactic: 27 time 0.063488 [01/19/2021-17:50:47] [V] [TRT] Tactic: 28 time 0.165888 [01/19/2021-17:50:47] [V] [TRT] Tactic: 31 time 0.054272 [01/19/2021-17:50:47] [V] [TRT] Tactic: 32 time 0.16384 [01/19/2021-17:50:47] [V] [TRT] Tactic: 34 time 0.152576 [01/19/2021-17:50:47] [V] [TRT] Tactic: 35 time 0.093184 [01/19/2021-17:50:47] [V] [TRT] Tactic: 40 time 0.151552 [01/19/2021-17:50:47] [V] [TRT] Tactic: 46 time 0.080896 [01/19/2021-17:50:47] [V] [TRT] Tactic: 50 time 0.08704 [01/19/2021-17:50:47] [V] [TRT] Tactic: 51 time 0.082944 [01/19/2021-17:50:47] [V] [TRT] Tactic: 53 time 0.0512 [01/19/2021-17:50:47] [V] [TRT] Tactic: 55 time 0.309248 [01/19/2021-17:50:47] [V] [TRT] Tactic: 59 time 0.136192 [01/19/2021-17:50:47] [V] [TRT] Tactic: 60 time 0.04096 [01/19/2021-17:50:47] [V] [TRT] Tactic: 61 time 0.057344 [01/19/2021-17:50:47] [V] [TRT] Tactic: 63 time 0.064512 [01/19/2021-17:50:47] [V] [TRT] Tactic: 64 time 0.063488 [01/19/2021-17:50:47] [V] [TRT] Tactic: 65 time 0.058368 [01/19/2021-17:50:47] [V] [TRT] Tactic: 68 time 0.157696 [01/19/2021-17:50:47] [V] [TRT] Tactic: 69 time 0.063488 [01/19/2021-17:50:47] [V] [TRT] Tactic: 70 time 0.06144 [01/19/2021-17:50:47] [V] [TRT] Tactic: 74 time 0.052224 [01/19/2021-17:50:47] [V] [TRT] Tactic: 75 time 0.094208 [01/19/2021-17:50:47] [V] [TRT] Tactic: 78 time 0.038912 [01/19/2021-17:50:47] [V] [TRT] Tactic: 79 time 0.08192 [01/19/2021-17:50:47] [V] [TRT] Tactic: 81 time 0.038912 [01/19/2021-17:50:47] [V] [TRT] Tactic: 82 time 0.06656 [01/19/2021-17:50:47] [V] [TRT] Tactic: 84 time 0.083968 [01/19/2021-17:50:47] [V] [TRT] Tactic: 85 time 0.054272 [01/19/2021-17:50:47] [V] [TRT] Tactic: 86 time 0.155648 [01/19/2021-17:50:47] [V] [TRT] Tactic: 87 time 0.086016 [01/19/2021-17:50:47] [V] [TRT] Tactic: 88 time 0.083968 [01/19/2021-17:50:47] [V] [TRT] Tactic: 89 time 0.041984 [01/19/2021-17:50:47] [V] [TRT] Tactic: 91 time 0.145408 [01/19/2021-17:50:47] [V] [TRT] Tactic: 94 time 0.047104 [01/19/2021-17:50:47] [V] [TRT] Tactic: 95 time 0.038912 [01/19/2021-17:50:47] [V] [TRT] Tactic: 97 time 0.0768 [01/19/2021-17:50:47] [V] [TRT] Tactic: 102 time 0.047104 [01/19/2021-17:50:47] [V] [TRT] Tactic: 103 time 0.082944 [01/19/2021-17:50:47] [V] [TRT] Tactic: 105 time 0.084992 [01/19/2021-17:50:47] [V] [TRT] Tactic: 106 time 0.054272 [01/19/2021-17:50:47] [V] [TRT] Tactic: 107 time 0.0512 [01/19/2021-17:50:47] [V] [TRT] Tactic: 108 time 0.08704 [01/19/2021-17:50:47] [V] [TRT] Tactic: 109 time 0.086016 [01/19/2021-17:50:47] [V] [TRT] Tactic: 111 time 0.041984 [01/19/2021-17:50:47] [V] [TRT] Tactic: 112 time 0.057344 [01/19/2021-17:50:47] [V] [TRT] Tactic: 114 time 0.135168 [01/19/2021-17:50:47] [V] [TRT] Tactic: 115 time 0.084992 [01/19/2021-17:50:47] [V] [TRT] Tactic: 117 time 0.050176 [01/19/2021-17:50:47] [V] [TRT] Tactic: 118 time 0.06144 [01/19/2021-17:50:47] [V] [TRT] Tactic: 124 time 0.06656 [01/19/2021-17:50:47] [V] [TRT] Tactic: 125 time 0.052224 [01/19/2021-17:50:47] [V] [TRT] Tactic: 126 time 0.06656 [01/19/2021-17:50:47] [V] [TRT] Tactic: 131 time 0.083968 [01/19/2021-17:50:47] [V] [TRT] Tactic: 132 time 0.049152 [01/19/2021-17:50:47] [V] [TRT] Tactic: 138 time 0.054272 [01/19/2021-17:50:47] [V] [TRT] Tactic: 145 time 0.052224 [01/19/2021-17:50:47] [V] [TRT] Tactic: 150 time 0.064384 [01/19/2021-17:50:47] [V] [TRT] Tactic: 155 time 0.152576 [01/19/2021-17:50:47] [V] [TRT] Tactic: 157 time 0.069632 [01/19/2021-17:50:47] [V] [TRT] Tactic: 160 time 0.094112 [01/19/2021-17:50:47] [V] [TRT] Tactic: 163 time 0.050176 [01/19/2021-17:50:47] [V] [TRT] Tactic: 166 time 0.09216 [01/19/2021-17:50:47] [V] [TRT] Fastest Tactic: 78 Time: 0.038912 [01/19/2021-17:50:47] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6 (CaskConvolution) [01/19/2021-17:50:47] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:47] [V] [TRT] Tactic: 1062367460111450758 time 0.121856 [01/19/2021-17:50:47] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:47] [V] [TRT] Tactic: 4501471010995462441 time 0.114688 [01/19/2021-17:50:47] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:47] [V] [TRT] Tactic: 5137655947464784826 time 0.086016 [01/19/2021-17:50:47] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:47] [V] [TRT] Tactic: 5326823351883942011 time 0.110592 [01/19/2021-17:50:47] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:47] [V] [TRT] Tactic: 6645123197870846056 time 0.094208 [01/19/2021-17:50:47] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:47] [V] [TRT] Tactic: -6576203419454146580 time 0.094208 [01/19/2021-17:50:47] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:47] [V] [TRT] Tactic: -3456450830548107839 time 0.101376 [01/19/2021-17:50:47] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:47] [V] [TRT] Tactic: -410470605513481746 time 0.110592 [01/19/2021-17:50:47] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:47] [V] [TRT] Tactic: -37215280111360163 time 0.082944 [01/19/2021-17:50:47] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.082944 [01/19/2021-17:50:47] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6 (CudaConvolution) [01/19/2021-17:50:47] [V] [TRT] Tactic: 0 time 0.1024 [01/19/2021-17:50:47] [V] [TRT] Tactic: 1 time 0.126976 [01/19/2021-17:50:47] [V] [TRT] Tactic: 2 time 0.16384 [01/19/2021-17:50:47] [V] [TRT] Tactic: 4 skipped. Scratch requested: 759234560, available: 16777216 [01/19/2021-17:50:47] [V] [TRT] Tactic: 5 skipped. Scratch requested: 46653952, available: 16777216 [01/19/2021-17:50:47] [V] [TRT] Fastest Tactic: 0 Time: 0.1024 [01/19/2021-17:50:47] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:47] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 78 [01/19/2021-17:50:47] [V] [TRT] [01/19/2021-17:50:47] [V] [TRT] *************** Autotuning format combination: Float(1,10,100,25600) -> Float(1,5,25,6400) *************** [01/19/2021-17:50:47] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:47] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:47] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:47] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:47] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6 (CaskConvolution) [01/19/2021-17:50:47] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:47] [V] [TRT] Tactic: 1062367460111450758 time 1.87802 [01/19/2021-17:50:47] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [01/19/2021-17:50:47] [V] [TRT] Tactic: 4337000649858996379 time 1.74899 [01/19/2021-17:50:47] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:47] [V] [TRT] Tactic: 4501471010995462441 time 1.78893 [01/19/2021-17:50:47] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:47] [V] [TRT] Tactic: 5137655947464784826 time 1.66298 [01/19/2021-17:50:47] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:47] [V] [TRT] Tactic: 6645123197870846056 time 1.70189 [01/19/2021-17:50:47] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [01/19/2021-17:50:47] [V] [TRT] Tactic: -9137461792520977713 time 1.81248 [01/19/2021-17:50:47] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [01/19/2021-17:50:47] [V] [TRT] Tactic: -6092040395344634144 time 1.9497 [01/19/2021-17:50:47] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:47] [V] [TRT] Tactic: -3456450830548107839 time 1.76538 [01/19/2021-17:50:47] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:47] [V] [TRT] Tactic: -410470605513481746 time 1.79302 [01/19/2021-17:50:47] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 1.66298 [01/19/2021-17:50:47] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6 (CudaConvolution) [01/19/2021-17:50:47] [V] [TRT] Tactic: 0 time 0.01024 [01/19/2021-17:50:47] [V] [TRT] Tactic: 1 time 1.31277 [01/19/2021-17:50:47] [V] [TRT] Tactic: 2 time 2.48714 [01/19/2021-17:50:47] [V] [TRT] Tactic: 5 time 8.86762 [01/19/2021-17:50:47] [V] [TRT] Fastest Tactic: 0 Time: 0.01024 [01/19/2021-17:50:47] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:47] [V] [TRT] Tactic: -1 time 0.00512 [01/19/2021-17:50:47] [V] [TRT] Fastest Tactic: -1 Time: 0.00512 [01/19/2021-17:50:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [01/19/2021-17:50:47] [V] [TRT] [01/19/2021-17:50:47] [V] [TRT] *************** Autotuning format combination: Float(1,5,25,6400) -> Float(1,5,25,12800) *************** [01/19/2021-17:50:47] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:47] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:47] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:47] [V] [TRT] Tactic: 8 time 0.054272 [01/19/2021-17:50:47] [V] [TRT] Tactic: 9 time 0.03584 [01/19/2021-17:50:47] [V] [TRT] Tactic: 11 time 0.017408 [01/19/2021-17:50:47] [V] [TRT] Tactic: 12 time 0.01536 [01/19/2021-17:50:47] [V] [TRT] Tactic: 17 time 0.01024 [01/19/2021-17:50:47] [V] [TRT] Tactic: 19 time 0.062464 [01/19/2021-17:50:47] [V] [TRT] Tactic: 20 time 0.038912 [01/19/2021-17:50:47] [V] [TRT] Tactic: 21 time 0.016384 [01/19/2021-17:50:47] [V] [TRT] Tactic: 22 time 0.022528 [01/19/2021-17:50:47] [V] [TRT] Tactic: 24 time 0.013312 [01/19/2021-17:50:47] [V] [TRT] Tactic: 27 time 0.017408 [01/19/2021-17:50:47] [V] [TRT] Tactic: 28 time 0.039936 [01/19/2021-17:50:47] [V] [TRT] Tactic: 31 time 0.014336 [01/19/2021-17:50:47] [V] [TRT] Tactic: 32 time 0.037888 [01/19/2021-17:50:47] [V] [TRT] Tactic: 34 time 0.034816 [01/19/2021-17:50:47] [V] [TRT] Tactic: 35 time 0.024576 [01/19/2021-17:50:47] [V] [TRT] Tactic: 40 time 0.034816 [01/19/2021-17:50:47] [V] [TRT] Tactic: 46 time 0.02048 [01/19/2021-17:50:47] [V] [TRT] Tactic: 50 time 0.023552 [01/19/2021-17:50:47] [V] [TRT] Tactic: 51 time 0.02048 [01/19/2021-17:50:47] [V] [TRT] Tactic: 53 time 0.013312 [01/19/2021-17:50:47] [V] [TRT] Tactic: 55 time 0.067584 [01/19/2021-17:50:47] [V] [TRT] Tactic: 59 time 0.03072 [01/19/2021-17:50:47] [V] [TRT] Tactic: 60 time 0.011264 [01/19/2021-17:50:47] [V] [TRT] Tactic: 61 time 0.01536 [01/19/2021-17:50:47] [V] [TRT] Tactic: 63 time 0.019456 [01/19/2021-17:50:47] [V] [TRT] Tactic: 64 time 0.01536 [01/19/2021-17:50:47] [V] [TRT] Tactic: 65 time 0.016384 [01/19/2021-17:50:47] [V] [TRT] Tactic: 68 time 0.036864 [01/19/2021-17:50:47] [V] [TRT] Tactic: 69 time 0.012288 [01/19/2021-17:50:47] [V] [TRT] Tactic: 70 time 0.012288 [01/19/2021-17:50:47] [V] [TRT] Tactic: 74 time 0.013312 [01/19/2021-17:50:47] [V] [TRT] Tactic: 75 time 0.024576 [01/19/2021-17:50:47] [V] [TRT] Tactic: 78 time 0.012288 [01/19/2021-17:50:47] [V] [TRT] Tactic: 79 time 0.019456 [01/19/2021-17:50:47] [V] [TRT] Tactic: 81 time 0.01024 [01/19/2021-17:50:47] [V] [TRT] Tactic: 82 time 0.017408 [01/19/2021-17:50:47] [V] [TRT] Tactic: 84 time 0.022528 [01/19/2021-17:50:47] [V] [TRT] Tactic: 85 time 0.01536 [01/19/2021-17:50:47] [V] [TRT] Tactic: 86 time 0.034816 [01/19/2021-17:50:47] [V] [TRT] Tactic: 87 time 0.02048 [01/19/2021-17:50:47] [V] [TRT] Tactic: 88 time 0.02048 [01/19/2021-17:50:47] [V] [TRT] Tactic: 89 time 0.013312 [01/19/2021-17:50:47] [V] [TRT] Tactic: 91 time 0.033792 [01/19/2021-17:50:47] [V] [TRT] Tactic: 94 time 0.013312 [01/19/2021-17:50:47] [V] [TRT] Tactic: 95 time 0.01024 [01/19/2021-17:50:47] [V] [TRT] Tactic: 97 time 0.018432 [01/19/2021-17:50:47] [V] [TRT] Tactic: 102 time 0.012288 [01/19/2021-17:50:47] [V] [TRT] Tactic: 103 time 0.019456 [01/19/2021-17:50:47] [V] [TRT] Tactic: 105 time 0.02048 [01/19/2021-17:50:47] [V] [TRT] Tactic: 106 time 0.014336 [01/19/2021-17:50:47] [V] [TRT] Tactic: 107 time 0.013312 [01/19/2021-17:50:47] [V] [TRT] Tactic: 108 time 0.02048 [01/19/2021-17:50:47] [V] [TRT] Tactic: 109 time 0.021504 [01/19/2021-17:50:47] [V] [TRT] Tactic: 111 time 0.012288 [01/19/2021-17:50:47] [V] [TRT] Tactic: 112 time 0.016384 [01/19/2021-17:50:47] [V] [TRT] Tactic: 114 time 0.029696 [01/19/2021-17:50:47] [V] [TRT] Tactic: 115 time 0.02048 [01/19/2021-17:50:47] [V] [TRT] Tactic: 117 time 0.014336 [01/19/2021-17:50:47] [V] [TRT] Tactic: 118 time 0.017408 [01/19/2021-17:50:47] [V] [TRT] Tactic: 124 time 0.01536 [01/19/2021-17:50:47] [V] [TRT] Tactic: 125 time 0.013312 [01/19/2021-17:50:47] [V] [TRT] Tactic: 126 time 0.016384 [01/19/2021-17:50:47] [V] [TRT] Tactic: 131 time 0.021504 [01/19/2021-17:50:47] [V] [TRT] Tactic: 132 time 0.013312 [01/19/2021-17:50:47] [V] [TRT] Tactic: 138 time 0.014336 [01/19/2021-17:50:47] [V] [TRT] Tactic: 145 time 0.013312 [01/19/2021-17:50:47] [V] [TRT] Tactic: 150 time 0.018432 [01/19/2021-17:50:47] [V] [TRT] Tactic: 155 time 0.034816 [01/19/2021-17:50:47] [V] [TRT] Tactic: 157 time 0.014336 [01/19/2021-17:50:47] [V] [TRT] Tactic: 160 time 0.021504 [01/19/2021-17:50:47] [V] [TRT] Tactic: 163 time 0.014336 [01/19/2021-17:50:47] [V] [TRT] Tactic: 166 time 0.027648 [01/19/2021-17:50:47] [V] [TRT] Fastest Tactic: 17 Time: 0.01024 [01/19/2021-17:50:47] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6 (CaskConvolution) [01/19/2021-17:50:47] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:47] [V] [TRT] Tactic: 1062367460111450758 time 0.027648 [01/19/2021-17:50:47] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:47] [V] [TRT] Tactic: 4501471010995462441 time 0.028672 [01/19/2021-17:50:47] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:47] [V] [TRT] Tactic: 5137655947464784826 time 0.021504 [01/19/2021-17:50:47] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:47] [V] [TRT] Tactic: 5326823351883942011 time 0.028672 [01/19/2021-17:50:47] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:47] [V] [TRT] Tactic: 6645123197870846056 time 0.023552 [01/19/2021-17:50:47] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:47] [V] [TRT] Tactic: -6576203419454146580 time 0.023552 [01/19/2021-17:50:47] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:47] [V] [TRT] Tactic: -3456450830548107839 time 0.024576 [01/19/2021-17:50:47] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:47] [V] [TRT] Tactic: -410470605513481746 time 0.028672 [01/19/2021-17:50:47] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:47] [V] [TRT] Tactic: -37215280111360163 time 0.021504 [01/19/2021-17:50:47] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.021504 [01/19/2021-17:50:47] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6 (CudaConvolution) [01/19/2021-17:50:47] [V] [TRT] Tactic: 0 time 0.026624 [01/19/2021-17:50:47] [V] [TRT] Tactic: 1 time 0.036864 [01/19/2021-17:50:47] [V] [TRT] Tactic: 2 time 0.079872 [01/19/2021-17:50:47] [V] [TRT] Tactic: 4 skipped. Scratch requested: 303104000, available: 16777216 [01/19/2021-17:50:47] [V] [TRT] Tactic: 5 skipped. Scratch requested: 18348544, available: 16777216 [01/19/2021-17:50:47] [V] [TRT] Fastest Tactic: 0 Time: 0.026624 [01/19/2021-17:50:47] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:47] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:47] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 17 [01/19/2021-17:50:47] [V] [TRT] [01/19/2021-17:50:47] [V] [TRT] *************** Autotuning format combination: Float(1,5,25,12800) -> Float(1,5,25,14250) *************** [01/19/2021-17:50:47] [V] [TRT] --------------- Timing Runner: BoxPredictor_2/ClassPredictor/Conv2D || BoxPredictor_2/BoxEncodingPredictor/Conv2D (LegacySASSConvolution) [01/19/2021-17:50:47] [V] [TRT] Tactic: 0 time 0.544768 [01/19/2021-17:50:47] [V] [TRT] Tactic: 1 time 0.12288 [01/19/2021-17:50:47] [V] [TRT] Fastest Tactic: 1 Time: 0.12288 [01/19/2021-17:50:47] [V] [TRT] --------------- Timing Runner: BoxPredictor_2/ClassPredictor/Conv2D || BoxPredictor_2/BoxEncodingPredictor/Conv2D (FusedConvActConvolution) [01/19/2021-17:50:47] [V] [TRT] Tactic: 7 time 0.259072 [01/19/2021-17:50:47] [V] [TRT] Tactic: 10 time 0.167936 [01/19/2021-17:50:47] [V] [TRT] Tactic: 14 time 0.100352 [01/19/2021-17:50:47] [V] [TRT] Tactic: 15 time 0.169984 [01/19/2021-17:50:47] [V] [TRT] Tactic: 25 time 0.1024 [01/19/2021-17:50:47] [V] [TRT] Tactic: 26 time 0.072704 [01/19/2021-17:50:47] [V] [TRT] Tactic: 29 time 0.329728 [01/19/2021-17:50:47] [V] [TRT] Tactic: 30 time 0.305152 [01/19/2021-17:50:47] [V] [TRT] Tactic: 33 time 0.300032 [01/19/2021-17:50:47] [V] [TRT] Tactic: 36 time 0.118784 [01/19/2021-17:50:47] [V] [TRT] Tactic: 39 time 0.077824 [01/19/2021-17:50:47] [V] [TRT] Tactic: 41 time 0.183296 [01/19/2021-17:50:47] [V] [TRT] Tactic: 45 time 0.115712 [01/19/2021-17:50:47] [V] [TRT] Tactic: 47 time 0.098304 [01/19/2021-17:50:47] [V] [TRT] Tactic: 54 time 0.115712 [01/19/2021-17:50:47] [V] [TRT] Tactic: 66 time 0.357376 [01/19/2021-17:50:47] [V] [TRT] Tactic: 76 time 0.142336 [01/19/2021-17:50:47] [V] [TRT] Tactic: 90 time 0.329728 [01/19/2021-17:50:47] [V] [TRT] Tactic: 93 time 0.233472 [01/19/2021-17:50:47] [V] [TRT] Tactic: 98 time 0.172032 [01/19/2021-17:50:47] [V] [TRT] Tactic: 104 time 0.270336 [01/19/2021-17:50:47] [V] [TRT] Tactic: 110 time 0.080896 [01/19/2021-17:50:47] [V] [TRT] Tactic: 119 time 0.080896 [01/19/2021-17:50:47] [V] [TRT] Tactic: 121 time 0.169984 [01/19/2021-17:50:48] [V] [TRT] Tactic: 130 time 0.300032 [01/19/2021-17:50:48] [V] [TRT] Tactic: 134 time 0.084992 [01/19/2021-17:50:48] [V] [TRT] Tactic: 136 time 0.329728 [01/19/2021-17:50:48] [V] [TRT] Tactic: 137 time 0.108544 [01/19/2021-17:50:48] [V] [TRT] Tactic: 139 time 0.11264 [01/19/2021-17:50:48] [V] [TRT] Tactic: 144 time 0.352256 [01/19/2021-17:50:48] [V] [TRT] Tactic: 151 time 0.09216 [01/19/2021-17:50:48] [V] [TRT] Tactic: 152 time 0.149504 [01/19/2021-17:50:48] [V] [TRT] Tactic: 153 time 0.356352 [01/19/2021-17:50:48] [V] [TRT] Tactic: 156 time 0.329728 [01/19/2021-17:50:48] [V] [TRT] Tactic: 159 time 0.089088 [01/19/2021-17:50:48] [V] [TRT] Tactic: 162 time 0.0768 [01/19/2021-17:50:48] [V] [TRT] Tactic: 164 time 0.115712 [01/19/2021-17:50:48] [V] [TRT] Fastest Tactic: 26 Time: 0.072704 [01/19/2021-17:50:48] [V] [TRT] --------------- Timing Runner: BoxPredictor_2/ClassPredictor/Conv2D || BoxPredictor_2/BoxEncodingPredictor/Conv2D (CaskConvolution) [01/19/2021-17:50:48] [V] [TRT] BoxPredictor_2/ClassPredictor/Conv2D || BoxPredictor_2/BoxEncodingPredictor/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: 1062367460111450758 time 0.551936 [01/19/2021-17:50:48] [V] [TRT] BoxPredictor_2/ClassPredictor/Conv2D || BoxPredictor_2/BoxEncodingPredictor/Conv2D (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: 3827454225649558724 time 0.106496 [01/19/2021-17:50:48] [V] [TRT] BoxPredictor_2/ClassPredictor/Conv2D || BoxPredictor_2/BoxEncodingPredictor/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: 4337000649858996379 time 0.438272 [01/19/2021-17:50:48] [V] [TRT] BoxPredictor_2/ClassPredictor/Conv2D || BoxPredictor_2/BoxEncodingPredictor/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: 4501471010995462441 time 0.488448 [01/19/2021-17:50:48] [V] [TRT] BoxPredictor_2/ClassPredictor/Conv2D || BoxPredictor_2/BoxEncodingPredictor/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: 5137655947464784826 time 0.360448 [01/19/2021-17:50:48] [V] [TRT] BoxPredictor_2/ClassPredictor/Conv2D || BoxPredictor_2/BoxEncodingPredictor/Conv2D (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: 5921334924264294896 time 0.110592 [01/19/2021-17:50:48] [V] [TRT] BoxPredictor_2/ClassPredictor/Conv2D || BoxPredictor_2/BoxEncodingPredictor/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: 6645123197870846056 time 0.415744 [01/19/2021-17:50:48] [V] [TRT] BoxPredictor_2/ClassPredictor/Conv2D || BoxPredictor_2/BoxEncodingPredictor/Conv2D (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: 7852627285308570038 time 0.111616 [01/19/2021-17:50:48] [V] [TRT] BoxPredictor_2/ClassPredictor/Conv2D || BoxPredictor_2/BoxEncodingPredictor/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: -9137461792520977713 time 0.531456 [01/19/2021-17:50:48] [V] [TRT] BoxPredictor_2/ClassPredictor/Conv2D || BoxPredictor_2/BoxEncodingPredictor/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: -6092040395344634144 time 0.594944 [01/19/2021-17:50:48] [V] [TRT] BoxPredictor_2/ClassPredictor/Conv2D || BoxPredictor_2/BoxEncodingPredictor/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: -3456450830548107839 time 0.393216 [01/19/2021-17:50:48] [V] [TRT] BoxPredictor_2/ClassPredictor/Conv2D || BoxPredictor_2/BoxEncodingPredictor/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: -410470605513481746 time 0.4864 [01/19/2021-17:50:48] [V] [TRT] Fastest Tactic: 3827454225649558724 Time: 0.106496 [01/19/2021-17:50:48] [V] [TRT] --------------- Timing Runner: BoxPredictor_2/ClassPredictor/Conv2D || BoxPredictor_2/BoxEncodingPredictor/Conv2D (CudaConvolution) [01/19/2021-17:50:48] [V] [TRT] Tactic: 0 time 0.407552 [01/19/2021-17:50:48] [V] [TRT] Tactic: 1 time 0.509952 [01/19/2021-17:50:48] [V] [TRT] Tactic: 2 time 0.342016 [01/19/2021-17:50:48] [V] [TRT] Tactic: 4 skipped. Scratch requested: 684085248, available: 16777216 [01/19/2021-17:50:48] [V] [TRT] Tactic: 5 skipped. Scratch requested: 1274821120, available: 16777216 [01/19/2021-17:50:48] [V] [TRT] Tactic: 6 skipped. Scratch requested: 29383168, available: 16777216 [01/19/2021-17:50:48] [V] [TRT] Fastest Tactic: 2 Time: 0.342016 [01/19/2021-17:50:48] [V] [TRT] --------------- Timing Runner: BoxPredictor_2/ClassPredictor/Conv2D || BoxPredictor_2/BoxEncodingPredictor/Conv2D (CudaDepthwiseConvolution) [01/19/2021-17:50:48] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 26 [01/19/2021-17:50:48] [V] [TRT] [01/19/2021-17:50:48] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:48] [V] [TRT] Tactic: 0 time 0.00512 [01/19/2021-17:50:48] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [01/19/2021-17:50:48] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:48] [V] [TRT] Tactic: 0 time 0.00512 [01/19/2021-17:50:48] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [01/19/2021-17:50:48] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:48] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:48] [V] [TRT] *************** Autotuning format combination: Float(1,5,25,14250) -> Float(1,1,91,13650) *************** [01/19/2021-17:50:48] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 574) [Shuffle] + BoxPredictor_2/Reshape_1 (Shuffle) [01/19/2021-17:50:48] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:48] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:48] [V] [TRT] *************** Autotuning format combination: Float(1,5,25:32,450) -> Float(1,1,91:32,455) *************** [01/19/2021-17:50:48] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 574) [Shuffle] + BoxPredictor_2/Reshape_1 (Shuffle) [01/19/2021-17:50:48] [V] [TRT] Tactic: 0 time 0.00512 [01/19/2021-17:50:48] [V] [TRT] Fastest Tactic: 0 Time: 0.00512 [01/19/2021-17:50:48] [V] [TRT] *************** Autotuning format combination: Float(1,5,25,12800) -> Float(1,5,25,3200) *************** [01/19/2021-17:50:48] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:48] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:48] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:48] [V] [TRT] Tactic: 8 time 0.099328 [01/19/2021-17:50:48] [V] [TRT] Tactic: 9 time 0.064512 [01/19/2021-17:50:48] [V] [TRT] Tactic: 11 time 0.027648 [01/19/2021-17:50:48] [V] [TRT] Tactic: 12 time 0.023552 [01/19/2021-17:50:48] [V] [TRT] Tactic: 17 time 0.013312 [01/19/2021-17:50:48] [V] [TRT] Tactic: 19 time 0.114688 [01/19/2021-17:50:48] [V] [TRT] Tactic: 20 time 0.067584 [01/19/2021-17:50:48] [V] [TRT] Tactic: 21 time 0.01536 [01/19/2021-17:50:48] [V] [TRT] Tactic: 22 time 0.037888 [01/19/2021-17:50:48] [V] [TRT] Tactic: 24 time 0.017408 [01/19/2021-17:50:48] [V] [TRT] Tactic: 27 time 0.0256 [01/19/2021-17:50:48] [V] [TRT] Tactic: 28 time 0.070656 [01/19/2021-17:50:48] [V] [TRT] Tactic: 31 time 0.011264 [01/19/2021-17:50:48] [V] [TRT] Tactic: 32 time 0.069632 [01/19/2021-17:50:48] [V] [TRT] Tactic: 34 time 0.063488 [01/19/2021-17:50:48] [V] [TRT] Tactic: 35 time 0.04096 [01/19/2021-17:50:48] [V] [TRT] Tactic: 40 time 0.064512 [01/19/2021-17:50:48] [V] [TRT] Tactic: 46 time 0.034816 [01/19/2021-17:50:48] [V] [TRT] Tactic: 50 time 0.038912 [01/19/2021-17:50:48] [V] [TRT] Tactic: 51 time 0.034816 [01/19/2021-17:50:48] [V] [TRT] Tactic: 53 time 0.019456 [01/19/2021-17:50:48] [V] [TRT] Tactic: 55 time 0.128 [01/19/2021-17:50:48] [V] [TRT] Tactic: 59 time 0.05632 [01/19/2021-17:50:48] [V] [TRT] Tactic: 60 time 0.016384 [01/19/2021-17:50:48] [V] [TRT] Tactic: 61 time 0.023552 [01/19/2021-17:50:48] [V] [TRT] Tactic: 63 time 0.027648 [01/19/2021-17:50:48] [V] [TRT] Tactic: 64 time 0.011264 [01/19/2021-17:50:48] [V] [TRT] Tactic: 65 time 0.021504 [01/19/2021-17:50:48] [V] [TRT] Tactic: 68 time 0.065536 [01/19/2021-17:50:48] [V] [TRT] Tactic: 69 time 0.01536 [01/19/2021-17:50:48] [V] [TRT] Tactic: 70 time 0.014336 [01/19/2021-17:50:48] [V] [TRT] Tactic: 74 time 0.01536 [01/19/2021-17:50:48] [V] [TRT] Tactic: 75 time 0.037888 [01/19/2021-17:50:48] [V] [TRT] Tactic: 78 time 0.014336 [01/19/2021-17:50:48] [V] [TRT] Tactic: 79 time 0.032768 [01/19/2021-17:50:48] [V] [TRT] Tactic: 81 time 0.014336 [01/19/2021-17:50:48] [V] [TRT] Tactic: 82 time 0.025824 [01/19/2021-17:50:48] [V] [TRT] Tactic: 84 time 0.036864 [01/19/2021-17:50:48] [V] [TRT] Tactic: 85 time 0.023552 [01/19/2021-17:50:48] [V] [TRT] Tactic: 86 time 0.06144 [01/19/2021-17:50:48] [V] [TRT] Tactic: 87 time 0.034816 [01/19/2021-17:50:48] [V] [TRT] Tactic: 88 time 0.033792 [01/19/2021-17:50:48] [V] [TRT] Tactic: 89 time 0.018432 [01/19/2021-17:50:48] [V] [TRT] Tactic: 91 time 0.059392 [01/19/2021-17:50:48] [V] [TRT] Tactic: 94 time 0.018432 [01/19/2021-17:50:48] [V] [TRT] Tactic: 95 time 0.013312 [01/19/2021-17:50:48] [V] [TRT] Tactic: 97 time 0.032768 [01/19/2021-17:50:48] [V] [TRT] Tactic: 102 time 0.01536 [01/19/2021-17:50:48] [V] [TRT] Tactic: 103 time 0.032768 [01/19/2021-17:50:48] [V] [TRT] Tactic: 105 time 0.032768 [01/19/2021-17:50:48] [V] [TRT] Tactic: 106 time 0.01216 [01/19/2021-17:50:48] [V] [TRT] Tactic: 107 time 0.019328 [01/19/2021-17:50:48] [V] [TRT] Tactic: 108 time 0.034816 [01/19/2021-17:50:48] [V] [TRT] Tactic: 109 time 0.033792 [01/19/2021-17:50:48] [V] [TRT] Tactic: 111 time 0.017408 [01/19/2021-17:50:48] [V] [TRT] Tactic: 112 time 0.019456 [01/19/2021-17:50:48] [V] [TRT] Tactic: 114 time 0.0512 [01/19/2021-17:50:48] [V] [TRT] Tactic: 115 time 0.033792 [01/19/2021-17:50:48] [V] [TRT] Tactic: 117 time 0.021504 [01/19/2021-17:50:48] [V] [TRT] Tactic: 118 time 0.027648 [01/19/2021-17:50:48] [V] [TRT] Tactic: 124 time 0.022528 [01/19/2021-17:50:48] [V] [TRT] Tactic: 125 time 0.01536 [01/19/2021-17:50:48] [V] [TRT] Tactic: 126 time 0.026624 [01/19/2021-17:50:48] [V] [TRT] Tactic: 131 time 0.033792 [01/19/2021-17:50:48] [V] [TRT] Tactic: 132 time 0.018432 [01/19/2021-17:50:48] [V] [TRT] Tactic: 138 time 0.011264 [01/19/2021-17:50:48] [V] [TRT] Tactic: 145 time 0.01536 [01/19/2021-17:50:48] [V] [TRT] Tactic: 150 time 0.027648 [01/19/2021-17:50:48] [V] [TRT] Tactic: 155 time 0.064512 [01/19/2021-17:50:48] [V] [TRT] Tactic: 157 time 0.013312 [01/19/2021-17:50:48] [V] [TRT] Tactic: 160 time 0.036864 [01/19/2021-17:50:48] [V] [TRT] Tactic: 163 time 0.021504 [01/19/2021-17:50:48] [V] [TRT] Tactic: 166 time 0.037888 [01/19/2021-17:50:48] [V] [TRT] Fastest Tactic: 31 Time: 0.011264 [01/19/2021-17:50:48] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6 (CaskConvolution) [01/19/2021-17:50:48] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: 1062367460111450758 time 0.049152 [01/19/2021-17:50:48] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: 4501471010995462441 time 0.050176 [01/19/2021-17:50:48] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: 5137655947464784826 time 0.034816 [01/19/2021-17:50:48] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: 5326823351883942011 time 0.048128 [01/19/2021-17:50:48] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: 6645123197870846056 time 0.037888 [01/19/2021-17:50:48] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: -6576203419454146580 time 0.037888 [01/19/2021-17:50:48] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: -3456450830548107839 time 0.039936 [01/19/2021-17:50:48] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: -410470605513481746 time 0.048128 [01/19/2021-17:50:48] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: -37215280111360163 time 0.033792 [01/19/2021-17:50:48] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.033792 [01/19/2021-17:50:48] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6 (CudaConvolution) [01/19/2021-17:50:48] [V] [TRT] Tactic: 0 time 0.044032 [01/19/2021-17:50:48] [V] [TRT] Tactic: 1 time 0.057344 [01/19/2021-17:50:48] [V] [TRT] Tactic: 2 time 0.088064 [01/19/2021-17:50:48] [V] [TRT] Tactic: 4 skipped. Scratch requested: 152436736, available: 16777216 [01/19/2021-17:50:48] [V] [TRT] Tactic: 5 time 0.190464 [01/19/2021-17:50:48] [V] [TRT] Fastest Tactic: 0 Time: 0.044032 [01/19/2021-17:50:48] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:48] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 31 [01/19/2021-17:50:48] [V] [TRT] [01/19/2021-17:50:48] [V] [TRT] *************** Autotuning format combination: Float(1,5,25,3200) -> Float(1,3,9,1152) *************** [01/19/2021-17:50:48] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:48] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:48] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:48] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:48] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6 (CaskConvolution) [01/19/2021-17:50:48] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: 1062367460111450758 time 0.973824 [01/19/2021-17:50:48] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: 4337000649858996379 time 0.897024 [01/19/2021-17:50:48] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: 4501471010995462441 time 0.905184 [01/19/2021-17:50:48] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: 5137655947464784826 time 0.836608 [01/19/2021-17:50:48] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: 6645123197870846056 time 0.8704 [01/19/2021-17:50:48] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: -9137461792520977713 time 0.918528 [01/19/2021-17:50:48] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: -6092040395344634144 time 1.01478 [01/19/2021-17:50:48] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: -3456450830548107839 time 0.887808 [01/19/2021-17:50:48] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: -410470605513481746 time 0.902144 [01/19/2021-17:50:48] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.836608 [01/19/2021-17:50:48] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6 (CudaConvolution) [01/19/2021-17:50:48] [V] [TRT] Tactic: 0 time 0.008192 [01/19/2021-17:50:48] [V] [TRT] Tactic: 1 time 0.632832 [01/19/2021-17:50:48] [V] [TRT] Tactic: 2 time 1.14877 [01/19/2021-17:50:48] [V] [TRT] Tactic: 5 time 4.36941 [01/19/2021-17:50:48] [V] [TRT] Fastest Tactic: 0 Time: 0.008192 [01/19/2021-17:50:48] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:48] [V] [TRT] Tactic: -1 time 0.00512 [01/19/2021-17:50:48] [V] [TRT] Fastest Tactic: -1 Time: 0.00512 [01/19/2021-17:50:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [01/19/2021-17:50:48] [V] [TRT] [01/19/2021-17:50:48] [V] [TRT] *************** Autotuning format combination: Float(1,3,9,1152) -> Float(1,3,9,2304) *************** [01/19/2021-17:50:48] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:48] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:48] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:48] [V] [TRT] Tactic: 8 time 0.028672 [01/19/2021-17:50:48] [V] [TRT] Tactic: 9 time 0.021504 [01/19/2021-17:50:48] [V] [TRT] Tactic: 11 time 0.012288 [01/19/2021-17:50:48] [V] [TRT] Tactic: 12 time 0.01024 [01/19/2021-17:50:48] [V] [TRT] Tactic: 17 time 0.007168 [01/19/2021-17:50:48] [V] [TRT] Tactic: 19 time 0.034816 [01/19/2021-17:50:48] [V] [TRT] Tactic: 20 time 0.021376 [01/19/2021-17:50:48] [V] [TRT] Tactic: 21 time 0.007168 [01/19/2021-17:50:48] [V] [TRT] Tactic: 22 time 0.014336 [01/19/2021-17:50:48] [V] [TRT] Tactic: 24 time 0.008192 [01/19/2021-17:50:48] [V] [TRT] Tactic: 27 time 0.011264 [01/19/2021-17:50:48] [V] [TRT] Tactic: 28 time 0.022528 [01/19/2021-17:50:48] [V] [TRT] Tactic: 31 time 0.006144 [01/19/2021-17:50:48] [V] [TRT] Tactic: 32 time 0.022528 [01/19/2021-17:50:48] [V] [TRT] Tactic: 34 time 0.02048 [01/19/2021-17:50:48] [V] [TRT] Tactic: 35 time 0.016256 [01/19/2021-17:50:48] [V] [TRT] Tactic: 40 time 0.020352 [01/19/2021-17:50:48] [V] [TRT] Tactic: 46 time 0.013312 [01/19/2021-17:50:48] [V] [TRT] Tactic: 50 time 0.014336 [01/19/2021-17:50:48] [V] [TRT] Tactic: 51 time 0.013312 [01/19/2021-17:50:48] [V] [TRT] Tactic: 53 time 0.008192 [01/19/2021-17:50:48] [V] [TRT] Tactic: 55 time 0.037888 [01/19/2021-17:50:48] [V] [TRT] Tactic: 59 time 0.017408 [01/19/2021-17:50:48] [V] [TRT] Tactic: 60 time 0.008192 [01/19/2021-17:50:48] [V] [TRT] Tactic: 61 time 0.01024 [01/19/2021-17:50:48] [V] [TRT] Tactic: 63 time 0.012288 [01/19/2021-17:50:48] [V] [TRT] Tactic: 64 time 0.007168 [01/19/2021-17:50:48] [V] [TRT] Tactic: 65 time 0.009216 [01/19/2021-17:50:48] [V] [TRT] Tactic: 68 time 0.021504 [01/19/2021-17:50:48] [V] [TRT] Tactic: 69 time 0.008192 [01/19/2021-17:50:48] [V] [TRT] Tactic: 70 time 0.007168 [01/19/2021-17:50:48] [V] [TRT] Tactic: 74 time 0.008192 [01/19/2021-17:50:48] [V] [TRT] Tactic: 75 time 0.01536 [01/19/2021-17:50:48] [V] [TRT] Tactic: 78 time 0.007168 [01/19/2021-17:50:48] [V] [TRT] Tactic: 79 time 0.012288 [01/19/2021-17:50:48] [V] [TRT] Tactic: 81 time 0.00704 [01/19/2021-17:50:48] [V] [TRT] Tactic: 82 time 0.01024 [01/19/2021-17:50:48] [V] [TRT] Tactic: 84 time 0.013312 [01/19/2021-17:50:48] [V] [TRT] Tactic: 85 time 0.010144 [01/19/2021-17:50:48] [V] [TRT] Tactic: 86 time 0.019456 [01/19/2021-17:50:48] [V] [TRT] Tactic: 87 time 0.011264 [01/19/2021-17:50:48] [V] [TRT] Tactic: 88 time 0.012288 [01/19/2021-17:50:48] [V] [TRT] Tactic: 89 time 0.008192 [01/19/2021-17:50:48] [V] [TRT] Tactic: 91 time 0.018432 [01/19/2021-17:50:48] [V] [TRT] Tactic: 94 time 0.008192 [01/19/2021-17:50:48] [V] [TRT] Tactic: 95 time 0.007168 [01/19/2021-17:50:48] [V] [TRT] Tactic: 97 time 0.011264 [01/19/2021-17:50:48] [V] [TRT] Tactic: 102 time 0.008192 [01/19/2021-17:50:48] [V] [TRT] Tactic: 103 time 0.012288 [01/19/2021-17:50:48] [V] [TRT] Tactic: 105 time 0.012288 [01/19/2021-17:50:48] [V] [TRT] Tactic: 106 time 0.006144 [01/19/2021-17:50:48] [V] [TRT] Tactic: 107 time 0.008192 [01/19/2021-17:50:48] [V] [TRT] Tactic: 108 time 0.012288 [01/19/2021-17:50:48] [V] [TRT] Tactic: 109 time 0.012288 [01/19/2021-17:50:48] [V] [TRT] Tactic: 111 time 0.007168 [01/19/2021-17:50:48] [V] [TRT] Tactic: 112 time 0.009088 [01/19/2021-17:50:48] [V] [TRT] Tactic: 114 time 0.016192 [01/19/2021-17:50:48] [V] [TRT] Tactic: 115 time 0.012288 [01/19/2021-17:50:48] [V] [TRT] Tactic: 117 time 0.009216 [01/19/2021-17:50:48] [V] [TRT] Tactic: 118 time 0.011264 [01/19/2021-17:50:48] [V] [TRT] Tactic: 124 time 0.009216 [01/19/2021-17:50:48] [V] [TRT] Tactic: 125 time 0.008192 [01/19/2021-17:50:48] [V] [TRT] Tactic: 126 time 0.01024 [01/19/2021-17:50:48] [V] [TRT] Tactic: 131 time 0.012288 [01/19/2021-17:50:48] [V] [TRT] Tactic: 132 time 0.008192 [01/19/2021-17:50:48] [V] [TRT] Tactic: 138 time 0.006144 [01/19/2021-17:50:48] [V] [TRT] Tactic: 145 time 0.008192 [01/19/2021-17:50:48] [V] [TRT] Tactic: 150 time 0.012288 [01/19/2021-17:50:48] [V] [TRT] Tactic: 155 time 0.02048 [01/19/2021-17:50:48] [V] [TRT] Tactic: 157 time 0.007168 [01/19/2021-17:50:48] [V] [TRT] Tactic: 160 time 0.013312 [01/19/2021-17:50:48] [V] [TRT] Tactic: 163 time 0.009216 [01/19/2021-17:50:48] [V] [TRT] Tactic: 166 time 0.014336 [01/19/2021-17:50:48] [V] [TRT] Fastest Tactic: 31 Time: 0.006144 [01/19/2021-17:50:48] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6 (CaskConvolution) [01/19/2021-17:50:48] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: 1062367460111450758 time 0.018432 [01/19/2021-17:50:48] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: 4501471010995462441 time 0.018432 [01/19/2021-17:50:48] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: 5137655947464784826 time 0.014336 [01/19/2021-17:50:48] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: 5326823351883942011 time 0.018432 [01/19/2021-17:50:48] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: 6645123197870846056 time 0.01536 [01/19/2021-17:50:48] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: -6576203419454146580 time 0.01536 [01/19/2021-17:50:48] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: -3456450830548107839 time 0.016384 [01/19/2021-17:50:48] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: -410470605513481746 time 0.018432 [01/19/2021-17:50:48] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: -37215280111360163 time 0.014336 [01/19/2021-17:50:48] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.014336 [01/19/2021-17:50:48] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6 (CudaConvolution) [01/19/2021-17:50:48] [V] [TRT] Tactic: 0 time 0.017408 [01/19/2021-17:50:48] [V] [TRT] Tactic: 1 time 0.024576 [01/19/2021-17:50:48] [V] [TRT] Tactic: 2 time 0.044032 [01/19/2021-17:50:48] [V] [TRT] Tactic: 4 skipped. Scratch requested: 75923456, available: 16777216 [01/19/2021-17:50:48] [V] [TRT] Tactic: 5 time 0.123904 [01/19/2021-17:50:48] [V] [TRT] Fastest Tactic: 0 Time: 0.017408 [01/19/2021-17:50:48] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:48] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 31 [01/19/2021-17:50:48] [V] [TRT] [01/19/2021-17:50:48] [V] [TRT] *************** Autotuning format combination: Float(1,3,9,2304) -> Float(1,3,9,5130) *************** [01/19/2021-17:50:48] [V] [TRT] --------------- Timing Runner: BoxPredictor_3/ClassPredictor/Conv2D || BoxPredictor_3/BoxEncodingPredictor/Conv2D (LegacySASSConvolution) [01/19/2021-17:50:48] [V] [TRT] Tactic: 0 time 0.275456 [01/19/2021-17:50:48] [V] [TRT] Tactic: 1 time 0.065536 [01/19/2021-17:50:48] [V] [TRT] Fastest Tactic: 1 Time: 0.065536 [01/19/2021-17:50:48] [V] [TRT] --------------- Timing Runner: BoxPredictor_3/ClassPredictor/Conv2D || BoxPredictor_3/BoxEncodingPredictor/Conv2D (FusedConvActConvolution) [01/19/2021-17:50:48] [V] [TRT] Tactic: 7 time 0.13312 [01/19/2021-17:50:48] [V] [TRT] Tactic: 10 time 0.088064 [01/19/2021-17:50:48] [V] [TRT] Tactic: 14 time 0.047104 [01/19/2021-17:50:48] [V] [TRT] Tactic: 15 time 0.089088 [01/19/2021-17:50:48] [V] [TRT] Tactic: 25 time 0.054272 [01/19/2021-17:50:48] [V] [TRT] Tactic: 26 time 0.039936 [01/19/2021-17:50:48] [V] [TRT] Tactic: 29 time 0.168736 [01/19/2021-17:50:48] [V] [TRT] Tactic: 30 time 0.156672 [01/19/2021-17:50:48] [V] [TRT] Tactic: 33 time 0.154624 [01/19/2021-17:50:48] [V] [TRT] Tactic: 36 time 0.062464 [01/19/2021-17:50:48] [V] [TRT] Tactic: 39 time 0.041984 [01/19/2021-17:50:48] [V] [TRT] Tactic: 41 time 0.096 [01/19/2021-17:50:48] [V] [TRT] Tactic: 45 time 0.062464 [01/19/2021-17:50:48] [V] [TRT] Tactic: 47 time 0.052224 [01/19/2021-17:50:48] [V] [TRT] Tactic: 54 time 0.06144 [01/19/2021-17:50:48] [V] [TRT] Tactic: 66 time 0.183296 [01/19/2021-17:50:48] [V] [TRT] Tactic: 76 time 0.073728 [01/19/2021-17:50:48] [V] [TRT] Tactic: 90 time 0.167936 [01/19/2021-17:50:48] [V] [TRT] Tactic: 93 time 0.119808 [01/19/2021-17:50:48] [V] [TRT] Tactic: 98 time 0.091136 [01/19/2021-17:50:48] [V] [TRT] Tactic: 104 time 0.13824 [01/19/2021-17:50:48] [V] [TRT] Tactic: 110 time 0.038912 [01/19/2021-17:50:48] [V] [TRT] Tactic: 119 time 0.044032 [01/19/2021-17:50:48] [V] [TRT] Tactic: 121 time 0.089088 [01/19/2021-17:50:48] [V] [TRT] Tactic: 130 time 0.1536 [01/19/2021-17:50:48] [V] [TRT] Tactic: 134 time 0.047904 [01/19/2021-17:50:48] [V] [TRT] Tactic: 136 time 0.167936 [01/19/2021-17:50:48] [V] [TRT] Tactic: 137 time 0.057344 [01/19/2021-17:50:48] [V] [TRT] Tactic: 139 time 0.06144 [01/19/2021-17:50:48] [V] [TRT] Tactic: 144 time 0.180224 [01/19/2021-17:50:48] [V] [TRT] Tactic: 151 time 0.0512 [01/19/2021-17:50:48] [V] [TRT] Tactic: 152 time 0.078848 [01/19/2021-17:50:48] [V] [TRT] Tactic: 153 time 0.18304 [01/19/2021-17:50:48] [V] [TRT] Tactic: 156 time 0.167936 [01/19/2021-17:50:48] [V] [TRT] Tactic: 159 time 0.048128 [01/19/2021-17:50:48] [V] [TRT] Tactic: 162 time 0.04096 [01/19/2021-17:50:48] [V] [TRT] Tactic: 164 time 0.048128 [01/19/2021-17:50:48] [V] [TRT] Fastest Tactic: 110 Time: 0.038912 [01/19/2021-17:50:48] [V] [TRT] --------------- Timing Runner: BoxPredictor_3/ClassPredictor/Conv2D || BoxPredictor_3/BoxEncodingPredictor/Conv2D (CaskConvolution) [01/19/2021-17:50:48] [V] [TRT] BoxPredictor_3/ClassPredictor/Conv2D || BoxPredictor_3/BoxEncodingPredictor/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: 1062367460111450758 time 0.280576 [01/19/2021-17:50:48] [V] [TRT] BoxPredictor_3/ClassPredictor/Conv2D || BoxPredictor_3/BoxEncodingPredictor/Conv2D (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [01/19/2021-17:50:48] [V] [TRT] Tactic: 3827454225649558724 time 0.057344 [01/19/2021-17:50:48] [V] [TRT] BoxPredictor_3/ClassPredictor/Conv2D || BoxPredictor_3/BoxEncodingPredictor/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: 4337000649858996379 time 0.22528 [01/19/2021-17:50:49] [V] [TRT] BoxPredictor_3/ClassPredictor/Conv2D || BoxPredictor_3/BoxEncodingPredictor/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: 4501471010995462441 time 0.249856 [01/19/2021-17:50:49] [V] [TRT] BoxPredictor_3/ClassPredictor/Conv2D || BoxPredictor_3/BoxEncodingPredictor/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: 5137655947464784826 time 0.183072 [01/19/2021-17:50:49] [V] [TRT] BoxPredictor_3/ClassPredictor/Conv2D || BoxPredictor_3/BoxEncodingPredictor/Conv2D (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: 5921334924264294896 time 0.060416 [01/19/2021-17:50:49] [V] [TRT] BoxPredictor_3/ClassPredictor/Conv2D || BoxPredictor_3/BoxEncodingPredictor/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: 6645123197870846056 time 0.212992 [01/19/2021-17:50:49] [V] [TRT] BoxPredictor_3/ClassPredictor/Conv2D || BoxPredictor_3/BoxEncodingPredictor/Conv2D (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: 7852627285308570038 time 0.059392 [01/19/2021-17:50:49] [V] [TRT] BoxPredictor_3/ClassPredictor/Conv2D || BoxPredictor_3/BoxEncodingPredictor/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: -9137461792520977713 time 0.27136 [01/19/2021-17:50:49] [V] [TRT] BoxPredictor_3/ClassPredictor/Conv2D || BoxPredictor_3/BoxEncodingPredictor/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: -6092040395344634144 time 0.305152 [01/19/2021-17:50:49] [V] [TRT] BoxPredictor_3/ClassPredictor/Conv2D || BoxPredictor_3/BoxEncodingPredictor/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: -3456450830548107839 time 0.19968 [01/19/2021-17:50:49] [V] [TRT] BoxPredictor_3/ClassPredictor/Conv2D || BoxPredictor_3/BoxEncodingPredictor/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: -410470605513481746 time 0.244736 [01/19/2021-17:50:49] [V] [TRT] Fastest Tactic: 3827454225649558724 Time: 0.057344 [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: BoxPredictor_3/ClassPredictor/Conv2D || BoxPredictor_3/BoxEncodingPredictor/Conv2D (CudaConvolution) [01/19/2021-17:50:49] [V] [TRT] Tactic: 0 time 0.20992 [01/19/2021-17:50:49] [V] [TRT] Tactic: 1 time 0.264192 [01/19/2021-17:50:49] [V] [TRT] Tactic: 2 time 0.197632 [01/19/2021-17:50:49] [V] [TRT] Tactic: 4 skipped. Scratch requested: 342042624, available: 16777216 [01/19/2021-17:50:49] [V] [TRT] Tactic: 5 skipped. Scratch requested: 638663168, available: 16777216 [01/19/2021-17:50:49] [V] [TRT] Tactic: 6 time 0.13824 [01/19/2021-17:50:49] [V] [TRT] Fastest Tactic: 6 Time: 0.13824 [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: BoxPredictor_3/ClassPredictor/Conv2D || BoxPredictor_3/BoxEncodingPredictor/Conv2D (CudaDepthwiseConvolution) [01/19/2021-17:50:49] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 110 [01/19/2021-17:50:49] [V] [TRT] [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:49] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:49] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:49] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:49] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:49] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:49] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:49] [V] [TRT] *************** Autotuning format combination: Float(1,3,9,5130) -> Float(1,1,91,4914) *************** [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 615) [Shuffle] + BoxPredictor_3/Reshape_1 (Shuffle) [01/19/2021-17:50:49] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:49] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:49] [V] [TRT] *************** Autotuning format combination: Float(1,3,9:32,162) -> Float(1,1,91:32,182) *************** [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 615) [Shuffle] + BoxPredictor_3/Reshape_1 (Shuffle) [01/19/2021-17:50:49] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:49] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:49] [V] [TRT] *************** Autotuning format combination: Float(1,3,9,2304) -> Float(1,3,9,1152) *************** [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:49] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:49] [V] [TRT] Tactic: 8 time 0.053248 [01/19/2021-17:50:49] [V] [TRT] Tactic: 9 time 0.034816 [01/19/2021-17:50:49] [V] [TRT] Tactic: 11 time 0.016384 [01/19/2021-17:50:49] [V] [TRT] Tactic: 12 time 0.014336 [01/19/2021-17:50:49] [V] [TRT] Tactic: 17 time 0.009216 [01/19/2021-17:50:49] [V] [TRT] Tactic: 19 time 0.06144 [01/19/2021-17:50:49] [V] [TRT] Tactic: 20 time 0.03584 [01/19/2021-17:50:49] [V] [TRT] Tactic: 21 time 0.01008 [01/19/2021-17:50:49] [V] [TRT] Tactic: 22 time 0.0224 [01/19/2021-17:50:49] [V] [TRT] Tactic: 24 time 0.011264 [01/19/2021-17:50:49] [V] [TRT] Tactic: 27 time 0.016192 [01/19/2021-17:50:49] [V] [TRT] Tactic: 28 time 0.037888 [01/19/2021-17:50:49] [V] [TRT] Tactic: 31 time 0.008192 [01/19/2021-17:50:49] [V] [TRT] Tactic: 32 time 0.037888 [01/19/2021-17:50:49] [V] [TRT] Tactic: 34 time 0.034816 [01/19/2021-17:50:49] [V] [TRT] Tactic: 35 time 0.024576 [01/19/2021-17:50:49] [V] [TRT] Tactic: 40 time 0.034816 [01/19/2021-17:50:49] [V] [TRT] Tactic: 46 time 0.02048 [01/19/2021-17:50:49] [V] [TRT] Tactic: 50 time 0.022528 [01/19/2021-17:50:49] [V] [TRT] Tactic: 51 time 0.02048 [01/19/2021-17:50:49] [V] [TRT] Tactic: 53 time 0.012288 [01/19/2021-17:50:49] [V] [TRT] Tactic: 55 time 0.067584 [01/19/2021-17:50:49] [V] [TRT] Tactic: 59 time 0.03072 [01/19/2021-17:50:49] [V] [TRT] Tactic: 60 time 0.01024 [01/19/2021-17:50:49] [V] [TRT] Tactic: 61 time 0.013312 [01/19/2021-17:50:49] [V] [TRT] Tactic: 63 time 0.016384 [01/19/2021-17:50:49] [V] [TRT] Tactic: 64 time 0.008192 [01/19/2021-17:50:49] [V] [TRT] Tactic: 65 time 0.013312 [01/19/2021-17:50:49] [V] [TRT] Tactic: 68 time 0.03584 [01/19/2021-17:50:49] [V] [TRT] Tactic: 69 time 0.01024 [01/19/2021-17:50:49] [V] [TRT] Tactic: 70 time 0.009216 [01/19/2021-17:50:49] [V] [TRT] Tactic: 74 time 0.01024 [01/19/2021-17:50:49] [V] [TRT] Tactic: 75 time 0.022528 [01/19/2021-17:50:49] [V] [TRT] Tactic: 78 time 0.009216 [01/19/2021-17:50:49] [V] [TRT] Tactic: 79 time 0.018432 [01/19/2021-17:50:49] [V] [TRT] Tactic: 81 time 0.009216 [01/19/2021-17:50:49] [V] [TRT] Tactic: 82 time 0.01536 [01/19/2021-17:50:49] [V] [TRT] Tactic: 84 time 0.021504 [01/19/2021-17:50:49] [V] [TRT] Tactic: 85 time 0.014336 [01/19/2021-17:50:49] [V] [TRT] Tactic: 86 time 0.032768 [01/19/2021-17:50:49] [V] [TRT] Tactic: 87 time 0.017408 [01/19/2021-17:50:49] [V] [TRT] Tactic: 88 time 0.019456 [01/19/2021-17:50:49] [V] [TRT] Tactic: 89 time 0.011264 [01/19/2021-17:50:49] [V] [TRT] Tactic: 91 time 0.031744 [01/19/2021-17:50:49] [V] [TRT] Tactic: 94 time 0.011264 [01/19/2021-17:50:49] [V] [TRT] Tactic: 95 time 0.009216 [01/19/2021-17:50:49] [V] [TRT] Tactic: 97 time 0.018432 [01/19/2021-17:50:49] [V] [TRT] Tactic: 102 time 0.01024 [01/19/2021-17:50:49] [V] [TRT] Tactic: 103 time 0.018432 [01/19/2021-17:50:49] [V] [TRT] Tactic: 105 time 0.019456 [01/19/2021-17:50:49] [V] [TRT] Tactic: 106 time 0.008192 [01/19/2021-17:50:49] [V] [TRT] Tactic: 107 time 0.012288 [01/19/2021-17:50:49] [V] [TRT] Tactic: 108 time 0.017408 [01/19/2021-17:50:49] [V] [TRT] Tactic: 109 time 0.020384 [01/19/2021-17:50:49] [V] [TRT] Tactic: 111 time 0.011264 [01/19/2021-17:50:49] [V] [TRT] Tactic: 112 time 0.012288 [01/19/2021-17:50:49] [V] [TRT] Tactic: 114 time 0.02752 [01/19/2021-17:50:49] [V] [TRT] Tactic: 115 time 0.019456 [01/19/2021-17:50:49] [V] [TRT] Tactic: 117 time 0.013312 [01/19/2021-17:50:49] [V] [TRT] Tactic: 118 time 0.016384 [01/19/2021-17:50:49] [V] [TRT] Tactic: 124 time 0.013312 [01/19/2021-17:50:49] [V] [TRT] Tactic: 125 time 0.01024 [01/19/2021-17:50:49] [V] [TRT] Tactic: 126 time 0.01536 [01/19/2021-17:50:49] [V] [TRT] Tactic: 131 time 0.019456 [01/19/2021-17:50:49] [V] [TRT] Tactic: 132 time 0.011264 [01/19/2021-17:50:49] [V] [TRT] Tactic: 138 time 0.008192 [01/19/2021-17:50:49] [V] [TRT] Tactic: 145 time 0.01024 [01/19/2021-17:50:49] [V] [TRT] Tactic: 150 time 0.017408 [01/19/2021-17:50:49] [V] [TRT] Tactic: 155 time 0.034816 [01/19/2021-17:50:49] [V] [TRT] Tactic: 157 time 0.009216 [01/19/2021-17:50:49] [V] [TRT] Tactic: 160 time 0.02048 [01/19/2021-17:50:49] [V] [TRT] Tactic: 163 time 0.014336 [01/19/2021-17:50:49] [V] [TRT] Tactic: 166 time 0.022528 [01/19/2021-17:50:49] [V] [TRT] Fastest Tactic: 31 Time: 0.008192 [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6 (CaskConvolution) [01/19/2021-17:50:49] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: 1062367460111450758 time 0.028672 [01/19/2021-17:50:49] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: 4501471010995462441 time 0.028672 [01/19/2021-17:50:49] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: 5137655947464784826 time 0.021504 [01/19/2021-17:50:49] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: 5326823351883942011 time 0.028672 [01/19/2021-17:50:49] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: 6645123197870846056 time 0.022528 [01/19/2021-17:50:49] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: -6576203419454146580 time 0.023552 [01/19/2021-17:50:49] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: -3456450830548107839 time 0.024576 [01/19/2021-17:50:49] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: -410470605513481746 time 0.027648 [01/19/2021-17:50:49] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: -37215280111360163 time 0.02048 [01/19/2021-17:50:49] [V] [TRT] Fastest Tactic: -37215280111360163 Time: 0.02048 [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6 (CudaConvolution) [01/19/2021-17:50:49] [V] [TRT] Tactic: 0 time 0.026624 [01/19/2021-17:50:49] [V] [TRT] Tactic: 1 time 0.034816 [01/19/2021-17:50:49] [V] [TRT] Tactic: 2 time 0.078848 [01/19/2021-17:50:49] [V] [TRT] Tactic: 4 skipped. Scratch requested: 76218368, available: 16777216 [01/19/2021-17:50:49] [V] [TRT] Tactic: 5 time 0.119808 [01/19/2021-17:50:49] [V] [TRT] Fastest Tactic: 0 Time: 0.026624 [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:49] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 31 [01/19/2021-17:50:49] [V] [TRT] [01/19/2021-17:50:49] [V] [TRT] *************** Autotuning format combination: Float(1,3,9,1152) -> Float(1,2,4,512) *************** [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:49] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:49] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6 (CaskConvolution) [01/19/2021-17:50:49] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: 1062367460111450758 time 0.939008 [01/19/2021-17:50:49] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: 4337000649858996379 time 0.87552 [01/19/2021-17:50:49] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: 4501471010995462441 time 0.896 [01/19/2021-17:50:49] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: 5137655947464784826 time 0.833536 [01/19/2021-17:50:49] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: 6645123197870846056 time 0.84992 [01/19/2021-17:50:49] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: -9137461792520977713 time 0.907264 [01/19/2021-17:50:49] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: -6092040395344634144 time 0.976896 [01/19/2021-17:50:49] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: -3456450830548107839 time 0.881664 [01/19/2021-17:50:49] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: -410470605513481746 time 0.898048 [01/19/2021-17:50:49] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.833536 [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6 (CudaConvolution) [01/19/2021-17:50:49] [V] [TRT] Tactic: 0 time 0.008192 [01/19/2021-17:50:49] [V] [TRT] Tactic: 1 time 0.618496 [01/19/2021-17:50:49] [V] [TRT] Tactic: 2 time 1.11917 [01/19/2021-17:50:49] [V] [TRT] Tactic: 5 time 4.36326 [01/19/2021-17:50:49] [V] [TRT] Fastest Tactic: 0 Time: 0.008192 [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:49] [V] [TRT] Tactic: -1 time 0.00512 [01/19/2021-17:50:49] [V] [TRT] Fastest Tactic: -1 Time: 0.00512 [01/19/2021-17:50:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [01/19/2021-17:50:49] [V] [TRT] [01/19/2021-17:50:49] [V] [TRT] *************** Autotuning format combination: Float(1,2,4,512) -> Float(1,2,4,1024) *************** [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:49] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:49] [V] [TRT] Tactic: 8 time 0.027648 [01/19/2021-17:50:49] [V] [TRT] Tactic: 9 time 0.021504 [01/19/2021-17:50:49] [V] [TRT] Tactic: 11 time 0.011264 [01/19/2021-17:50:49] [V] [TRT] Tactic: 12 time 0.009216 [01/19/2021-17:50:49] [V] [TRT] Tactic: 17 time 0.007168 [01/19/2021-17:50:49] [V] [TRT] Tactic: 19 time 0.034816 [01/19/2021-17:50:49] [V] [TRT] Tactic: 20 time 0.021504 [01/19/2021-17:50:49] [V] [TRT] Tactic: 21 time 0.007168 [01/19/2021-17:50:49] [V] [TRT] Tactic: 22 time 0.014336 [01/19/2021-17:50:49] [V] [TRT] Tactic: 24 time 0.008192 [01/19/2021-17:50:49] [V] [TRT] Tactic: 27 time 0.01024 [01/19/2021-17:50:49] [V] [TRT] Tactic: 28 time 0.022528 [01/19/2021-17:50:49] [V] [TRT] Tactic: 31 time 0.006144 [01/19/2021-17:50:49] [V] [TRT] Tactic: 32 time 0.022528 [01/19/2021-17:50:49] [V] [TRT] Tactic: 34 time 0.02048 [01/19/2021-17:50:49] [V] [TRT] Tactic: 35 time 0.016384 [01/19/2021-17:50:49] [V] [TRT] Tactic: 40 time 0.02048 [01/19/2021-17:50:49] [V] [TRT] Tactic: 46 time 0.012288 [01/19/2021-17:50:49] [V] [TRT] Tactic: 50 time 0.014336 [01/19/2021-17:50:49] [V] [TRT] Tactic: 51 time 0.013312 [01/19/2021-17:50:49] [V] [TRT] Tactic: 53 time 0.008192 [01/19/2021-17:50:49] [V] [TRT] Tactic: 55 time 0.036864 [01/19/2021-17:50:49] [V] [TRT] Tactic: 59 time 0.017408 [01/19/2021-17:50:49] [V] [TRT] Tactic: 60 time 0.008192 [01/19/2021-17:50:49] [V] [TRT] Tactic: 61 time 0.009216 [01/19/2021-17:50:49] [V] [TRT] Tactic: 63 time 0.012288 [01/19/2021-17:50:49] [V] [TRT] Tactic: 64 time 0.006144 [01/19/2021-17:50:49] [V] [TRT] Tactic: 65 time 0.009216 [01/19/2021-17:50:49] [V] [TRT] Tactic: 68 time 0.021504 [01/19/2021-17:50:49] [V] [TRT] Tactic: 69 time 0.007168 [01/19/2021-17:50:49] [V] [TRT] Tactic: 70 time 0.007168 [01/19/2021-17:50:49] [V] [TRT] Tactic: 74 time 0.008192 [01/19/2021-17:50:49] [V] [TRT] Tactic: 75 time 0.01536 [01/19/2021-17:50:49] [V] [TRT] Tactic: 78 time 0.006144 [01/19/2021-17:50:49] [V] [TRT] Tactic: 79 time 0.012288 [01/19/2021-17:50:49] [V] [TRT] Tactic: 81 time 0.006144 [01/19/2021-17:50:49] [V] [TRT] Tactic: 82 time 0.01024 [01/19/2021-17:50:49] [V] [TRT] Tactic: 84 time 0.013312 [01/19/2021-17:50:49] [V] [TRT] Tactic: 85 time 0.009216 [01/19/2021-17:50:49] [V] [TRT] Tactic: 86 time 0.018432 [01/19/2021-17:50:49] [V] [TRT] Tactic: 87 time 0.011264 [01/19/2021-17:50:49] [V] [TRT] Tactic: 88 time 0.012288 [01/19/2021-17:50:49] [V] [TRT] Tactic: 89 time 0.008192 [01/19/2021-17:50:49] [V] [TRT] Tactic: 91 time 0.018432 [01/19/2021-17:50:49] [V] [TRT] Tactic: 94 time 0.008192 [01/19/2021-17:50:49] [V] [TRT] Tactic: 95 time 0.006144 [01/19/2021-17:50:49] [V] [TRT] Tactic: 97 time 0.011264 [01/19/2021-17:50:49] [V] [TRT] Tactic: 102 time 0.007168 [01/19/2021-17:50:49] [V] [TRT] Tactic: 103 time 0.012288 [01/19/2021-17:50:49] [V] [TRT] Tactic: 105 time 0.012288 [01/19/2021-17:50:49] [V] [TRT] Tactic: 106 time 0.006144 [01/19/2021-17:50:49] [V] [TRT] Tactic: 107 time 0.008192 [01/19/2021-17:50:49] [V] [TRT] Tactic: 108 time 0.011264 [01/19/2021-17:50:49] [V] [TRT] Tactic: 109 time 0.012288 [01/19/2021-17:50:49] [V] [TRT] Tactic: 111 time 0.008192 [01/19/2021-17:50:49] [V] [TRT] Tactic: 112 time 0.008192 [01/19/2021-17:50:49] [V] [TRT] Tactic: 114 time 0.01536 [01/19/2021-17:50:49] [V] [TRT] Tactic: 115 time 0.012288 [01/19/2021-17:50:49] [V] [TRT] Tactic: 117 time 0.009216 [01/19/2021-17:50:49] [V] [TRT] Tactic: 118 time 0.011264 [01/19/2021-17:50:49] [V] [TRT] Tactic: 124 time 0.009216 [01/19/2021-17:50:49] [V] [TRT] Tactic: 125 time 0.008192 [01/19/2021-17:50:49] [V] [TRT] Tactic: 126 time 0.01024 [01/19/2021-17:50:49] [V] [TRT] Tactic: 131 time 0.012288 [01/19/2021-17:50:49] [V] [TRT] Tactic: 132 time 0.008192 [01/19/2021-17:50:49] [V] [TRT] Tactic: 138 time 0.006144 [01/19/2021-17:50:49] [V] [TRT] Tactic: 145 time 0.008192 [01/19/2021-17:50:49] [V] [TRT] Tactic: 150 time 0.012288 [01/19/2021-17:50:49] [V] [TRT] Tactic: 155 time 0.02048 [01/19/2021-17:50:49] [V] [TRT] Tactic: 157 time 0.007168 [01/19/2021-17:50:49] [V] [TRT] Tactic: 160 time 0.012288 [01/19/2021-17:50:49] [V] [TRT] Tactic: 163 time 0.009216 [01/19/2021-17:50:49] [V] [TRT] Tactic: 166 time 0.014336 [01/19/2021-17:50:49] [V] [TRT] Fastest Tactic: 31 Time: 0.006144 [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6 (CaskConvolution) [01/19/2021-17:50:49] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: 1062367460111450758 time 0.018432 [01/19/2021-17:50:49] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: 4501471010995462441 time 0.018432 [01/19/2021-17:50:49] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: 5137655947464784826 time 0.014336 [01/19/2021-17:50:49] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: 5326823351883942011 time 0.018432 [01/19/2021-17:50:49] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: 6645123197870846056 time 0.01536 [01/19/2021-17:50:49] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: -6576203419454146580 time 0.01536 [01/19/2021-17:50:49] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: -3456450830548107839 time 0.016384 [01/19/2021-17:50:49] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: -410470605513481746 time 0.018432 [01/19/2021-17:50:49] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: -37215280111360163 time 0.014336 [01/19/2021-17:50:49] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.014336 [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6 (CudaConvolution) [01/19/2021-17:50:49] [V] [TRT] Tactic: 0 time 0.016384 [01/19/2021-17:50:49] [V] [TRT] Tactic: 1 time 0.024576 [01/19/2021-17:50:49] [V] [TRT] Tactic: 2 time 0.045056 [01/19/2021-17:50:49] [V] [TRT] Tactic: 4 skipped. Scratch requested: 75923456, available: 16777216 [01/19/2021-17:50:49] [V] [TRT] Tactic: 5 time 0.121856 [01/19/2021-17:50:49] [V] [TRT] Fastest Tactic: 0 Time: 0.016384 [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:49] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 31 [01/19/2021-17:50:49] [V] [TRT] [01/19/2021-17:50:49] [V] [TRT] *************** Autotuning format combination: Float(1,2,4,1024) -> Float(1,2,4,2280) *************** [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: BoxPredictor_4/ClassPredictor/Conv2D || BoxPredictor_4/BoxEncodingPredictor/Conv2D (LegacySASSConvolution) [01/19/2021-17:50:49] [V] [TRT] Tactic: 0 time 0.275456 [01/19/2021-17:50:49] [V] [TRT] Tactic: 1 time 0.065536 [01/19/2021-17:50:49] [V] [TRT] Fastest Tactic: 1 Time: 0.065536 [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: BoxPredictor_4/ClassPredictor/Conv2D || BoxPredictor_4/BoxEncodingPredictor/Conv2D (FusedConvActConvolution) [01/19/2021-17:50:49] [V] [TRT] Tactic: 7 time 0.13312 [01/19/2021-17:50:49] [V] [TRT] Tactic: 10 time 0.088064 [01/19/2021-17:50:49] [V] [TRT] Tactic: 14 time 0.048128 [01/19/2021-17:50:49] [V] [TRT] Tactic: 15 time 0.089088 [01/19/2021-17:50:49] [V] [TRT] Tactic: 25 time 0.053248 [01/19/2021-17:50:49] [V] [TRT] Tactic: 26 time 0.038912 [01/19/2021-17:50:49] [V] [TRT] Tactic: 29 time 0.16896 [01/19/2021-17:50:49] [V] [TRT] Tactic: 30 time 0.156672 [01/19/2021-17:50:49] [V] [TRT] Tactic: 33 time 0.154624 [01/19/2021-17:50:49] [V] [TRT] Tactic: 36 time 0.062464 [01/19/2021-17:50:49] [V] [TRT] Tactic: 39 time 0.041984 [01/19/2021-17:50:49] [V] [TRT] Tactic: 41 time 0.096256 [01/19/2021-17:50:49] [V] [TRT] Tactic: 45 time 0.06144 [01/19/2021-17:50:49] [V] [TRT] Tactic: 47 time 0.053248 [01/19/2021-17:50:49] [V] [TRT] Tactic: 54 time 0.060416 [01/19/2021-17:50:49] [V] [TRT] Tactic: 66 time 0.182272 [01/19/2021-17:50:49] [V] [TRT] Tactic: 76 time 0.073728 [01/19/2021-17:50:49] [V] [TRT] Tactic: 90 time 0.16896 [01/19/2021-17:50:49] [V] [TRT] Tactic: 93 time 0.119552 [01/19/2021-17:50:49] [V] [TRT] Tactic: 98 time 0.090112 [01/19/2021-17:50:49] [V] [TRT] Tactic: 104 time 0.13824 [01/19/2021-17:50:49] [V] [TRT] Tactic: 110 time 0.038912 [01/19/2021-17:50:49] [V] [TRT] Tactic: 119 time 0.044032 [01/19/2021-17:50:49] [V] [TRT] Tactic: 121 time 0.089088 [01/19/2021-17:50:49] [V] [TRT] Tactic: 130 time 0.1536 [01/19/2021-17:50:49] [V] [TRT] Tactic: 134 time 0.047104 [01/19/2021-17:50:49] [V] [TRT] Tactic: 136 time 0.167936 [01/19/2021-17:50:49] [V] [TRT] Tactic: 137 time 0.059392 [01/19/2021-17:50:49] [V] [TRT] Tactic: 139 time 0.061184 [01/19/2021-17:50:49] [V] [TRT] Tactic: 144 time 0.180224 [01/19/2021-17:50:49] [V] [TRT] Tactic: 151 time 0.052224 [01/19/2021-17:50:49] [V] [TRT] Tactic: 152 time 0.077824 [01/19/2021-17:50:49] [V] [TRT] Tactic: 153 time 0.183296 [01/19/2021-17:50:49] [V] [TRT] Tactic: 156 time 0.167936 [01/19/2021-17:50:49] [V] [TRT] Tactic: 159 time 0.047104 [01/19/2021-17:50:49] [V] [TRT] Tactic: 162 time 0.04272 [01/19/2021-17:50:49] [V] [TRT] Tactic: 164 time 0.048128 [01/19/2021-17:50:49] [V] [TRT] Fastest Tactic: 26 Time: 0.038912 [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: BoxPredictor_4/ClassPredictor/Conv2D || BoxPredictor_4/BoxEncodingPredictor/Conv2D (CaskConvolution) [01/19/2021-17:50:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: BoxPredictor_4/ClassPredictor/Conv2D || BoxPredictor_4/BoxEncodingPredictor/Conv2D (CudaConvolution) [01/19/2021-17:50:49] [V] [TRT] Tactic: 0 time 0.212992 [01/19/2021-17:50:49] [V] [TRT] Tactic: 1 time 0.211968 [01/19/2021-17:50:49] [V] [TRT] Tactic: 2 time 0.18944 [01/19/2021-17:50:49] [V] [TRT] Tactic: 4 skipped. Scratch requested: 342042624, available: 16777216 [01/19/2021-17:50:49] [V] [TRT] Tactic: 5 skipped. Scratch requested: 638663168, available: 16777216 [01/19/2021-17:50:49] [V] [TRT] Tactic: 6 time 0.136192 [01/19/2021-17:50:49] [V] [TRT] Fastest Tactic: 6 Time: 0.136192 [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: BoxPredictor_4/ClassPredictor/Conv2D || BoxPredictor_4/BoxEncodingPredictor/Conv2D (CudaDepthwiseConvolution) [01/19/2021-17:50:49] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 26 [01/19/2021-17:50:49] [V] [TRT] [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:49] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:49] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:49] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:49] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:49] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:49] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:49] [V] [TRT] *************** Autotuning format combination: Float(1,2,4,2280) -> Float(1,1,91,2184) *************** [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 656) [Shuffle] + BoxPredictor_4/Reshape_1 (Shuffle) [01/19/2021-17:50:49] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:49] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:49] [V] [TRT] *************** Autotuning format combination: Float(1,2,4:32,72) -> Float(1,1,91:32,91) *************** [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 656) [Shuffle] + BoxPredictor_4/Reshape_1 (Shuffle) [01/19/2021-17:50:49] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:49] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:49] [V] [TRT] *************** Autotuning format combination: Float(1,2,4,1024) -> Float(1,2,4,256) *************** [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:49] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:49] [V] [TRT] Tactic: 8 time 0.0512 [01/19/2021-17:50:49] [V] [TRT] Tactic: 9 time 0.034816 [01/19/2021-17:50:49] [V] [TRT] Tactic: 11 time 0.017408 [01/19/2021-17:50:49] [V] [TRT] Tactic: 12 time 0.013312 [01/19/2021-17:50:49] [V] [TRT] Tactic: 17 time 0.009216 [01/19/2021-17:50:49] [V] [TRT] Tactic: 19 time 0.06144 [01/19/2021-17:50:49] [V] [TRT] Tactic: 20 time 0.036864 [01/19/2021-17:50:49] [V] [TRT] Tactic: 21 time 0.01024 [01/19/2021-17:50:49] [V] [TRT] Tactic: 22 time 0.021504 [01/19/2021-17:50:49] [V] [TRT] Tactic: 24 time 0.011264 [01/19/2021-17:50:49] [V] [TRT] Tactic: 27 time 0.01536 [01/19/2021-17:50:49] [V] [TRT] Tactic: 28 time 0.037888 [01/19/2021-17:50:49] [V] [TRT] Tactic: 31 time 0.008192 [01/19/2021-17:50:49] [V] [TRT] Tactic: 32 time 0.037888 [01/19/2021-17:50:49] [V] [TRT] Tactic: 34 time 0.033792 [01/19/2021-17:50:49] [V] [TRT] Tactic: 35 time 0.0256 [01/19/2021-17:50:49] [V] [TRT] Tactic: 40 time 0.034816 [01/19/2021-17:50:49] [V] [TRT] Tactic: 46 time 0.019456 [01/19/2021-17:50:49] [V] [TRT] Tactic: 50 time 0.021504 [01/19/2021-17:50:49] [V] [TRT] Tactic: 51 time 0.02048 [01/19/2021-17:50:49] [V] [TRT] Tactic: 53 time 0.012288 [01/19/2021-17:50:49] [V] [TRT] Tactic: 55 time 0.06656 [01/19/2021-17:50:49] [V] [TRT] Tactic: 59 time 0.029696 [01/19/2021-17:50:49] [V] [TRT] Tactic: 60 time 0.01024 [01/19/2021-17:50:49] [V] [TRT] Tactic: 61 time 0.013312 [01/19/2021-17:50:49] [V] [TRT] Tactic: 63 time 0.016384 [01/19/2021-17:50:49] [V] [TRT] Tactic: 64 time 0.008192 [01/19/2021-17:50:49] [V] [TRT] Tactic: 65 time 0.013312 [01/19/2021-17:50:49] [V] [TRT] Tactic: 68 time 0.03584 [01/19/2021-17:50:49] [V] [TRT] Tactic: 69 time 0.01024 [01/19/2021-17:50:49] [V] [TRT] Tactic: 70 time 0.009216 [01/19/2021-17:50:49] [V] [TRT] Tactic: 74 time 0.01024 [01/19/2021-17:50:49] [V] [TRT] Tactic: 75 time 0.022528 [01/19/2021-17:50:49] [V] [TRT] Tactic: 78 time 0.009216 [01/19/2021-17:50:49] [V] [TRT] Tactic: 79 time 0.019456 [01/19/2021-17:50:49] [V] [TRT] Tactic: 81 time 0.009216 [01/19/2021-17:50:49] [V] [TRT] Tactic: 82 time 0.01536 [01/19/2021-17:50:49] [V] [TRT] Tactic: 84 time 0.02048 [01/19/2021-17:50:49] [V] [TRT] Tactic: 85 time 0.013312 [01/19/2021-17:50:49] [V] [TRT] Tactic: 86 time 0.03264 [01/19/2021-17:50:49] [V] [TRT] Tactic: 87 time 0.017408 [01/19/2021-17:50:49] [V] [TRT] Tactic: 88 time 0.019456 [01/19/2021-17:50:49] [V] [TRT] Tactic: 89 time 0.011264 [01/19/2021-17:50:49] [V] [TRT] Tactic: 91 time 0.031744 [01/19/2021-17:50:49] [V] [TRT] Tactic: 94 time 0.012288 [01/19/2021-17:50:49] [V] [TRT] Tactic: 95 time 0.009216 [01/19/2021-17:50:49] [V] [TRT] Tactic: 97 time 0.018432 [01/19/2021-17:50:49] [V] [TRT] Tactic: 102 time 0.01024 [01/19/2021-17:50:49] [V] [TRT] Tactic: 103 time 0.018432 [01/19/2021-17:50:49] [V] [TRT] Tactic: 105 time 0.019456 [01/19/2021-17:50:49] [V] [TRT] Tactic: 106 time 0.008192 [01/19/2021-17:50:49] [V] [TRT] Tactic: 107 time 0.012288 [01/19/2021-17:50:49] [V] [TRT] Tactic: 108 time 0.017408 [01/19/2021-17:50:49] [V] [TRT] Tactic: 109 time 0.019456 [01/19/2021-17:50:49] [V] [TRT] Tactic: 111 time 0.01024 [01/19/2021-17:50:49] [V] [TRT] Tactic: 112 time 0.011264 [01/19/2021-17:50:49] [V] [TRT] Tactic: 114 time 0.02752 [01/19/2021-17:50:49] [V] [TRT] Tactic: 115 time 0.019328 [01/19/2021-17:50:49] [V] [TRT] Tactic: 117 time 0.013312 [01/19/2021-17:50:49] [V] [TRT] Tactic: 118 time 0.016384 [01/19/2021-17:50:49] [V] [TRT] Tactic: 124 time 0.013312 [01/19/2021-17:50:49] [V] [TRT] Tactic: 125 time 0.01024 [01/19/2021-17:50:49] [V] [TRT] Tactic: 126 time 0.01536 [01/19/2021-17:50:49] [V] [TRT] Tactic: 131 time 0.019456 [01/19/2021-17:50:49] [V] [TRT] Tactic: 132 time 0.011264 [01/19/2021-17:50:49] [V] [TRT] Tactic: 138 time 0.008192 [01/19/2021-17:50:49] [V] [TRT] Tactic: 145 time 0.01024 [01/19/2021-17:50:49] [V] [TRT] Tactic: 150 time 0.017408 [01/19/2021-17:50:49] [V] [TRT] Tactic: 155 time 0.034816 [01/19/2021-17:50:49] [V] [TRT] Tactic: 157 time 0.009216 [01/19/2021-17:50:49] [V] [TRT] Tactic: 160 time 0.021504 [01/19/2021-17:50:49] [V] [TRT] Tactic: 163 time 0.013312 [01/19/2021-17:50:49] [V] [TRT] Tactic: 166 time 0.022528 [01/19/2021-17:50:49] [V] [TRT] Fastest Tactic: 31 Time: 0.008192 [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6 (CaskConvolution) [01/19/2021-17:50:49] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: 1062367460111450758 time 0.027648 [01/19/2021-17:50:49] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: 4501471010995462441 time 0.028672 [01/19/2021-17:50:49] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: 5137655947464784826 time 0.021504 [01/19/2021-17:50:49] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: 5326823351883942011 time 0.028672 [01/19/2021-17:50:49] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: 6645123197870846056 time 0.022528 [01/19/2021-17:50:49] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: -6576203419454146580 time 0.023552 [01/19/2021-17:50:49] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: -3456450830548107839 time 0.023552 [01/19/2021-17:50:49] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: -410470605513481746 time 0.027648 [01/19/2021-17:50:49] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:49] [V] [TRT] Tactic: -37215280111360163 time 0.021504 [01/19/2021-17:50:49] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.021504 [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6 (CudaConvolution) [01/19/2021-17:50:49] [V] [TRT] Tactic: 0 time 0.024576 [01/19/2021-17:50:49] [V] [TRT] Tactic: 1 time 0.036864 [01/19/2021-17:50:49] [V] [TRT] Tactic: 2 time 0.078848 [01/19/2021-17:50:49] [V] [TRT] Tactic: 4 skipped. Scratch requested: 38404096, available: 16777216 [01/19/2021-17:50:49] [V] [TRT] Tactic: 5 time 0.083968 [01/19/2021-17:50:49] [V] [TRT] Fastest Tactic: 0 Time: 0.024576 [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:49] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 31 [01/19/2021-17:50:49] [V] [TRT] [01/19/2021-17:50:49] [V] [TRT] *************** Autotuning format combination: Float(1,2,4,256) -> Float(1,1,1,64) *************** [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:49] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:49] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6 (CaskConvolution) [01/19/2021-17:50:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6 (CudaConvolution) [01/19/2021-17:50:49] [V] [TRT] Tactic: 0 time 0.009216 [01/19/2021-17:50:49] [V] [TRT] Tactic: 1 time 0.309248 [01/19/2021-17:50:49] [V] [TRT] Tactic: 2 time 0.534528 [01/19/2021-17:50:49] [V] [TRT] Tactic: 5 time 2.19341 [01/19/2021-17:50:49] [V] [TRT] Fastest Tactic: 0 Time: 0.009216 [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:49] [V] [TRT] Tactic: -1 time 0.004096 [01/19/2021-17:50:49] [V] [TRT] Fastest Tactic: -1 Time: 0.004096 [01/19/2021-17:50:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [01/19/2021-17:50:49] [V] [TRT] [01/19/2021-17:50:49] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,64) -> Float(1,1,1,128) *************** [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6 (LegacySASSConvolution) [01/19/2021-17:50:49] [V] [TRT] LegacySASSConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:49] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6 (FusedConvActConvolution) [01/19/2021-17:50:49] [V] [TRT] Tactic: 8 time 0.016384 [01/19/2021-17:50:49] [V] [TRT] Tactic: 9 time 0.013312 [01/19/2021-17:50:49] [V] [TRT] Tactic: 11 time 0.009216 [01/19/2021-17:50:49] [V] [TRT] Tactic: 12 time 0.007168 [01/19/2021-17:50:49] [V] [TRT] Tactic: 17 time 0.00512 [01/19/2021-17:50:49] [V] [TRT] Tactic: 19 time 0.021504 [01/19/2021-17:50:49] [V] [TRT] Tactic: 20 time 0.013312 [01/19/2021-17:50:49] [V] [TRT] Tactic: 21 time 0.006144 [01/19/2021-17:50:50] [V] [TRT] Tactic: 22 time 0.010112 [01/19/2021-17:50:50] [V] [TRT] Tactic: 24 time 0.006144 [01/19/2021-17:50:50] [V] [TRT] Tactic: 27 time 0.008192 [01/19/2021-17:50:50] [V] [TRT] Tactic: 28 time 0.01536 [01/19/2021-17:50:50] [V] [TRT] Tactic: 31 time 0.006144 [01/19/2021-17:50:50] [V] [TRT] Tactic: 32 time 0.014336 [01/19/2021-17:50:50] [V] [TRT] Tactic: 34 time 0.012288 [01/19/2021-17:50:50] [V] [TRT] Tactic: 35 time 0.011264 [01/19/2021-17:50:50] [V] [TRT] Tactic: 40 time 0.013312 [01/19/2021-17:50:50] [V] [TRT] Tactic: 46 time 0.008192 [01/19/2021-17:50:50] [V] [TRT] Tactic: 50 time 0.01024 [01/19/2021-17:50:50] [V] [TRT] Tactic: 51 time 0.009216 [01/19/2021-17:50:50] [V] [TRT] Tactic: 53 time 0.007168 [01/19/2021-17:50:50] [V] [TRT] Tactic: 55 time 0.021504 [01/19/2021-17:50:50] [V] [TRT] Tactic: 59 time 0.011264 [01/19/2021-17:50:50] [V] [TRT] Tactic: 60 time 0.006144 [01/19/2021-17:50:50] [V] [TRT] Tactic: 61 time 0.007168 [01/19/2021-17:50:50] [V] [TRT] Tactic: 63 time 0.009216 [01/19/2021-17:50:50] [V] [TRT] Tactic: 64 time 0.00512 [01/19/2021-17:50:50] [V] [TRT] Tactic: 65 time 0.007168 [01/19/2021-17:50:50] [V] [TRT] Tactic: 68 time 0.014336 [01/19/2021-17:50:50] [V] [TRT] Tactic: 69 time 0.006144 [01/19/2021-17:50:50] [V] [TRT] Tactic: 70 time 0.006144 [01/19/2021-17:50:50] [V] [TRT] Tactic: 74 time 0.006144 [01/19/2021-17:50:50] [V] [TRT] Tactic: 75 time 0.011264 [01/19/2021-17:50:50] [V] [TRT] Tactic: 78 time 0.00512 [01/19/2021-17:50:50] [V] [TRT] Tactic: 79 time 0.008192 [01/19/2021-17:50:50] [V] [TRT] Tactic: 81 time 0.00512 [01/19/2021-17:50:50] [V] [TRT] Tactic: 82 time 0.007168 [01/19/2021-17:50:50] [V] [TRT] Tactic: 84 time 0.01024 [01/19/2021-17:50:50] [V] [TRT] Tactic: 85 time 0.007168 [01/19/2021-17:50:50] [V] [TRT] Tactic: 86 time 0.011264 [01/19/2021-17:50:50] [V] [TRT] Tactic: 87 time 0.007168 [01/19/2021-17:50:50] [V] [TRT] Tactic: 88 time 0.008192 [01/19/2021-17:50:50] [V] [TRT] Tactic: 89 time 0.006144 [01/19/2021-17:50:50] [V] [TRT] Tactic: 91 time 0.011264 [01/19/2021-17:50:50] [V] [TRT] Tactic: 94 time 0.006144 [01/19/2021-17:50:50] [V] [TRT] Tactic: 95 time 0.00512 [01/19/2021-17:50:50] [V] [TRT] Tactic: 97 time 0.008192 [01/19/2021-17:50:50] [V] [TRT] Tactic: 102 time 0.006144 [01/19/2021-17:50:50] [V] [TRT] Tactic: 103 time 0.008192 [01/19/2021-17:50:50] [V] [TRT] Tactic: 105 time 0.009216 [01/19/2021-17:50:50] [V] [TRT] Tactic: 106 time 0.006144 [01/19/2021-17:50:50] [V] [TRT] Tactic: 107 time 0.006144 [01/19/2021-17:50:50] [V] [TRT] Tactic: 108 time 0.007168 [01/19/2021-17:50:50] [V] [TRT] Tactic: 109 time 0.008192 [01/19/2021-17:50:50] [V] [TRT] Tactic: 111 time 0.006144 [01/19/2021-17:50:50] [V] [TRT] Tactic: 112 time 0.006144 [01/19/2021-17:50:50] [V] [TRT] Tactic: 114 time 0.01024 [01/19/2021-17:50:50] [V] [TRT] Tactic: 115 time 0.009216 [01/19/2021-17:50:50] [V] [TRT] Tactic: 117 time 0.007168 [01/19/2021-17:50:50] [V] [TRT] Tactic: 118 time 0.009216 [01/19/2021-17:50:50] [V] [TRT] Tactic: 124 time 0.006144 [01/19/2021-17:50:50] [V] [TRT] Tactic: 125 time 0.006144 [01/19/2021-17:50:50] [V] [TRT] Tactic: 126 time 0.008096 [01/19/2021-17:50:50] [V] [TRT] Tactic: 131 time 0.009216 [01/19/2021-17:50:50] [V] [TRT] Tactic: 132 time 0.006144 [01/19/2021-17:50:50] [V] [TRT] Tactic: 138 time 0.00512 [01/19/2021-17:50:50] [V] [TRT] Tactic: 145 time 0.007168 [01/19/2021-17:50:50] [V] [TRT] Tactic: 150 time 0.009216 [01/19/2021-17:50:50] [V] [TRT] Tactic: 155 time 0.013312 [01/19/2021-17:50:50] [V] [TRT] Tactic: 157 time 0.006144 [01/19/2021-17:50:50] [V] [TRT] Tactic: 160 time 0.009216 [01/19/2021-17:50:50] [V] [TRT] Tactic: 163 time 0.007168 [01/19/2021-17:50:50] [V] [TRT] Tactic: 166 time 0.011264 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 17 Time: 0.00512 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6 (CaskConvolution) [01/19/2021-17:50:50] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:50] [V] [TRT] Tactic: 1062367460111450758 time 0.013312 [01/19/2021-17:50:50] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:50] [V] [TRT] Tactic: 4501471010995462441 time 0.013312 [01/19/2021-17:50:50] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:50] [V] [TRT] Tactic: 5137655947464784826 time 0.011264 [01/19/2021-17:50:50] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 [01/19/2021-17:50:50] [V] [TRT] Tactic: 5326823351883942011 time 0.013312 [01/19/2021-17:50:50] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 [01/19/2021-17:50:50] [V] [TRT] Tactic: 6645123197870846056 time 0.012288 [01/19/2021-17:50:50] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:50] [V] [TRT] Tactic: -6576203419454146580 time 0.012288 [01/19/2021-17:50:50] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 [01/19/2021-17:50:50] [V] [TRT] Tactic: -3456450830548107839 time 0.012288 [01/19/2021-17:50:50] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 [01/19/2021-17:50:50] [V] [TRT] Tactic: -410470605513481746 time 0.013312 [01/19/2021-17:50:50] [V] [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:50] [V] [TRT] Tactic: -37215280111360163 time 0.011264 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 5137655947464784826 Time: 0.011264 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6 (CudaConvolution) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.011264 [01/19/2021-17:50:50] [V] [TRT] Tactic: 1 time 0.019456 [01/19/2021-17:50:50] [V] [TRT] Tactic: 2 time 0.0256 [01/19/2021-17:50:50] [V] [TRT] Tactic: 4 skipped. Scratch requested: 19054592, available: 16777216 [01/19/2021-17:50:50] [V] [TRT] Tactic: 5 time 0.028672 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.011264 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6 (CudaDepthwiseConvolution) [01/19/2021-17:50:50] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 17 [01/19/2021-17:50:50] [V] [TRT] [01/19/2021-17:50:50] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,128) -> Float(1,1,1,570) *************** [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: BoxPredictor_5/ClassPredictor/Conv2D || BoxPredictor_5/BoxEncodingPredictor/Conv2D (LegacySASSConvolution) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.14336 [01/19/2021-17:50:50] [V] [TRT] Tactic: 1 time 0.037888 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 1 Time: 0.037888 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: BoxPredictor_5/ClassPredictor/Conv2D || BoxPredictor_5/BoxEncodingPredictor/Conv2D (FusedConvActConvolution) [01/19/2021-17:50:50] [V] [TRT] Tactic: 7 time 0.069632 [01/19/2021-17:50:50] [V] [TRT] Tactic: 10 time 0.048128 [01/19/2021-17:50:50] [V] [TRT] Tactic: 14 time 0.027488 [01/19/2021-17:50:50] [V] [TRT] Tactic: 15 time 0.049152 [01/19/2021-17:50:50] [V] [TRT] Tactic: 25 time 0.03072 [01/19/2021-17:50:50] [V] [TRT] Tactic: 26 time 0.023552 [01/19/2021-17:50:50] [V] [TRT] Tactic: 29 time 0.088064 [01/19/2021-17:50:50] [V] [TRT] Tactic: 30 time 0.08192 [01/19/2021-17:50:50] [V] [TRT] Tactic: 33 time 0.08192 [01/19/2021-17:50:50] [V] [TRT] Tactic: 36 time 0.03584 [01/19/2021-17:50:50] [V] [TRT] Tactic: 39 time 0.0256 [01/19/2021-17:50:50] [V] [TRT] Tactic: 41 time 0.053248 [01/19/2021-17:50:50] [V] [TRT] Tactic: 45 time 0.036864 [01/19/2021-17:50:50] [V] [TRT] Tactic: 47 time 0.03072 [01/19/2021-17:50:50] [V] [TRT] Tactic: 54 time 0.03584 [01/19/2021-17:50:50] [V] [TRT] Tactic: 66 time 0.096256 [01/19/2021-17:50:50] [V] [TRT] Tactic: 76 time 0.04096 [01/19/2021-17:50:50] [V] [TRT] Tactic: 90 time 0.089088 [01/19/2021-17:50:50] [V] [TRT] Tactic: 93 time 0.062464 [01/19/2021-17:50:50] [V] [TRT] Tactic: 98 time 0.050176 [01/19/2021-17:50:50] [V] [TRT] Tactic: 104 time 0.072704 [01/19/2021-17:50:50] [V] [TRT] Tactic: 110 time 0.022528 [01/19/2021-17:50:50] [V] [TRT] Tactic: 119 time 0.0256 [01/19/2021-17:50:50] [V] [TRT] Tactic: 121 time 0.049152 [01/19/2021-17:50:50] [V] [TRT] Tactic: 130 time 0.080896 [01/19/2021-17:50:50] [V] [TRT] Tactic: 134 time 0.028672 [01/19/2021-17:50:50] [V] [TRT] Tactic: 136 time 0.088064 [01/19/2021-17:50:50] [V] [TRT] Tactic: 137 time 0.033792 [01/19/2021-17:50:50] [V] [TRT] Tactic: 139 time 0.034816 [01/19/2021-17:50:50] [V] [TRT] Tactic: 144 time 0.095232 [01/19/2021-17:50:50] [V] [TRT] Tactic: 151 time 0.028672 [01/19/2021-17:50:50] [V] [TRT] Tactic: 152 time 0.044032 [01/19/2021-17:50:50] [V] [TRT] Tactic: 153 time 0.096256 [01/19/2021-17:50:50] [V] [TRT] Tactic: 156 time 0.088064 [01/19/2021-17:50:50] [V] [TRT] Tactic: 159 time 0.026624 [01/19/2021-17:50:50] [V] [TRT] Tactic: 162 time 0.024576 [01/19/2021-17:50:50] [V] [TRT] Tactic: 164 time 0.028672 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 110 Time: 0.022528 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: BoxPredictor_5/ClassPredictor/Conv2D || BoxPredictor_5/BoxEncodingPredictor/Conv2D (CaskConvolution) [01/19/2021-17:50:50] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: BoxPredictor_5/ClassPredictor/Conv2D || BoxPredictor_5/BoxEncodingPredictor/Conv2D (CudaConvolution) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.109568 [01/19/2021-17:50:50] [V] [TRT] Tactic: 1 time 0.106496 [01/19/2021-17:50:50] [V] [TRT] Tactic: 2 time 0.097056 [01/19/2021-17:50:50] [V] [TRT] Tactic: 4 skipped. Scratch requested: 171021312, available: 16777216 [01/19/2021-17:50:50] [V] [TRT] Tactic: 5 skipped. Scratch requested: 320584192, available: 16777216 [01/19/2021-17:50:50] [V] [TRT] Tactic: 6 time 0.073728 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 6 Time: 0.073728 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: BoxPredictor_5/ClassPredictor/Conv2D || BoxPredictor_5/BoxEncodingPredictor/Conv2D (CudaDepthwiseConvolution) [01/19/2021-17:50:50] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [01/19/2021-17:50:50] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 110 [01/19/2021-17:50:50] [V] [TRT] [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,570) -> Float(1,1,91,546) *************** [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 697) [Shuffle] + BoxPredictor_5/Reshape_1 (Shuffle) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] *************** Autotuning format combination: Float(1,1,1:32,18) -> Float(1,1,91:32,91) *************** [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 697) [Shuffle] + BoxPredictor_5/Reshape_1 (Shuffle) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.009216 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.009216 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.006144 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.006144 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.00496 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.00496 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] *************** Autotuning format combination: Float(1,1,91,98553), Float(1,1,91,54600), Float(1,1,91,13650), Float(1,1,91,4914), Float(1,1,91,2184), Float(1,1,91,546) -> Float(1,1,1,174447) *************** [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] *************** Autotuning format combination: Float(1,19,361,102885) -> Float(1,4,4,4332) *************** [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 707) [Shuffle] + BoxPredictor_0/Reshape (Shuffle) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] *************** Autotuning format combination: Float(1,19,361:32,3249) -> Float(1,4,4:32,136) *************** [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 707) [Shuffle] + BoxPredictor_0/Reshape (Shuffle) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] *************** Autotuning format combination: Float(1,10,100,57000) -> Float(1,4,4,2400) *************** [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 716) [Shuffle] + BoxPredictor_1/Reshape (Shuffle) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] *************** Autotuning format combination: Float(1,10,100:32,1800) -> Float(1,4,4:32,76) *************** [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 716) [Shuffle] + BoxPredictor_1/Reshape (Shuffle) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] *************** Autotuning format combination: Float(1,5,25,14250) -> Float(1,4,4,600) *************** [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 725) [Shuffle] + BoxPredictor_2/Reshape (Shuffle) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] *************** Autotuning format combination: Float(1,5,25:32,450) -> Float(1,4,4:32,20) *************** [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 725) [Shuffle] + BoxPredictor_2/Reshape (Shuffle) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] *************** Autotuning format combination: Float(1,3,9,5130) -> Float(1,4,4,216) *************** [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 734) [Shuffle] + BoxPredictor_3/Reshape (Shuffle) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] *************** Autotuning format combination: Float(1,3,9:32,162) -> Float(1,4,4:32,8) *************** [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 734) [Shuffle] + BoxPredictor_3/Reshape (Shuffle) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] *************** Autotuning format combination: Float(1,2,4,2280) -> Float(1,4,4,96) *************** [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 743) [Shuffle] + BoxPredictor_4/Reshape (Shuffle) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] *************** Autotuning format combination: Float(1,2,4:32,72) -> Float(1,4,4:32,4) *************** [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 743) [Shuffle] + BoxPredictor_4/Reshape (Shuffle) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.003968 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.003968 [01/19/2021-17:50:50] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,570) -> Float(1,4,4,24) *************** [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 752) [Shuffle] + BoxPredictor_5/Reshape (Shuffle) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] *************** Autotuning format combination: Float(1,1,1:32,18) -> Float(1,4,4:32,4) *************** [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 752) [Shuffle] + BoxPredictor_5/Reshape (Shuffle) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.003968 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.003968 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] *************** Autotuning format combination: Float(1,4,4,4332), Float(1,4,4,2400), Float(1,4,4,600), Float(1,4,4,216), Float(1,4,4,96), Float(1,4,4,24) -> Float(1,1,1,7668) *************** [01/19/2021-17:50:50] [V] [TRT] *************** Autotuning format combination: -> Float(1,2) *************** [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.003072 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.003072 [01/19/2021-17:50:50] [V] [TRT] *************** Autotuning format combination: Float(1,2) -> Float(1,1,4332,8664), Float(1,1,2400,4800), Float(1,1,600,1200), Float(1,1,216,432), Float(1,1,96,192), Float(1,1,24,48) *************** [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: GridAnchor copy (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: GridAnchor_1 copy (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: GridAnchor_2 copy (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: GridAnchor_3 copy (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: GridAnchor_4 copy (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] --------------- Timing Runner: GridAnchor_5 copy (Reformat) [01/19/2021-17:50:50] [V] [TRT] Tactic: 0 time 0.004096 [01/19/2021-17:50:50] [V] [TRT] Fastest Tactic: 0 Time: 0.004096 [01/19/2021-17:50:50] [V] [TRT] *************** Autotuning format combination: Float(1,1,1,174447), Float(1,1,1,7668), Float(1,1,7668,15336) -> Float(1,7,700,700), Float(1,1,1,1) *************** [01/19/2021-17:50:50] [V] [TRT] Adding reformat layer: GridAnchor reformatted input 0 (Const) from Float(1,2) to Float(1,2) [01/19/2021-17:50:50] [V] [TRT] Formats and tactics selection completed in 16.9157 seconds. [01/19/2021-17:50:50] [V] [TRT] After reformat layers: 94 layers [01/19/2021-17:50:50] [V] [TRT] Block size 16777216 [01/19/2021-17:50:50] [V] [TRT] Block size 8640000 [01/19/2021-17:50:50] [V] [TRT] Block size 3240448 [01/19/2021-17:50:50] [V] [TRT] Block size 540160 [01/19/2021-17:50:50] [V] [TRT] Block size 384000 [01/19/2021-17:50:50] [V] [TRT] Block size 218624 [01/19/2021-17:50:50] [V] [TRT] Block size 102400 [01/19/2021-17:50:50] [V] [TRT] Block size 54784 [01/19/2021-17:50:50] [V] [TRT] Block size 20992 [01/19/2021-17:50:50] [V] [TRT] Block size 19968 [01/19/2021-17:50:50] [V] [TRT] Block size 9216 [01/19/2021-17:50:50] [V] [TRT] Block size 9216 [01/19/2021-17:50:50] [V] [TRT] Block size 2560 [01/19/2021-17:50:50] [V] [TRT] Block size 2560 [01/19/2021-17:50:50] [V] [TRT] Total Activation Memory: 30022144 [01/19/2021-17:50:50] [I] [TRT] Detected 1 inputs and 2 output network tensors. [01/19/2021-17:50:50] [V] [TRT] FeatureExtractor/MobilenetV2/Conv/Conv2D + FeatureExtractor/MobilenetV2/Conv/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 [01/19/2021-17:50:50] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv/project/Conv2D (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:50] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:50] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:50] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_2/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_2/add (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 [01/19/2021-17:50:50] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 [01/19/2021-17:50:50] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:50] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_4/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_4/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:50] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:50] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_5/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_5/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:50] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:50] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:50] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:50] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:50] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_8/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_8/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:50] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:50] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_9/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_9/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:50] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:50] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:50] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:50] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:50] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_12/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_12/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:50] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 [01/19/2021-17:50:50] [V] [TRT] BoxPredictor_0/ClassPredictor/Conv2D || BoxPredictor_0/BoxEncodingPredictor/Conv2D (scudnn_winograd) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 [01/19/2021-17:50:50] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:50] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:50] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:50] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_15/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/add (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:50] [V] [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 [01/19/2021-17:50:50] [V] [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + FeatureExtractor/MobilenetV2/Conv_1/Relu6 (scudnn) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 [01/19/2021-17:50:50] [V] [TRT] Engine generation completed in 17.3105 seconds. [01/19/2021-17:50:50] [V] [TRT] Engine Layer Information: [01/19/2021-17:50:50] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV2/Conv/Conv2D + FeatureExtractor/MobilenetV2/Conv/Relu6, Tactic: -6092040395344634144, Input[Float(3,300,300)] -> FeatureExtractor/MobilenetV2/Conv/Relu6[Float(32,150,150)] [01/19/2021-17:50:50] [V] [TRT] Layer(DepthwiseConvolution): FeatureExtractor/MobilenetV2/expanded_conv/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv/depthwise/Relu6, Tactic: -1, FeatureExtractor/MobilenetV2/Conv/Relu6[Float(32,150,150)] -> FeatureExtractor/MobilenetV2/expanded_conv/depthwise/Relu6[Float(32,150,150)] [01/19/2021-17:50:50] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV2/expanded_conv/project/Conv2D, Tactic: -6576203419454146580, FeatureExtractor/MobilenetV2/expanded_conv/depthwise/Relu6[Float(32,150,150)] -> FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/batchnorm/add_1[Float(16,150,150)] [01/19/2021-17:50:50] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Relu6, Tactic: 4501471010995462441, FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/batchnorm/add_1[Float(16,150,150)] -> FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Relu6[Float(96,150,150)] [01/19/2021-17:50:50] [V] [TRT] Layer(DepthwiseConvolution): FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/Relu6, Tactic: -1, FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Relu6[Float(96,150,150)] -> FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/Relu6[Float(96,75,75)] [01/19/2021-17:50:50] [V] [TRT] Layer(CustomImplicitGemm): FeatureExtractor/MobilenetV2/expanded_conv_1/project/Conv2D, Tactic: 0, FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/Relu6[Float(96,75,75)] -> FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/batchnorm/add_1[Float(24,75,75)] [01/19/2021-17:50:50] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Relu6, Tactic: -6576203419454146580, FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/batchnorm/add_1[Float(24,75,75)] -> FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Relu6[Float(144,75,75)] [01/19/2021-17:50:50] [V] [TRT] Layer(DepthwiseConvolution): FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/Relu6, Tactic: -1, FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Relu6[Float(144,75,75)] -> FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/Relu6[Float(144,75,75)] [01/19/2021-17:50:50] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV2/expanded_conv_2/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_2/add, Tactic: -6576203419454146580, FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/Relu6[Float(144,75,75)], FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/batchnorm/add_1[Float(24,75,75)] -> FeatureExtractor/MobilenetV2/expanded_conv_2/add[Float(24,75,75)] [01/19/2021-17:50:50] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Relu6, Tactic: 1062367460111450758, FeatureExtractor/MobilenetV2/expanded_conv_2/add[Float(24,75,75)] -> FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Relu6[Float(144,75,75)] [01/19/2021-17:50:50] [V] [TRT] Layer(DepthwiseConvolution): FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/Relu6, Tactic: -1, FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Relu6[Float(144,75,75)] -> FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/Relu6[Float(144,38,38)] [01/19/2021-17:50:50] [V] [TRT] Layer(FusedConvActDirect): FeatureExtractor/MobilenetV2/expanded_conv_3/project/Conv2D, Tactic: 74, FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/Relu6[Float(144,38,38)] -> FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/batchnorm/add_1[Float(32,38,38)] [01/19/2021-17:50:50] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Relu6, Tactic: -37215280111360163, FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/batchnorm/add_1[Float(32,38,38)] -> FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Relu6[Float(192,38,38)] [01/19/2021-17:50:50] [V] [TRT] Layer(DepthwiseConvolution): FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/Relu6, Tactic: -1, FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Relu6[Float(192,38,38)] -> FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/Relu6[Float(192,38,38)] [01/19/2021-17:50:50] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV2/expanded_conv_4/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_4/add, Tactic: 5137655947464784826, FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/Relu6[Float(192,38,38)], FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/batchnorm/add_1[Float(32,38,38)] -> FeatureExtractor/MobilenetV2/expanded_conv_4/add[Float(32,38,38)] [01/19/2021-17:50:50] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Relu6, Tactic: 5137655947464784826, FeatureExtractor/MobilenetV2/expanded_conv_4/add[Float(32,38,38)] -> FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Relu6[Float(192,38,38)] [01/19/2021-17:50:50] [V] [TRT] Layer(DepthwiseConvolution): FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/Relu6, Tactic: -1, FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Relu6[Float(192,38,38)] -> FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/Relu6[Float(192,38,38)] [01/19/2021-17:50:50] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV2/expanded_conv_5/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_5/add, Tactic: 5137655947464784826, FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/Relu6[Float(192,38,38)], FeatureExtractor/MobilenetV2/expanded_conv_4/add[Float(32,38,38)] -> FeatureExtractor/MobilenetV2/expanded_conv_5/add[Float(32,38,38)] [01/19/2021-17:50:50] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Relu6, Tactic: -37215280111360163, FeatureExtractor/MobilenetV2/expanded_conv_5/add[Float(32,38,38)] -> FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Relu6[Float(192,38,38)] [01/19/2021-17:50:50] [V] [TRT] Layer(DepthwiseConvolution): FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/Relu6, Tactic: -1, FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Relu6[Float(192,38,38)] -> FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/Relu6[Float(192,19,19)] [01/19/2021-17:50:50] [V] [TRT] Layer(FusedConvActDirect): FeatureExtractor/MobilenetV2/expanded_conv_6/project/Conv2D, Tactic: 17, FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/Relu6[Float(192,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/batchnorm/add_1[Float(64,19,19)] [01/19/2021-17:50:50] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6, Tactic: 4501471010995462441, FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/batchnorm/add_1[Float(64,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6[Float(384,19,19)] [01/19/2021-17:50:50] [V] [TRT] Layer(DepthwiseConvolution): FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6, Tactic: -1, FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6[Float(384,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6[Float(384,19,19)] [01/19/2021-17:50:50] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add, Tactic: 5137655947464784826, FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6[Float(384,19,19)], FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/batchnorm/add_1[Float(64,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_7/add[Float(64,19,19)] [01/19/2021-17:50:50] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Relu6, Tactic: 4501471010995462441, FeatureExtractor/MobilenetV2/expanded_conv_7/add[Float(64,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Relu6[Float(384,19,19)] [01/19/2021-17:50:50] [V] [TRT] Layer(DepthwiseConvolution): FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/Relu6, Tactic: -1, FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Relu6[Float(384,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/Relu6[Float(384,19,19)] [01/19/2021-17:50:50] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV2/expanded_conv_8/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_8/add, Tactic: 5137655947464784826, FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/Relu6[Float(384,19,19)], FeatureExtractor/MobilenetV2/expanded_conv_7/add[Float(64,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_8/add[Float(64,19,19)] [01/19/2021-17:50:50] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Relu6, Tactic: 4501471010995462441, FeatureExtractor/MobilenetV2/expanded_conv_8/add[Float(64,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Relu6[Float(384,19,19)] [01/19/2021-17:50:50] [V] [TRT] Layer(DepthwiseConvolution): FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/Relu6, Tactic: -1, FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Relu6[Float(384,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/Relu6[Float(384,19,19)] [01/19/2021-17:50:50] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV2/expanded_conv_9/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_9/add, Tactic: 5137655947464784826, FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/Relu6[Float(384,19,19)], FeatureExtractor/MobilenetV2/expanded_conv_8/add[Float(64,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_9/add[Float(64,19,19)] [01/19/2021-17:50:50] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Relu6, Tactic: 4501471010995462441, FeatureExtractor/MobilenetV2/expanded_conv_9/add[Float(64,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Relu6[Float(384,19,19)] [01/19/2021-17:50:50] [V] [TRT] Layer(DepthwiseConvolution): FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/Relu6, Tactic: -1, FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Relu6[Float(384,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/Relu6[Float(384,19,19)] [01/19/2021-17:50:50] [V] [TRT] Layer(FusedConvActDirect): FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D, Tactic: 74, FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/Relu6[Float(384,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/batchnorm/add_1[Float(96,19,19)] [01/19/2021-17:50:50] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6, Tactic: 4501471010995462441, FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/batchnorm/add_1[Float(96,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6[Float(576,19,19)] [01/19/2021-17:50:50] [V] [TRT] Layer(DepthwiseConvolution): FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6, Tactic: -1, FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6[Float(576,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6[Float(576,19,19)] [01/19/2021-17:50:50] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add, Tactic: -37215280111360163, FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6[Float(576,19,19)], FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/batchnorm/add_1[Float(96,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_11/add[Float(96,19,19)] [01/19/2021-17:50:50] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Relu6, Tactic: 4501471010995462441, FeatureExtractor/MobilenetV2/expanded_conv_11/add[Float(96,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Relu6[Float(576,19,19)] [01/19/2021-17:50:50] [V] [TRT] Layer(DepthwiseConvolution): FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/Relu6, Tactic: -1, FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Relu6[Float(576,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/Relu6[Float(576,19,19)] [01/19/2021-17:50:50] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV2/expanded_conv_12/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_12/add, Tactic: -37215280111360163, FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/Relu6[Float(576,19,19)], FeatureExtractor/MobilenetV2/expanded_conv_11/add[Float(96,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_12/add[Float(96,19,19)] [01/19/2021-17:50:50] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6, Tactic: 4501471010995462441, FeatureExtractor/MobilenetV2/expanded_conv_12/add[Float(96,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6[Float(576,19,19)] [01/19/2021-17:50:50] [V] [TRT] Layer(scudnn_winograd): BoxPredictor_0/ClassPredictor/Conv2D || BoxPredictor_0/BoxEncodingPredictor/Conv2D, Tactic: 3827454225649558724, FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6[Float(576,19,19)] -> BoxPredictor_0/ClassPredictor/Conv2D || BoxPredictor_0/BoxEncodingPredictor/Conv2D[Float(285,19,19)] [01/19/2021-17:50:50] [V] [TRT] Layer(Shuffle): (Unnamed Layer* 404) [Shuffle] + BoxPredictor_0/Reshape_1, Tactic: 0, BoxPredictor_0/ClassPredictor/Conv2D || BoxPredictor_0/BoxEncodingPredictor/Conv2D[Float(273,19,19)] -> BoxPredictor_0/Reshape_1[Float(1083,91,1)] [01/19/2021-17:50:50] [V] [TRT] Layer(DepthwiseConvolution): FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6, Tactic: -1, FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6[Float(576,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6[Float(576,10,10)] [01/19/2021-17:50:50] [V] [TRT] Layer(FusedConvActDirect): FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D, Tactic: 31, FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6[Float(576,10,10)] -> FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/batchnorm/add_1[Float(160,10,10)] [01/19/2021-17:50:50] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6, Tactic: 5137655947464784826, FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/batchnorm/add_1[Float(160,10,10)] -> FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6[Float(960,10,10)] [01/19/2021-17:50:50] [V] [TRT] Layer(DepthwiseConvolution): FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6, Tactic: -1, FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6[Float(960,10,10)] -> FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6[Float(960,10,10)] [01/19/2021-17:50:50] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add, Tactic: -37215280111360163, FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6[Float(960,10,10)], FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/batchnorm/add_1[Float(160,10,10)] -> FeatureExtractor/MobilenetV2/expanded_conv_14/add[Float(160,10,10)] [01/19/2021-17:50:50] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Relu6, Tactic: 5137655947464784826, FeatureExtractor/MobilenetV2/expanded_conv_14/add[Float(160,10,10)] -> FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Relu6[Float(960,10,10)] [01/19/2021-17:50:50] [V] [TRT] Layer(DepthwiseConvolution): FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/Relu6, Tactic: -1, FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Relu6[Float(960,10,10)] -> FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/Relu6[Float(960,10,10)] [01/19/2021-17:50:50] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV2/expanded_conv_15/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/add, Tactic: -37215280111360163, FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/Relu6[Float(960,10,10)], FeatureExtractor/MobilenetV2/expanded_conv_14/add[Float(160,10,10)] -> FeatureExtractor/MobilenetV2/expanded_conv_15/add[Float(160,10,10)] [01/19/2021-17:50:50] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Relu6, Tactic: 5137655947464784826, FeatureExtractor/MobilenetV2/expanded_conv_15/add[Float(160,10,10)] -> FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Relu6[Float(960,10,10)] [01/19/2021-17:50:50] [V] [TRT] Layer(DepthwiseConvolution): FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/depthwise + FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/Relu6, Tactic: -1, FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Relu6[Float(960,10,10)] -> FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/Relu6[Float(960,10,10)] [01/19/2021-17:50:50] [V] [TRT] Layer(FusedConvActDirect): FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D, Tactic: 78, FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/Relu6[Float(960,10,10)] -> FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/batchnorm/add_1[Float(320,10,10)] [01/19/2021-17:50:50] [V] [TRT] Layer(scudnn): FeatureExtractor/MobilenetV2/Conv_1/Conv2D + FeatureExtractor/MobilenetV2/Conv_1/Relu6, Tactic: -37215280111360163, FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/batchnorm/add_1[Float(320,10,10)] -> FeatureExtractor/MobilenetV2/Conv_1/Relu6[Float(1280,10,10)] [01/19/2021-17:50:50] [V] [TRT] Layer(FusedConvActDirect): BoxPredictor_1/ClassPredictor/Conv2D || BoxPredictor_1/BoxEncodingPredictor/Conv2D, Tactic: 159, FeatureExtractor/MobilenetV2/Conv_1/Relu6[Float(1280,10,10)] -> BoxPredictor_1/ClassPredictor/Conv2D || BoxPredictor_1/BoxEncodingPredictor/Conv2D[Float(570,10,10)] [01/19/2021-17:50:50] [V] [TRT] Layer(Shuffle): (Unnamed Layer* 533) [Shuffle] + BoxPredictor_1/Reshape_1, Tactic: 0, BoxPredictor_1/ClassPredictor/Conv2D || BoxPredictor_1/BoxEncodingPredictor/Conv2D[Float(546,10,10)] -> BoxPredictor_1/Reshape_1[Float(600,91,1)] [01/19/2021-17:50:50] [V] [TRT] Layer(FusedConvActDirect): FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6, Tactic: 78, FeatureExtractor/MobilenetV2/Conv_1/Relu6[Float(1280,10,10)] -> FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6[Float(256,10,10)] [01/19/2021-17:50:50] [V] [TRT] Layer(DepthwiseConvolution): FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6, Tactic: -1, FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6[Float(256,10,10)] -> FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6[Float(256,5,5)] [01/19/2021-17:50:50] [V] [TRT] Layer(FusedConvActDirect): FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6, Tactic: 17, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6[Float(256,5,5)] -> FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6[Float(512,5,5)] [01/19/2021-17:50:50] [V] [TRT] Layer(FusedConvActDirect): BoxPredictor_2/ClassPredictor/Conv2D || BoxPredictor_2/BoxEncodingPredictor/Conv2D, Tactic: 26, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6[Float(512,5,5)] -> BoxPredictor_2/ClassPredictor/Conv2D || BoxPredictor_2/BoxEncodingPredictor/Conv2D[Float(570,5,5)] [01/19/2021-17:50:50] [V] [TRT] Layer(Shuffle): (Unnamed Layer* 574) [Shuffle] + BoxPredictor_2/Reshape_1, Tactic: 0, BoxPredictor_2/ClassPredictor/Conv2D || BoxPredictor_2/BoxEncodingPredictor/Conv2D[Float(546,5,5)] -> BoxPredictor_2/Reshape_1[Float(150,91,1)] [01/19/2021-17:50:50] [V] [TRT] Layer(FusedConvActDirect): FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6, Tactic: 31, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6[Float(512,5,5)] -> FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6[Float(128,5,5)] [01/19/2021-17:50:50] [V] [TRT] Layer(DepthwiseConvolution): FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6, Tactic: -1, FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6[Float(128,5,5)] -> FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6[Float(128,3,3)] [01/19/2021-17:50:50] [V] [TRT] Layer(FusedConvActDirect): FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6, Tactic: 31, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6[Float(128,3,3)] -> FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6[Float(256,3,3)] [01/19/2021-17:50:50] [V] [TRT] Layer(FusedConvActDirect): BoxPredictor_3/ClassPredictor/Conv2D || BoxPredictor_3/BoxEncodingPredictor/Conv2D, Tactic: 110, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6[Float(256,3,3)] -> BoxPredictor_3/ClassPredictor/Conv2D || BoxPredictor_3/BoxEncodingPredictor/Conv2D[Float(570,3,3)] [01/19/2021-17:50:50] [V] [TRT] Layer(Shuffle): (Unnamed Layer* 615) [Shuffle] + BoxPredictor_3/Reshape_1, Tactic: 0, BoxPredictor_3/ClassPredictor/Conv2D || BoxPredictor_3/BoxEncodingPredictor/Conv2D[Float(546,3,3)] -> BoxPredictor_3/Reshape_1[Float(54,91,1)] [01/19/2021-17:50:50] [V] [TRT] Layer(FusedConvActDirect): FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6, Tactic: 31, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6[Float(256,3,3)] -> FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6[Float(128,3,3)] [01/19/2021-17:50:50] [V] [TRT] Layer(DepthwiseConvolution): FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6, Tactic: -1, FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6[Float(128,3,3)] -> FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6[Float(128,2,2)] [01/19/2021-17:50:50] [V] [TRT] Layer(FusedConvActDirect): FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6, Tactic: 31, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6[Float(128,2,2)] -> FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6[Float(256,2,2)] [01/19/2021-17:50:50] [V] [TRT] Layer(FusedConvActDirect): BoxPredictor_4/ClassPredictor/Conv2D || BoxPredictor_4/BoxEncodingPredictor/Conv2D, Tactic: 26, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6[Float(256,2,2)] -> BoxPredictor_4/ClassPredictor/Conv2D || BoxPredictor_4/BoxEncodingPredictor/Conv2D[Float(570,2,2)] [01/19/2021-17:50:50] [V] [TRT] Layer(Shuffle): (Unnamed Layer* 656) [Shuffle] + BoxPredictor_4/Reshape_1, Tactic: 0, BoxPredictor_4/ClassPredictor/Conv2D || BoxPredictor_4/BoxEncodingPredictor/Conv2D[Float(546,2,2)] -> BoxPredictor_4/Reshape_1[Float(24,91,1)] [01/19/2021-17:50:50] [V] [TRT] Layer(FusedConvActDirect): FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6, Tactic: 31, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6[Float(256,2,2)] -> FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6[Float(64,2,2)] [01/19/2021-17:50:50] [V] [TRT] Layer(DepthwiseConvolution): FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6, Tactic: -1, FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6[Float(64,2,2)] -> FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6[Float(64,1,1)] [01/19/2021-17:50:50] [V] [TRT] Layer(FusedConvActDirect): FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6, Tactic: 17, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6[Float(64,1,1)] -> FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6[Float(128,1,1)] [01/19/2021-17:50:50] [V] [TRT] Layer(FusedConvActDirect): BoxPredictor_5/ClassPredictor/Conv2D || BoxPredictor_5/BoxEncodingPredictor/Conv2D, Tactic: 110, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6[Float(128,1,1)] -> BoxPredictor_5/ClassPredictor/Conv2D || BoxPredictor_5/BoxEncodingPredictor/Conv2D[Float(570,1,1)] [01/19/2021-17:50:50] [V] [TRT] Layer(Shuffle): (Unnamed Layer* 697) [Shuffle] + BoxPredictor_5/Reshape_1, Tactic: 0, BoxPredictor_5/ClassPredictor/Conv2D || BoxPredictor_5/BoxEncodingPredictor/Conv2D[Float(546,1,1)] -> BoxPredictor_5/Reshape_1[Float(6,91,1)] [01/19/2021-17:50:50] [V] [TRT] Layer(PluginV2): concat_box_conf, Tactic: 0, BoxPredictor_0/Reshape_1[Float(1083,91,1)], BoxPredictor_1/Reshape_1[Float(600,91,1)], BoxPredictor_2/Reshape_1[Float(150,91,1)], BoxPredictor_3/Reshape_1[Float(54,91,1)], BoxPredictor_4/Reshape_1[Float(24,91,1)], BoxPredictor_5/Reshape_1[Float(6,91,1)] -> concat_box_conf[Float(174447,1,1)] [01/19/2021-17:50:50] [V] [TRT] Layer(Shuffle): (Unnamed Layer* 707) [Shuffle] + BoxPredictor_0/Reshape, Tactic: 0, BoxPredictor_0/ClassPredictor/Conv2D || BoxPredictor_0/BoxEncodingPredictor/Conv2D[Float(12,19,19)] -> BoxPredictor_0/Reshape[Float(1083,1,4)] [01/19/2021-17:50:50] [V] [TRT] Layer(Shuffle): (Unnamed Layer* 716) [Shuffle] + BoxPredictor_1/Reshape, Tactic: 0, BoxPredictor_1/ClassPredictor/Conv2D || BoxPredictor_1/BoxEncodingPredictor/Conv2D[Float(24,10,10)] -> BoxPredictor_1/Reshape[Float(600,1,4)] [01/19/2021-17:50:50] [V] [TRT] Layer(Shuffle): (Unnamed Layer* 725) [Shuffle] + BoxPredictor_2/Reshape, Tactic: 0, BoxPredictor_2/ClassPredictor/Conv2D || BoxPredictor_2/BoxEncodingPredictor/Conv2D[Float(24,5,5)] -> BoxPredictor_2/Reshape[Float(150,1,4)] [01/19/2021-17:50:50] [V] [TRT] Layer(Shuffle): (Unnamed Layer* 734) [Shuffle] + BoxPredictor_3/Reshape, Tactic: 0, BoxPredictor_3/ClassPredictor/Conv2D || BoxPredictor_3/BoxEncodingPredictor/Conv2D[Float(24,3,3)] -> BoxPredictor_3/Reshape[Float(54,1,4)] [01/19/2021-17:50:50] [V] [TRT] Layer(Shuffle): (Unnamed Layer* 743) [Shuffle] + BoxPredictor_4/Reshape, Tactic: 0, BoxPredictor_4/ClassPredictor/Conv2D || BoxPredictor_4/BoxEncodingPredictor/Conv2D[Float(24,2,2)] -> BoxPredictor_4/Reshape[Float(24,1,4)] [01/19/2021-17:50:50] [V] [TRT] Layer(Shuffle): (Unnamed Layer* 752) [Shuffle] + BoxPredictor_5/Reshape, Tactic: 0, BoxPredictor_5/ClassPredictor/Conv2D || BoxPredictor_5/BoxEncodingPredictor/Conv2D[Float(24,1,1)] -> BoxPredictor_5/Reshape[Float(6,1,4)] [01/19/2021-17:50:50] [V] [TRT] Layer(PluginV2): Squeeze, Tactic: 0, BoxPredictor_0/Reshape[Float(1083,1,4)], BoxPredictor_1/Reshape[Float(600,1,4)], BoxPredictor_2/Reshape[Float(150,1,4)], BoxPredictor_3/Reshape[Float(54,1,4)], BoxPredictor_4/Reshape[Float(24,1,4)], BoxPredictor_5/Reshape[Float(6,1,4)] -> Squeeze[Float(7668,1,1)] [01/19/2021-17:50:50] [V] [TRT] Layer(Constant): Const, Tactic: 0, -> Const[Float(2)] [01/19/2021-17:50:50] [V] [TRT] Layer(Reformat): GridAnchor input reformatter 0, Tactic: 0, Const[Float(2)] -> GridAnchor reformatted input 0[Float(2)] [01/19/2021-17:50:50] [V] [TRT] Layer(PluginV2): GridAnchor, Tactic: 0, GridAnchor reformatted input 0[Float(2)] -> GridAnchor[Float(2,4332,1)], GridAnchor_1[Float(2,2400,1)], GridAnchor_2[Float(2,600,1)], GridAnchor_3[Float(2,216,1)], GridAnchor_4[Float(2,96,1)], GridAnchor_5[Float(2,24,1)] [01/19/2021-17:50:50] [V] [TRT] Layer(Reformat): GridAnchor copy, Tactic: 0, GridAnchor[Float(2,4332,1)] -> concat_priorbox[Float(2,4332,1)] [01/19/2021-17:50:50] [V] [TRT] Layer(Reformat): GridAnchor_1 copy, Tactic: 0, GridAnchor_1[Float(2,2400,1)] -> concat_priorbox[Float(2,2400,1)] [01/19/2021-17:50:50] [V] [TRT] Layer(Reformat): GridAnchor_2 copy, Tactic: 0, GridAnchor_2[Float(2,600,1)] -> concat_priorbox[Float(2,600,1)] [01/19/2021-17:50:50] [V] [TRT] Layer(Reformat): GridAnchor_3 copy, Tactic: 0, GridAnchor_3[Float(2,216,1)] -> concat_priorbox[Float(2,216,1)] [01/19/2021-17:50:50] [V] [TRT] Layer(Reformat): GridAnchor_4 copy, Tactic: 0, GridAnchor_4[Float(2,96,1)] -> concat_priorbox[Float(2,96,1)] [01/19/2021-17:50:50] [V] [TRT] Layer(Reformat): GridAnchor_5 copy, Tactic: 0, GridAnchor_5[Float(2,24,1)] -> concat_priorbox[Float(2,24,1)] [01/19/2021-17:50:50] [V] [TRT] Layer(PluginV2): NMS, Tactic: 0, concat_box_conf[Float(174447,1,1)], Squeeze[Float(7668,1,1)], concat_priorbox[Float(2,7668,1)] -> NMS[Float(1,100,7)], NMS_1[Float(1,1,1)] [01/19/2021-17:50:50] [W] [TRT] Current optimization profile is: 0. Please ensure there are no enqueued operations pending in this context prior to switching profiles [01/19/2021-17:50:53] [I] Warmup completed 64 queries over 200 ms [01/19/2021-17:50:53] [I] Timing trace has 953 queries over 3.0122 s [01/19/2021-17:50:53] [I] Trace averages of 10 runs: [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.09074 ms - Host latency: 3.18718 ms (end to end 6.12924 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.09033 ms - Host latency: 3.18808 ms (end to end 6.12546 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.08828 ms - Host latency: 3.18306 ms (end to end 6.12704 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.1917 ms - Host latency: 3.28875 ms (end to end 6.31784 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.26247 ms - Host latency: 3.35867 ms (end to end 6.41463 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.18516 ms - Host latency: 3.28245 ms (end to end 6.38071 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.17973 ms - Host latency: 3.27697 ms (end to end 6.28264 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.09842 ms - Host latency: 3.19489 ms (end to end 6.16517 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.08828 ms - Host latency: 3.18371 ms (end to end 6.12927 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.16109 ms - Host latency: 3.25705 ms (end to end 6.27492 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.13498 ms - Host latency: 3.23055 ms (end to end 6.221 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.14634 ms - Host latency: 3.24203 ms (end to end 6.2476 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.16855 ms - Host latency: 3.26472 ms (end to end 6.2924 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.14748 ms - Host latency: 3.24449 ms (end to end 5.92891 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.22161 ms - Host latency: 3.31731 ms (end to end 6.36057 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.19406 ms - Host latency: 3.29138 ms (end to end 6.37127 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.10396 ms - Host latency: 3.19988 ms (end to end 6.1584 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.18351 ms - Host latency: 3.27854 ms (end to end 6.30728 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.16959 ms - Host latency: 3.26597 ms (end to end 6.28892 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.14635 ms - Host latency: 3.24118 ms (end to end 6.23828 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.1701 ms - Host latency: 3.26548 ms (end to end 6.30246 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.09872 ms - Host latency: 3.19386 ms (end to end 6.16598 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.17072 ms - Host latency: 3.26835 ms (end to end 6.28683 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.20429 ms - Host latency: 3.30142 ms (end to end 6.35538 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.13835 ms - Host latency: 3.23619 ms (end to end 6.184 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.15443 ms - Host latency: 3.25099 ms (end to end 6.28493 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.17307 ms - Host latency: 3.2699 ms (end to end 6.26971 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.16324 ms - Host latency: 3.26051 ms (end to end 6.29692 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.21659 ms - Host latency: 3.31327 ms (end to end 6.38331 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.15616 ms - Host latency: 3.25061 ms (end to end 6.25233 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.16375 ms - Host latency: 3.25848 ms (end to end 6.2926 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.12657 ms - Host latency: 3.22124 ms (end to end 6.2371 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.13169 ms - Host latency: 3.22683 ms (end to end 6.1869 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.17152 ms - Host latency: 3.2683 ms (end to end 6.32739 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.15227 ms - Host latency: 3.24757 ms (end to end 6.26562 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.17263 ms - Host latency: 3.26708 ms (end to end 6.29481 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.11749 ms - Host latency: 3.21279 ms (end to end 6.20247 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.09822 ms - Host latency: 3.19331 ms (end to end 6.15355 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.09974 ms - Host latency: 3.19673 ms (end to end 6.1505 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.09851 ms - Host latency: 3.19524 ms (end to end 6.1531 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.12865 ms - Host latency: 3.22426 ms (end to end 6.21329 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.11398 ms - Host latency: 3.21005 ms (end to end 6.18269 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.16027 ms - Host latency: 3.25626 ms (end to end 6.21613 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.12655 ms - Host latency: 3.22238 ms (end to end 6.2625 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.74189 ms - Host latency: 3.83782 ms (end to end 7.3587 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.45537 ms - Host latency: 3.55077 ms (end to end 6.93712 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.37686 ms - Host latency: 3.47181 ms (end to end 6.71134 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.34542 ms - Host latency: 3.44012 ms (end to end 6.64265 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.22091 ms - Host latency: 3.31575 ms (end to end 6.4028 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.17871 ms - Host latency: 3.27389 ms (end to end 6.3188 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.09493 ms - Host latency: 3.18988 ms (end to end 6.14838 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.10238 ms - Host latency: 3.19698 ms (end to end 6.15814 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.11212 ms - Host latency: 3.2069 ms (end to end 6.18623 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.10913 ms - Host latency: 3.20405 ms (end to end 6.17668 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.09485 ms - Host latency: 3.19069 ms (end to end 6.14648 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.13547 ms - Host latency: 3.23263 ms (end to end 6.22011 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.17478 ms - Host latency: 3.27252 ms (end to end 6.29397 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.19253 ms - Host latency: 3.29 ms (end to end 6.31298 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.19425 ms - Host latency: 3.29121 ms (end to end 6.3163 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.28872 ms - Host latency: 3.3834 ms (end to end 6.52856 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.24441 ms - Host latency: 3.33967 ms (end to end 6.42903 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.1416 ms - Host latency: 3.2386 ms (end to end 6.25183 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.10024 ms - Host latency: 3.19644 ms (end to end 6.15322 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.16672 ms - Host latency: 3.26147 ms (end to end 6.27209 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.09932 ms - Host latency: 3.19443 ms (end to end 6.17268 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.09678 ms - Host latency: 3.19258 ms (end to end 6.1532 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.09377 ms - Host latency: 3.18872 ms (end to end 6.14424 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.10278 ms - Host latency: 3.19788 ms (end to end 6.16113 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.097 ms - Host latency: 3.19402 ms (end to end 6.13784 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.09612 ms - Host latency: 3.19114 ms (end to end 6.14866 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.10303 ms - Host latency: 3.19827 ms (end to end 6.15537 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.10029 ms - Host latency: 3.19517 ms (end to end 6.16023 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.10361 ms - Host latency: 3.19866 ms (end to end 6.16121 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.09668 ms - Host latency: 3.19163 ms (end to end 6.15139 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.09563 ms - Host latency: 3.19043 ms (end to end 6.14907 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.09687 ms - Host latency: 3.19192 ms (end to end 6.15176 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.10029 ms - Host latency: 3.19578 ms (end to end 6.14834 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.09753 ms - Host latency: 3.19229 ms (end to end 6.15586 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.16865 ms - Host latency: 3.26406 ms (end to end 6.28877 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.10269 ms - Host latency: 3.1981 ms (end to end 6.16582 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.10195 ms - Host latency: 3.19697 ms (end to end 6.15771 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.0969 ms - Host latency: 3.19204 ms (end to end 6.15208 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.09526 ms - Host latency: 3.19026 ms (end to end 6.14878 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.0957 ms - Host latency: 3.19075 ms (end to end 6.15012 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.09543 ms - Host latency: 3.19016 ms (end to end 6.14951 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.09539 ms - Host latency: 3.19131 ms (end to end 6.00566 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.09395 ms - Host latency: 3.19331 ms (end to end 5.98237 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.09785 ms - Host latency: 3.19404 ms (end to end 6.10598 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.09692 ms - Host latency: 3.19211 ms (end to end 6.13616 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.10237 ms - Host latency: 3.19768 ms (end to end 6.15508 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.09395 ms - Host latency: 3.1896 ms (end to end 6.14407 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.09502 ms - Host latency: 3.1897 ms (end to end 6.14988 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.09524 ms - Host latency: 3.18945 ms (end to end 6.14417 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.09443 ms - Host latency: 3.19001 ms (end to end 6.14146 ms) [01/19/2021-17:50:53] [I] Average on 10 runs - GPU latency: 3.14973 ms - Host latency: 3.24429 ms (end to end 6.25525 ms) [01/19/2021-17:50:53] [I] Host latency [01/19/2021-17:50:53] [I] min: 3.16257 ms (end to end 3.40613 ms) [01/19/2021-17:50:53] [I] max: 4.98853 ms (end to end 8.3302 ms) [01/19/2021-17:50:53] [I] mean: 3.24502 ms (end to end 6.24453 ms) [01/19/2021-17:50:53] [I] median: 3.19556 ms (end to end 6.15674 ms) [01/19/2021-17:50:53] [I] percentile: 3.95361 ms at 99% (end to end 7.16931 ms at 99%) [01/19/2021-17:50:53] [I] throughput: 316.38 qps [01/19/2021-17:50:53] [I] walltime: 3.0122 s [01/19/2021-17:50:53] [I] GPU Compute [01/19/2021-17:50:53] [I] min: 3.06787 ms [01/19/2021-17:50:53] [I] max: 4.89368 ms [01/19/2021-17:50:53] [I] mean: 3.14927 ms [01/19/2021-17:50:53] [I] median: 3.09967 ms [01/19/2021-17:50:53] [I] percentile: 3.8584 ms at 99% [01/19/2021-17:50:53] [I] total compute time: 3.00126 s &&&& PASSED TensorRT.trtexec # /usr/src/tensorrt/bin/trtexec --uff=frozen_inference_graph.uff --uffInput=Input,3,300,300 --output=NMS --verbose root@f96e084d7778:/Studienarbeit/tensorflow_od/uff/test# ~