&&&& RUNNING TensorRT.trtexec [TensorRT v8003] # C:\Program Files\NVIDIA GPU Computing Toolkit\TensorRT-8.0.3.4\bin\trtexec.exe --onnx=resnet_gap_surgery.onnx --useCudaGraph --threads --noDataTransfers --verbose --best [10/12/2021-21:19:59] [I] === Model Options === [10/12/2021-21:19:59] [I] Format: ONNX [10/12/2021-21:19:59] [I] Model: resnet_gap_surgery.onnx [10/12/2021-21:19:59] [I] Output: [10/12/2021-21:19:59] [I] === Build Options === [10/12/2021-21:19:59] [I] Max batch: explicit [10/12/2021-21:19:59] [I] Workspace: 16 MiB [10/12/2021-21:19:59] [I] minTiming: 1 [10/12/2021-21:19:59] [I] avgTiming: 8 [10/12/2021-21:19:59] [I] Precision: FP32+FP16+INT8 [10/12/2021-21:19:59] [I] Calibration: Dynamic [10/12/2021-21:19:59] [I] Refit: Disabled [10/12/2021-21:19:59] [I] Sparsity: Disabled [10/12/2021-21:19:59] [I] Safe mode: Disabled [10/12/2021-21:19:59] [I] Restricted mode: Disabled [10/12/2021-21:19:59] [I] Save engine: [10/12/2021-21:19:59] [I] Load engine: [10/12/2021-21:19:59] [I] NVTX verbosity: 0 [10/12/2021-21:19:59] [I] Tactic sources: Using default tactic sources [10/12/2021-21:19:59] [I] timingCacheMode: local [10/12/2021-21:19:59] [I] timingCacheFile: [10/12/2021-21:19:59] [I] Input(s)s format: fp32:CHW [10/12/2021-21:19:59] [I] Output(s)s format: fp32:CHW [10/12/2021-21:19:59] [I] Input build shapes: model [10/12/2021-21:19:59] [I] Input calibration shapes: model [10/12/2021-21:19:59] [I] === System Options === [10/12/2021-21:19:59] [I] Device: 0 [10/12/2021-21:19:59] [I] DLACore: [10/12/2021-21:19:59] [I] Plugins: [10/12/2021-21:19:59] [I] === Inference Options === [10/12/2021-21:19:59] [I] Batch: Explicit [10/12/2021-21:19:59] [I] Input inference shapes: model [10/12/2021-21:19:59] [I] Iterations: 10 [10/12/2021-21:19:59] [I] Duration: 3s (+ 200ms warm up) [10/12/2021-21:19:59] [I] Sleep time: 0ms [10/12/2021-21:19:59] [I] Streams: 1 [10/12/2021-21:19:59] [I] ExposeDMA: Disabled [10/12/2021-21:19:59] [I] Data transfers: Disabled [10/12/2021-21:19:59] [I] Spin-wait: Disabled [10/12/2021-21:19:59] [I] Multithreading: Enabled [10/12/2021-21:19:59] [I] CUDA Graph: Enabled [10/12/2021-21:19:59] [I] Separate profiling: Disabled [10/12/2021-21:19:59] [I] Time Deserialize: Disabled [10/12/2021-21:19:59] [I] Time Refit: Disabled [10/12/2021-21:19:59] [I] Skip inference: Disabled [10/12/2021-21:19:59] [I] Inputs: [10/12/2021-21:19:59] [I] === Reporting Options === [10/12/2021-21:19:59] [I] Verbose: Enabled [10/12/2021-21:19:59] [I] Averages: 10 inferences [10/12/2021-21:19:59] [I] Percentile: 99 [10/12/2021-21:19:59] [I] Dump refittable layers:Disabled [10/12/2021-21:19:59] [I] Dump output: Disabled [10/12/2021-21:19:59] [I] Profile: Disabled [10/12/2021-21:19:59] [I] Export timing to JSON file: [10/12/2021-21:19:59] [I] Export output to JSON file: [10/12/2021-21:19:59] [I] Export profile to JSON file: [10/12/2021-21:19:59] [I] [10/12/2021-21:19:59] [I] === Device Information === [10/12/2021-21:19:59] [I] Selected Device: GeForce GTX 1060 6GB [10/12/2021-21:19:59] [I] Compute Capability: 6.1 [10/12/2021-21:19:59] [I] SMs: 10 [10/12/2021-21:19:59] [I] Compute Clock Rate: 1.7085 GHz [10/12/2021-21:19:59] [I] Device Global Memory: 6144 MiB [10/12/2021-21:19:59] [I] Shared Memory per SM: 96 KiB [10/12/2021-21:19:59] [I] Memory Bus Width: 192 bits (ECC disabled) [10/12/2021-21:19:59] [I] Memory Clock Rate: 4.004 GHz [10/12/2021-21:19:59] [I] [10/12/2021-21:19:59] [I] TensorRT version: 8003 [10/12/2021-21:19:59] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Registered plugin creator - ::GridAnchorRect_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Registered plugin creator - ::Region_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Registered plugin creator - ::ScatterND version 1 [10/12/2021-21:19:59] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Registered plugin creator - ::BatchedNMSDynamic_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Registered plugin creator - ::CropAndResize version 1 [10/12/2021-21:19:59] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Registered plugin creator - ::EfficientNMS_ONNX_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Registered plugin creator - ::EfficientNMS_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Registered plugin creator - ::Proposal version 1 [10/12/2021-21:19:59] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Registered plugin creator - ::Split version 1 [10/12/2021-21:19:59] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1 [10/12/2021-21:19:59] [I] [TRT] [MemUsageChange] Init CUDA: CPU +229, GPU +0, now: CPU 9038, GPU 977 (MiB) [10/12/2021-21:19:59] [I] Start parsing network model [10/12/2021-21:19:59] [I] [TRT] ---------------------------------------------------------------- [10/12/2021-21:19:59] [I] [TRT] Input filename: resnet_gap_surgery.onnx [10/12/2021-21:19:59] [I] [TRT] ONNX IR version: 0.0.8 [10/12/2021-21:19:59] [I] [TRT] Opset version: 13 [10/12/2021-21:19:59] [I] [TRT] Producer name: [10/12/2021-21:19:59] [I] [TRT] Producer version: [10/12/2021-21:19:59] [I] [TRT] Domain: [10/12/2021-21:19:59] [I] [TRT] Model version: 0 [10/12/2021-21:19:59] [I] [TRT] Doc string: [10/12/2021-21:19:59] [I] [TRT] ---------------------------------------------------------------- [10/12/2021-21:19:59] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Plugin creator already registered - ::GridAnchorRect_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Plugin creator already registered - ::NMS_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Plugin creator already registered - ::Reorg_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Plugin creator already registered - ::Region_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Plugin creator already registered - ::Clip_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Plugin creator already registered - ::LReLU_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Plugin creator already registered - ::Normalize_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Plugin creator already registered - ::ScatterND version 1 [10/12/2021-21:19:59] [V] [TRT] Plugin creator already registered - ::RPROI_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Plugin creator already registered - ::BatchedNMSDynamic_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1 [10/12/2021-21:19:59] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Plugin creator already registered - ::EfficientNMS_ONNX_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Plugin creator already registered - ::EfficientNMS_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Plugin creator already registered - ::Proposal version 1 [10/12/2021-21:19:59] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Plugin creator already registered - ::Split version 1 [10/12/2021-21:19:59] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 1 [10/12/2021-21:19:59] [V] [TRT] Adding network input: input_1 with dtype: float32, dimensions: (1, 3, 32, 32) [10/12/2021-21:19:59] [V] [TRT] Registering tensor: input_1 for ONNX tensor: input_1 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_36/transpose__400 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__996 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_35/transpose__388 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__984 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_34/transpose__378 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__976 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_33/transpose__366 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__964 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_32/transpose__356 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__956 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_31/transpose__344 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__944 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_30/transpose__334 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__936 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_29/transpose__322 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__924 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_28/transpose__312 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__916 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_27/transpose__300 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__904 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_26/transpose__290 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__896 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_25/transpose__278 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__884 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_24/transpose__268 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__876 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_23/transpose__256 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__864 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_22/transpose__246 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__856 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_20/transpose__234 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__844 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_19/transpose__224 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__836 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_21/transpose__216 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__824 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_18/transpose__206 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__816 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_17/transpose__196 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__808 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_16/transpose__184 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__796 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_15/transpose__174 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__788 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_14/transpose__162 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__776 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_13/transpose__152 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__768 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_12/transpose__140 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__756 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_11/transpose__130 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__748 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_10/transpose__118 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__736 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_9/transpose__108 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__728 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_8/transpose__96 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__716 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_7/transpose__86 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__708 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_6/transpose__74 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__696 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_5/transpose__64 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__688 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_4/transpose__52 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__676 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_3/transpose__42 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__668 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_2/transpose__30 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__656 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_1/transpose__20 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__648 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d/transpose__8 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__636 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__632 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: zero_point__933 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/dense/quantize_and_dequantize_1/ReadVariableOp__626 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1204 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: zero_point__1205 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_56/transpose__614 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1192 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_55/transpose__604 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1184 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_54/transpose__592 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1172 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_53/transpose__582 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1164 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_52/transpose__570 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1152 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_51/transpose__560 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1144 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_50/transpose__548 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1132 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_49/transpose__538 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1124 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_48/transpose__526 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1112 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_47/transpose__516 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1104 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_46/transpose__504 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1092 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_45/transpose__494 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1084 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_44/transpose__482 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1072 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_43/transpose__472 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1064 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_42/transpose__460 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1052 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_41/transpose__450 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1044 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_39/transpose__438 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1032 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_38/transpose__428 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1024 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_40/transpose__420 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1012 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_37/transpose__410 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1004 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d/BiasAdd/ReadVariableOp__11 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization/ReadVariableOp__12 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization/ReadVariableOp_1__13 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization/FusedBatchNormV3/ReadVariableOp__14 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization/FusedBatchNormV3/ReadVariableOp_1__15 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__644 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_1/BiasAdd/ReadVariableOp__23 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_1/ReadVariableOp__24 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_1/ReadVariableOp_1__25 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_1/FusedBatchNormV3/ReadVariableOp__26 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_1/FusedBatchNormV3/ReadVariableOp_1__27 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__652 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_2/BiasAdd/ReadVariableOp__33 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_2/ReadVariableOp__34 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_2/ReadVariableOp_1__35 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_2/FusedBatchNormV3/ReadVariableOp__36 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_2/FusedBatchNormV3/ReadVariableOp_1__37 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__660 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_3/BiasAdd/ReadVariableOp__45 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_3/ReadVariableOp__46 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_3/ReadVariableOp_1__47 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_3/FusedBatchNormV3/ReadVariableOp__48 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_3/FusedBatchNormV3/ReadVariableOp_1__49 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__672 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_4/BiasAdd/ReadVariableOp__55 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_4/ReadVariableOp__56 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_4/ReadVariableOp_1__57 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_4/FusedBatchNormV3/ReadVariableOp__58 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_4/FusedBatchNormV3/ReadVariableOp_1__59 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__684 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_5/BiasAdd/ReadVariableOp__67 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_5/ReadVariableOp__68 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_5/ReadVariableOp_1__69 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_5/FusedBatchNormV3/ReadVariableOp__70 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_5/FusedBatchNormV3/ReadVariableOp_1__71 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__692 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_6/BiasAdd/ReadVariableOp__77 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_6/ReadVariableOp__78 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_6/ReadVariableOp_1__79 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_6/FusedBatchNormV3/ReadVariableOp__80 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_6/FusedBatchNormV3/ReadVariableOp_1__81 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__700 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_7/BiasAdd/ReadVariableOp__89 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_7/ReadVariableOp__90 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_7/ReadVariableOp_1__91 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_7/FusedBatchNormV3/ReadVariableOp__92 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_7/FusedBatchNormV3/ReadVariableOp_1__93 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__712 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_8/BiasAdd/ReadVariableOp__99 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_8/ReadVariableOp__100 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_8/ReadVariableOp_1__101 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_8/FusedBatchNormV3/ReadVariableOp__102 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_8/FusedBatchNormV3/ReadVariableOp_1__103 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__720 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_9/BiasAdd/ReadVariableOp__111 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_9/ReadVariableOp__112 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_9/ReadVariableOp_1__113 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_9/FusedBatchNormV3/ReadVariableOp__114 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_9/FusedBatchNormV3/ReadVariableOp_1__115 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__732 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_10/BiasAdd/ReadVariableOp__121 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_10/ReadVariableOp__122 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_10/ReadVariableOp_1__123 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_10/FusedBatchNormV3/ReadVariableOp__124 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_10/FusedBatchNormV3/ReadVariableOp_1__125 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__744 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_11/BiasAdd/ReadVariableOp__133 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_11/ReadVariableOp__134 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_11/ReadVariableOp_1__135 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_11/FusedBatchNormV3/ReadVariableOp__136 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_11/FusedBatchNormV3/ReadVariableOp_1__137 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__752 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_12/BiasAdd/ReadVariableOp__143 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_12/ReadVariableOp__144 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_12/ReadVariableOp_1__145 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_12/FusedBatchNormV3/ReadVariableOp__146 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_12/FusedBatchNormV3/ReadVariableOp_1__147 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__760 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_13/BiasAdd/ReadVariableOp__155 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_13/ReadVariableOp__156 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_13/ReadVariableOp_1__157 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_13/FusedBatchNormV3/ReadVariableOp__158 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_13/FusedBatchNormV3/ReadVariableOp_1__159 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__772 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_14/BiasAdd/ReadVariableOp__165 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_14/ReadVariableOp__166 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_14/ReadVariableOp_1__167 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_14/FusedBatchNormV3/ReadVariableOp__168 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_14/FusedBatchNormV3/ReadVariableOp_1__169 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__784 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_15/BiasAdd/ReadVariableOp__177 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_15/ReadVariableOp__178 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_15/ReadVariableOp_1__179 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_15/FusedBatchNormV3/ReadVariableOp__180 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_15/FusedBatchNormV3/ReadVariableOp_1__181 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__792 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_16/BiasAdd/ReadVariableOp__187 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_16/ReadVariableOp__188 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_16/ReadVariableOp_1__189 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_16/FusedBatchNormV3/ReadVariableOp__190 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_16/FusedBatchNormV3/ReadVariableOp_1__191 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__804 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_17/BiasAdd/ReadVariableOp__199 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_17/ReadVariableOp__200 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_17/ReadVariableOp_1__201 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_17/FusedBatchNormV3/ReadVariableOp__202 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_17/FusedBatchNormV3/ReadVariableOp_1__203 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__812 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_18/BiasAdd/ReadVariableOp__209 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_18/ReadVariableOp__210 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_18/ReadVariableOp_1__211 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_18/FusedBatchNormV3/ReadVariableOp__212 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_18/FusedBatchNormV3/ReadVariableOp_1__213 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__832 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_19/BiasAdd/ReadVariableOp__227 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_21/BiasAdd/ReadVariableOp__219 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_19/ReadVariableOp__228 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_19/ReadVariableOp_1__229 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_19/FusedBatchNormV3/ReadVariableOp__230 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_19/FusedBatchNormV3/ReadVariableOp_1__231 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__828 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__840 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_20/BiasAdd/ReadVariableOp__237 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_20/ReadVariableOp__238 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_20/ReadVariableOp_1__239 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_20/FusedBatchNormV3/ReadVariableOp__240 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_20/FusedBatchNormV3/ReadVariableOp_1__241 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__848 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_22/BiasAdd/ReadVariableOp__249 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_21/ReadVariableOp__250 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_21/ReadVariableOp_1__251 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_21/FusedBatchNormV3/ReadVariableOp__252 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_21/FusedBatchNormV3/ReadVariableOp_1__253 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__860 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_23/BiasAdd/ReadVariableOp__259 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_22/ReadVariableOp__260 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_22/ReadVariableOp_1__261 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_22/FusedBatchNormV3/ReadVariableOp__262 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_22/FusedBatchNormV3/ReadVariableOp_1__263 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__868 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_24/BiasAdd/ReadVariableOp__271 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_23/ReadVariableOp__272 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_23/ReadVariableOp_1__273 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_23/FusedBatchNormV3/ReadVariableOp__274 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_23/FusedBatchNormV3/ReadVariableOp_1__275 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__880 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_25/BiasAdd/ReadVariableOp__281 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_24/ReadVariableOp__282 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_24/ReadVariableOp_1__283 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_24/FusedBatchNormV3/ReadVariableOp__284 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_24/FusedBatchNormV3/ReadVariableOp_1__285 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__888 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_26/BiasAdd/ReadVariableOp__293 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_25/ReadVariableOp__294 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_25/ReadVariableOp_1__295 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_25/FusedBatchNormV3/ReadVariableOp__296 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_25/FusedBatchNormV3/ReadVariableOp_1__297 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__900 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_27/BiasAdd/ReadVariableOp__303 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_26/ReadVariableOp__304 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_26/ReadVariableOp_1__305 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_26/FusedBatchNormV3/ReadVariableOp__306 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_26/FusedBatchNormV3/ReadVariableOp_1__307 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__908 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_28/BiasAdd/ReadVariableOp__315 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_27/ReadVariableOp__316 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_27/ReadVariableOp_1__317 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_27/FusedBatchNormV3/ReadVariableOp__318 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_27/FusedBatchNormV3/ReadVariableOp_1__319 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__920 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_29/BiasAdd/ReadVariableOp__325 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_28/ReadVariableOp__326 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_28/ReadVariableOp_1__327 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_28/FusedBatchNormV3/ReadVariableOp__328 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_28/FusedBatchNormV3/ReadVariableOp_1__329 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__928 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_30/BiasAdd/ReadVariableOp__337 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_29/ReadVariableOp__338 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_29/ReadVariableOp_1__339 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_29/FusedBatchNormV3/ReadVariableOp__340 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_29/FusedBatchNormV3/ReadVariableOp_1__341 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__940 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_31/BiasAdd/ReadVariableOp__347 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_30/ReadVariableOp__348 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_30/ReadVariableOp_1__349 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_30/FusedBatchNormV3/ReadVariableOp__350 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_30/FusedBatchNormV3/ReadVariableOp_1__351 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__952 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_32/BiasAdd/ReadVariableOp__359 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_31/ReadVariableOp__360 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_31/ReadVariableOp_1__361 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_31/FusedBatchNormV3/ReadVariableOp__362 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_31/FusedBatchNormV3/ReadVariableOp_1__363 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__960 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_33/BiasAdd/ReadVariableOp__369 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_32/ReadVariableOp__370 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_32/ReadVariableOp_1__371 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_32/FusedBatchNormV3/ReadVariableOp__372 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_32/FusedBatchNormV3/ReadVariableOp_1__373 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__972 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_34/BiasAdd/ReadVariableOp__381 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_33/ReadVariableOp__382 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_33/ReadVariableOp_1__383 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_33/FusedBatchNormV3/ReadVariableOp__384 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_33/FusedBatchNormV3/ReadVariableOp_1__385 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__980 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_35/BiasAdd/ReadVariableOp__391 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_34/ReadVariableOp__392 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_34/ReadVariableOp_1__393 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_34/FusedBatchNormV3/ReadVariableOp__394 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_34/FusedBatchNormV3/ReadVariableOp_1__395 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__992 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_36/BiasAdd/ReadVariableOp__403 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_35/ReadVariableOp__404 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_35/ReadVariableOp_1__405 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_35/FusedBatchNormV3/ReadVariableOp__406 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_35/FusedBatchNormV3/ReadVariableOp_1__407 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1000 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_37/BiasAdd/ReadVariableOp__413 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_36/ReadVariableOp__414 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_36/ReadVariableOp_1__415 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_36/FusedBatchNormV3/ReadVariableOp__416 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_36/FusedBatchNormV3/ReadVariableOp_1__417 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1008 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_38/BiasAdd/ReadVariableOp__431 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_40/BiasAdd/ReadVariableOp__423 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_37/ReadVariableOp__432 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_37/ReadVariableOp_1__433 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_37/FusedBatchNormV3/ReadVariableOp__434 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_37/FusedBatchNormV3/ReadVariableOp_1__435 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1016 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1028 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_39/BiasAdd/ReadVariableOp__441 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_38/ReadVariableOp__442 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_38/ReadVariableOp_1__443 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_38/FusedBatchNormV3/ReadVariableOp__444 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_38/FusedBatchNormV3/ReadVariableOp_1__445 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1040 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_41/BiasAdd/ReadVariableOp__453 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_39/ReadVariableOp__454 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_39/ReadVariableOp_1__455 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_39/FusedBatchNormV3/ReadVariableOp__456 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_39/FusedBatchNormV3/ReadVariableOp_1__457 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1048 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_42/BiasAdd/ReadVariableOp__463 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_40/ReadVariableOp__464 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_40/ReadVariableOp_1__465 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_40/FusedBatchNormV3/ReadVariableOp__466 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_40/FusedBatchNormV3/ReadVariableOp_1__467 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1060 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_43/BiasAdd/ReadVariableOp__475 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_41/ReadVariableOp__476 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_41/ReadVariableOp_1__477 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_41/FusedBatchNormV3/ReadVariableOp__478 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_41/FusedBatchNormV3/ReadVariableOp_1__479 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1068 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_44/BiasAdd/ReadVariableOp__485 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_42/ReadVariableOp__486 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_42/ReadVariableOp_1__487 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_42/FusedBatchNormV3/ReadVariableOp__488 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_42/FusedBatchNormV3/ReadVariableOp_1__489 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1076 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_45/BiasAdd/ReadVariableOp__497 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_43/ReadVariableOp__498 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_43/ReadVariableOp_1__499 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_43/FusedBatchNormV3/ReadVariableOp__500 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_43/FusedBatchNormV3/ReadVariableOp_1__501 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1088 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_46/BiasAdd/ReadVariableOp__507 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_44/ReadVariableOp__508 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_44/ReadVariableOp_1__509 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_44/FusedBatchNormV3/ReadVariableOp__510 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_44/FusedBatchNormV3/ReadVariableOp_1__511 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1096 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_47/BiasAdd/ReadVariableOp__519 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_45/ReadVariableOp__520 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_45/ReadVariableOp_1__521 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_45/FusedBatchNormV3/ReadVariableOp__522 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_45/FusedBatchNormV3/ReadVariableOp_1__523 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1108 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_48/BiasAdd/ReadVariableOp__529 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_46/ReadVariableOp__530 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_46/ReadVariableOp_1__531 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_46/FusedBatchNormV3/ReadVariableOp__532 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_46/FusedBatchNormV3/ReadVariableOp_1__533 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1120 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_49/BiasAdd/ReadVariableOp__541 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_47/ReadVariableOp__542 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_47/ReadVariableOp_1__543 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_47/FusedBatchNormV3/ReadVariableOp__544 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_47/FusedBatchNormV3/ReadVariableOp_1__545 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1128 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_50/BiasAdd/ReadVariableOp__551 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_48/ReadVariableOp__552 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_48/ReadVariableOp_1__553 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_48/FusedBatchNormV3/ReadVariableOp__554 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_48/FusedBatchNormV3/ReadVariableOp_1__555 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1136 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_51/BiasAdd/ReadVariableOp__563 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_49/ReadVariableOp__564 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_49/ReadVariableOp_1__565 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_49/FusedBatchNormV3/ReadVariableOp__566 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_49/FusedBatchNormV3/ReadVariableOp_1__567 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1148 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_52/BiasAdd/ReadVariableOp__573 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_50/ReadVariableOp__574 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_50/ReadVariableOp_1__575 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_50/FusedBatchNormV3/ReadVariableOp__576 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_50/FusedBatchNormV3/ReadVariableOp_1__577 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1160 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_53/BiasAdd/ReadVariableOp__585 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_51/ReadVariableOp__586 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_51/ReadVariableOp_1__587 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_51/FusedBatchNormV3/ReadVariableOp__588 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_51/FusedBatchNormV3/ReadVariableOp_1__589 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1168 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_54/BiasAdd/ReadVariableOp__595 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_52/ReadVariableOp__596 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_52/ReadVariableOp_1__597 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_52/FusedBatchNormV3/ReadVariableOp__598 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_52/FusedBatchNormV3/ReadVariableOp_1__599 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1180 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_55/BiasAdd/ReadVariableOp__607 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_53/ReadVariableOp__608 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_53/ReadVariableOp_1__609 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_53/FusedBatchNormV3/ReadVariableOp__610 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_53/FusedBatchNormV3/ReadVariableOp_1__611 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1188 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/conv2d_56/BiasAdd/ReadVariableOp__617 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_54/ReadVariableOp__618 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_54/ReadVariableOp_1__619 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_54/FusedBatchNormV3/ReadVariableOp__620 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/batch_normalization_54/FusedBatchNormV3/ReadVariableOp_1__621 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1196 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: const_axes__2037 [10/12/2021-21:19:59] [10/12/2021-21:19:59] [V] [TRT] Importing initializer: quant_scale__1200 [10/12/2021-21:19:59] [V] [TRT] Importing initializer: StatefulPartitionedCall/model/dense/BiasAdd/ReadVariableOp__629 [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__998 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_36/transpose__400 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__996 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__998 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_36/transpose__400 -> (32, 32, 3, 3)[FLOAT]], [quant_scale__996 -> (32)[FLOAT]], [zero_point__917 -> (32)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_36/transpose__400 for ONNX node: StatefulPartitionedCall/model/conv2d_36/transpose__400 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__998:0 for ONNX tensor: QuantLinearNode__998:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__998 [QuantizeLinear] outputs: [QuantLinearNode__998:0 -> (32, 32, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__986 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_35/transpose__388 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__984 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__986 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_35/transpose__388 -> (32, 32, 3, 3)[FLOAT]], [quant_scale__984 -> (32)[FLOAT]], [zero_point__917 -> (32)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_35/transpose__388 for ONNX node: StatefulPartitionedCall/model/conv2d_35/transpose__388 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__986:0 for ONNX tensor: QuantLinearNode__986:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__986 [QuantizeLinear] outputs: [QuantLinearNode__986:0 -> (32, 32, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__978 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_34/transpose__378 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__976 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__978 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_34/transpose__378 -> (32, 32, 3, 3)[FLOAT]], [quant_scale__976 -> (32)[FLOAT]], [zero_point__917 -> (32)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_34/transpose__378 for ONNX node: StatefulPartitionedCall/model/conv2d_34/transpose__378 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__978:0 for ONNX tensor: QuantLinearNode__978:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__978 [QuantizeLinear] outputs: [QuantLinearNode__978:0 -> (32, 32, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__966 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_33/transpose__366 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__964 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__966 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_33/transpose__366 -> (32, 32, 3, 3)[FLOAT]], [quant_scale__964 -> (32)[FLOAT]], [zero_point__917 -> (32)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_33/transpose__366 for ONNX node: StatefulPartitionedCall/model/conv2d_33/transpose__366 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__966:0 for ONNX tensor: QuantLinearNode__966:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__966 [QuantizeLinear] outputs: [QuantLinearNode__966:0 -> (32, 32, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__958 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_32/transpose__356 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__956 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__958 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_32/transpose__356 -> (32, 32, 3, 3)[FLOAT]], [quant_scale__956 -> (32)[FLOAT]], [zero_point__917 -> (32)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_32/transpose__356 for ONNX node: StatefulPartitionedCall/model/conv2d_32/transpose__356 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__958:0 for ONNX tensor: QuantLinearNode__958:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__958 [QuantizeLinear] outputs: [QuantLinearNode__958:0 -> (32, 32, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__946 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_31/transpose__344 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__944 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__946 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_31/transpose__344 -> (32, 32, 3, 3)[FLOAT]], [quant_scale__944 -> (32)[FLOAT]], [zero_point__917 -> (32)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_31/transpose__344 for ONNX node: StatefulPartitionedCall/model/conv2d_31/transpose__344 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__946:0 for ONNX tensor: QuantLinearNode__946:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__946 [QuantizeLinear] outputs: [QuantLinearNode__946:0 -> (32, 32, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__938 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_30/transpose__334 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__936 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__938 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_30/transpose__334 -> (32, 32, 3, 3)[FLOAT]], [quant_scale__936 -> (32)[FLOAT]], [zero_point__917 -> (32)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_30/transpose__334 for ONNX node: StatefulPartitionedCall/model/conv2d_30/transpose__334 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__938:0 for ONNX tensor: QuantLinearNode__938:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__938 [QuantizeLinear] outputs: [QuantLinearNode__938:0 -> (32, 32, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__926 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_29/transpose__322 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__924 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__926 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_29/transpose__322 -> (32, 32, 3, 3)[FLOAT]], [quant_scale__924 -> (32)[FLOAT]], [zero_point__917 -> (32)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_29/transpose__322 for ONNX node: StatefulPartitionedCall/model/conv2d_29/transpose__322 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__926:0 for ONNX tensor: QuantLinearNode__926:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__926 [QuantizeLinear] outputs: [QuantLinearNode__926:0 -> (32, 32, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__918 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_28/transpose__312 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__916 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__918 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_28/transpose__312 -> (32, 32, 3, 3)[FLOAT]], [quant_scale__916 -> (32)[FLOAT]], [zero_point__917 -> (32)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_28/transpose__312 for ONNX node: StatefulPartitionedCall/model/conv2d_28/transpose__312 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__918:0 for ONNX tensor: QuantLinearNode__918:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__918 [QuantizeLinear] outputs: [QuantLinearNode__918:0 -> (32, 32, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__906 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_27/transpose__300 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__904 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__906 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_27/transpose__300 -> (32, 32, 3, 3)[FLOAT]], [quant_scale__904 -> (32)[FLOAT]], [zero_point__917 -> (32)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_27/transpose__300 for ONNX node: StatefulPartitionedCall/model/conv2d_27/transpose__300 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__906:0 for ONNX tensor: QuantLinearNode__906:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__906 [QuantizeLinear] outputs: [QuantLinearNode__906:0 -> (32, 32, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__898 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_26/transpose__290 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__896 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__898 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_26/transpose__290 -> (32, 32, 3, 3)[FLOAT]], [quant_scale__896 -> (32)[FLOAT]], [zero_point__917 -> (32)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_26/transpose__290 for ONNX node: StatefulPartitionedCall/model/conv2d_26/transpose__290 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__898:0 for ONNX tensor: QuantLinearNode__898:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__898 [QuantizeLinear] outputs: [QuantLinearNode__898:0 -> (32, 32, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__886 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_25/transpose__278 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__884 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__886 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_25/transpose__278 -> (32, 32, 3, 3)[FLOAT]], [quant_scale__884 -> (32)[FLOAT]], [zero_point__917 -> (32)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_25/transpose__278 for ONNX node: StatefulPartitionedCall/model/conv2d_25/transpose__278 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__886:0 for ONNX tensor: QuantLinearNode__886:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__886 [QuantizeLinear] outputs: [QuantLinearNode__886:0 -> (32, 32, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__878 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_24/transpose__268 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__876 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__878 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_24/transpose__268 -> (32, 32, 3, 3)[FLOAT]], [quant_scale__876 -> (32)[FLOAT]], [zero_point__917 -> (32)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_24/transpose__268 for ONNX node: StatefulPartitionedCall/model/conv2d_24/transpose__268 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__878:0 for ONNX tensor: QuantLinearNode__878:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__878 [QuantizeLinear] outputs: [QuantLinearNode__878:0 -> (32, 32, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__866 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_23/transpose__256 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__864 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__866 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_23/transpose__256 -> (32, 32, 3, 3)[FLOAT]], [quant_scale__864 -> (32)[FLOAT]], [zero_point__917 -> (32)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_23/transpose__256 for ONNX node: StatefulPartitionedCall/model/conv2d_23/transpose__256 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__866:0 for ONNX tensor: QuantLinearNode__866:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__866 [QuantizeLinear] outputs: [QuantLinearNode__866:0 -> (32, 32, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__858 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_22/transpose__246 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__856 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__858 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_22/transpose__246 -> (32, 32, 3, 3)[FLOAT]], [quant_scale__856 -> (32)[FLOAT]], [zero_point__917 -> (32)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_22/transpose__246 for ONNX node: StatefulPartitionedCall/model/conv2d_22/transpose__246 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__858:0 for ONNX tensor: QuantLinearNode__858:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__858 [QuantizeLinear] outputs: [QuantLinearNode__858:0 -> (32, 32, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__846 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_20/transpose__234 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__844 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__846 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_20/transpose__234 -> (32, 32, 3, 3)[FLOAT]], [quant_scale__844 -> (32)[FLOAT]], [zero_point__917 -> (32)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_20/transpose__234 for ONNX node: StatefulPartitionedCall/model/conv2d_20/transpose__234 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__846:0 for ONNX tensor: QuantLinearNode__846:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__846 [QuantizeLinear] outputs: [QuantLinearNode__846:0 -> (32, 32, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__838 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_19/transpose__224 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__836 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__838 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_19/transpose__224 -> (32, 16, 3, 3)[FLOAT]], [quant_scale__836 -> (32)[FLOAT]], [zero_point__917 -> (32)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_19/transpose__224 for ONNX node: StatefulPartitionedCall/model/conv2d_19/transpose__224 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__838:0 for ONNX tensor: QuantLinearNode__838:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__838 [QuantizeLinear] outputs: [QuantLinearNode__838:0 -> (32, 16, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__826 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_21/transpose__216 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__824 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__826 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_21/transpose__216 -> (32, 16, 1, 1)[FLOAT]], [quant_scale__824 -> (32)[FLOAT]], [zero_point__917 -> (32)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_21/transpose__216 for ONNX node: StatefulPartitionedCall/model/conv2d_21/transpose__216 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__826:0 for ONNX tensor: QuantLinearNode__826:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__826 [QuantizeLinear] outputs: [QuantLinearNode__826:0 -> (32, 16, 1, 1)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__818 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_18/transpose__206 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__816 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__818 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_18/transpose__206 -> (16, 16, 3, 3)[FLOAT]], [quant_scale__816 -> (16)[FLOAT]], [zero_point__669 -> (16)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_18/transpose__206 for ONNX node: StatefulPartitionedCall/model/conv2d_18/transpose__206 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__818:0 for ONNX tensor: QuantLinearNode__818:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__818 [QuantizeLinear] outputs: [QuantLinearNode__818:0 -> (16, 16, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__810 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_17/transpose__196 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__808 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__810 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_17/transpose__196 -> (16, 16, 3, 3)[FLOAT]], [quant_scale__808 -> (16)[FLOAT]], [zero_point__669 -> (16)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_17/transpose__196 for ONNX node: StatefulPartitionedCall/model/conv2d_17/transpose__196 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__810:0 for ONNX tensor: QuantLinearNode__810:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__810 [QuantizeLinear] outputs: [QuantLinearNode__810:0 -> (16, 16, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__798 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_16/transpose__184 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__796 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__798 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_16/transpose__184 -> (16, 16, 3, 3)[FLOAT]], [quant_scale__796 -> (16)[FLOAT]], [zero_point__669 -> (16)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_16/transpose__184 for ONNX node: StatefulPartitionedCall/model/conv2d_16/transpose__184 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__798:0 for ONNX tensor: QuantLinearNode__798:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__798 [QuantizeLinear] outputs: [QuantLinearNode__798:0 -> (16, 16, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__790 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_15/transpose__174 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__788 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__790 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_15/transpose__174 -> (16, 16, 3, 3)[FLOAT]], [quant_scale__788 -> (16)[FLOAT]], [zero_point__669 -> (16)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_15/transpose__174 for ONNX node: StatefulPartitionedCall/model/conv2d_15/transpose__174 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__790:0 for ONNX tensor: QuantLinearNode__790:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__790 [QuantizeLinear] outputs: [QuantLinearNode__790:0 -> (16, 16, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__778 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_14/transpose__162 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__776 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__778 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_14/transpose__162 -> (16, 16, 3, 3)[FLOAT]], [quant_scale__776 -> (16)[FLOAT]], [zero_point__669 -> (16)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_14/transpose__162 for ONNX node: StatefulPartitionedCall/model/conv2d_14/transpose__162 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__778:0 for ONNX tensor: QuantLinearNode__778:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__778 [QuantizeLinear] outputs: [QuantLinearNode__778:0 -> (16, 16, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__770 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_13/transpose__152 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__768 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__770 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_13/transpose__152 -> (16, 16, 3, 3)[FLOAT]], [quant_scale__768 -> (16)[FLOAT]], [zero_point__669 -> (16)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_13/transpose__152 for ONNX node: StatefulPartitionedCall/model/conv2d_13/transpose__152 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__770:0 for ONNX tensor: QuantLinearNode__770:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__770 [QuantizeLinear] outputs: [QuantLinearNode__770:0 -> (16, 16, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__758 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_12/transpose__140 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__756 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__758 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_12/transpose__140 -> (16, 16, 3, 3)[FLOAT]], [quant_scale__756 -> (16)[FLOAT]], [zero_point__669 -> (16)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_12/transpose__140 for ONNX node: StatefulPartitionedCall/model/conv2d_12/transpose__140 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__758:0 for ONNX tensor: QuantLinearNode__758:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__758 [QuantizeLinear] outputs: [QuantLinearNode__758:0 -> (16, 16, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__750 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_11/transpose__130 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__748 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__750 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_11/transpose__130 -> (16, 16, 3, 3)[FLOAT]], [quant_scale__748 -> (16)[FLOAT]], [zero_point__669 -> (16)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_11/transpose__130 for ONNX node: StatefulPartitionedCall/model/conv2d_11/transpose__130 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__750:0 for ONNX tensor: QuantLinearNode__750:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__750 [QuantizeLinear] outputs: [QuantLinearNode__750:0 -> (16, 16, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__738 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_10/transpose__118 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__736 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__738 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_10/transpose__118 -> (16, 16, 3, 3)[FLOAT]], [quant_scale__736 -> (16)[FLOAT]], [zero_point__669 -> (16)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_10/transpose__118 for ONNX node: StatefulPartitionedCall/model/conv2d_10/transpose__118 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__738:0 for ONNX tensor: QuantLinearNode__738:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__738 [QuantizeLinear] outputs: [QuantLinearNode__738:0 -> (16, 16, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__730 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_9/transpose__108 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__728 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__730 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_9/transpose__108 -> (16, 16, 3, 3)[FLOAT]], [quant_scale__728 -> (16)[FLOAT]], [zero_point__669 -> (16)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_9/transpose__108 for ONNX node: StatefulPartitionedCall/model/conv2d_9/transpose__108 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__730:0 for ONNX tensor: QuantLinearNode__730:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__730 [QuantizeLinear] outputs: [QuantLinearNode__730:0 -> (16, 16, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__718 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_8/transpose__96 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__716 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__718 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_8/transpose__96 -> (16, 16, 3, 3)[FLOAT]], [quant_scale__716 -> (16)[FLOAT]], [zero_point__669 -> (16)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_8/transpose__96 for ONNX node: StatefulPartitionedCall/model/conv2d_8/transpose__96 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__718:0 for ONNX tensor: QuantLinearNode__718:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__718 [QuantizeLinear] outputs: [QuantLinearNode__718:0 -> (16, 16, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__710 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_7/transpose__86 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__708 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__710 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_7/transpose__86 -> (16, 16, 3, 3)[FLOAT]], [quant_scale__708 -> (16)[FLOAT]], [zero_point__669 -> (16)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_7/transpose__86 for ONNX node: StatefulPartitionedCall/model/conv2d_7/transpose__86 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__710:0 for ONNX tensor: QuantLinearNode__710:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__710 [QuantizeLinear] outputs: [QuantLinearNode__710:0 -> (16, 16, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__698 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_6/transpose__74 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__696 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__698 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_6/transpose__74 -> (16, 16, 3, 3)[FLOAT]], [quant_scale__696 -> (16)[FLOAT]], [zero_point__669 -> (16)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_6/transpose__74 for ONNX node: StatefulPartitionedCall/model/conv2d_6/transpose__74 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__698:0 for ONNX tensor: QuantLinearNode__698:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__698 [QuantizeLinear] outputs: [QuantLinearNode__698:0 -> (16, 16, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__690 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_5/transpose__64 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__688 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__690 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_5/transpose__64 -> (16, 16, 3, 3)[FLOAT]], [quant_scale__688 -> (16)[FLOAT]], [zero_point__669 -> (16)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_5/transpose__64 for ONNX node: StatefulPartitionedCall/model/conv2d_5/transpose__64 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__690:0 for ONNX tensor: QuantLinearNode__690:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__690 [QuantizeLinear] outputs: [QuantLinearNode__690:0 -> (16, 16, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__678 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_4/transpose__52 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__676 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__678 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_4/transpose__52 -> (16, 16, 3, 3)[FLOAT]], [quant_scale__676 -> (16)[FLOAT]], [zero_point__669 -> (16)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_4/transpose__52 for ONNX node: StatefulPartitionedCall/model/conv2d_4/transpose__52 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__678:0 for ONNX tensor: QuantLinearNode__678:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__678 [QuantizeLinear] outputs: [QuantLinearNode__678:0 -> (16, 16, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__670 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_3/transpose__42 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__668 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__670 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_3/transpose__42 -> (16, 16, 3, 3)[FLOAT]], [quant_scale__668 -> (16)[FLOAT]], [zero_point__669 -> (16)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_3/transpose__42 for ONNX node: StatefulPartitionedCall/model/conv2d_3/transpose__42 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__670:0 for ONNX tensor: QuantLinearNode__670:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__670 [QuantizeLinear] outputs: [QuantLinearNode__670:0 -> (16, 16, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__658 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_2/transpose__30 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__656 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__658 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_2/transpose__30 -> (16, 16, 3, 3)[FLOAT]], [quant_scale__656 -> (16)[FLOAT]], [zero_point__669 -> (16)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_2/transpose__30 for ONNX node: StatefulPartitionedCall/model/conv2d_2/transpose__30 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__658:0 for ONNX tensor: QuantLinearNode__658:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__658 [QuantizeLinear] outputs: [QuantLinearNode__658:0 -> (16, 16, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__650 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_1/transpose__20 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__648 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__650 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_1/transpose__20 -> (16, 16, 3, 3)[FLOAT]], [quant_scale__648 -> (16)[FLOAT]], [zero_point__669 -> (16)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_1/transpose__20 for ONNX node: StatefulPartitionedCall/model/conv2d_1/transpose__20 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__650:0 for ONNX tensor: QuantLinearNode__650:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__650 [QuantizeLinear] outputs: [QuantLinearNode__650:0 -> (16, 16, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__638 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d/transpose__8 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__636 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__638 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d/transpose__8 -> (16, 3, 3, 3)[FLOAT]], [quant_scale__636 -> (16)[FLOAT]], [zero_point__669 -> (16)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d/transpose__8 for ONNX node: StatefulPartitionedCall/model/conv2d/transpose__8 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__638:0 for ONNX tensor: QuantLinearNode__638:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__638 [QuantizeLinear] outputs: [QuantLinearNode__638:0 -> (16, 3, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__634 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: input_1 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__632 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__634 [QuantizeLinear] inputs: [input_1 -> (1, 3, 32, 32)[FLOAT]], [quant_scale__632 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__634:0 for ONNX tensor: QuantLinearNode__634:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__634 [QuantizeLinear] outputs: [QuantLinearNode__634:0 -> (1, 3, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__1206 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/dense/quantize_and_dequantize_1/ReadVariableOp__626 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1204 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1205 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1206 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/dense/quantize_and_dequantize_1/ReadVariableOp__626 -> (64, 10)[FLOAT]], [quant_scale__1204 -> (10)[FLOAT]], [zero_point__1205 -> (10)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/dense/quantize_and_dequantize_1/ReadVariableOp__626 for ONNX node: StatefulPartitionedCall/model/dense/quantize_and_dequantize_1/ReadVariableOp__626 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__1206:0 for ONNX tensor: QuantLinearNode__1206:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1206 [QuantizeLinear] outputs: [QuantLinearNode__1206:0 -> (64, 10)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__1194 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_56/transpose__614 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1192 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1194 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_56/transpose__614 -> (64, 64, 3, 3)[FLOAT]], [quant_scale__1192 -> (64)[FLOAT]], [zero_point__1033 -> (64)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_56/transpose__614 for ONNX node: StatefulPartitionedCall/model/conv2d_56/transpose__614 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__1194:0 for ONNX tensor: QuantLinearNode__1194:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1194 [QuantizeLinear] outputs: [QuantLinearNode__1194:0 -> (64, 64, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__1186 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_55/transpose__604 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1184 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1186 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_55/transpose__604 -> (64, 64, 3, 3)[FLOAT]], [quant_scale__1184 -> (64)[FLOAT]], [zero_point__1033 -> (64)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_55/transpose__604 for ONNX node: StatefulPartitionedCall/model/conv2d_55/transpose__604 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__1186:0 for ONNX tensor: QuantLinearNode__1186:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1186 [QuantizeLinear] outputs: [QuantLinearNode__1186:0 -> (64, 64, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__1174 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_54/transpose__592 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1172 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1174 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_54/transpose__592 -> (64, 64, 3, 3)[FLOAT]], [quant_scale__1172 -> (64)[FLOAT]], [zero_point__1033 -> (64)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_54/transpose__592 for ONNX node: StatefulPartitionedCall/model/conv2d_54/transpose__592 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__1174:0 for ONNX tensor: QuantLinearNode__1174:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1174 [QuantizeLinear] outputs: [QuantLinearNode__1174:0 -> (64, 64, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__1166 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_53/transpose__582 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1164 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1166 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_53/transpose__582 -> (64, 64, 3, 3)[FLOAT]], [quant_scale__1164 -> (64)[FLOAT]], [zero_point__1033 -> (64)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_53/transpose__582 for ONNX node: StatefulPartitionedCall/model/conv2d_53/transpose__582 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__1166:0 for ONNX tensor: QuantLinearNode__1166:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1166 [QuantizeLinear] outputs: [QuantLinearNode__1166:0 -> (64, 64, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__1154 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_52/transpose__570 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1152 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1154 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_52/transpose__570 -> (64, 64, 3, 3)[FLOAT]], [quant_scale__1152 -> (64)[FLOAT]], [zero_point__1033 -> (64)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_52/transpose__570 for ONNX node: StatefulPartitionedCall/model/conv2d_52/transpose__570 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__1154:0 for ONNX tensor: QuantLinearNode__1154:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1154 [QuantizeLinear] outputs: [QuantLinearNode__1154:0 -> (64, 64, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__1146 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_51/transpose__560 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1144 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1146 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_51/transpose__560 -> (64, 64, 3, 3)[FLOAT]], [quant_scale__1144 -> (64)[FLOAT]], [zero_point__1033 -> (64)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_51/transpose__560 for ONNX node: StatefulPartitionedCall/model/conv2d_51/transpose__560 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__1146:0 for ONNX tensor: QuantLinearNode__1146:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1146 [QuantizeLinear] outputs: [QuantLinearNode__1146:0 -> (64, 64, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__1134 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_50/transpose__548 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1132 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1134 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_50/transpose__548 -> (64, 64, 3, 3)[FLOAT]], [quant_scale__1132 -> (64)[FLOAT]], [zero_point__1033 -> (64)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_50/transpose__548 for ONNX node: StatefulPartitionedCall/model/conv2d_50/transpose__548 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__1134:0 for ONNX tensor: QuantLinearNode__1134:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1134 [QuantizeLinear] outputs: [QuantLinearNode__1134:0 -> (64, 64, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__1126 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_49/transpose__538 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1124 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1126 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_49/transpose__538 -> (64, 64, 3, 3)[FLOAT]], [quant_scale__1124 -> (64)[FLOAT]], [zero_point__1033 -> (64)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_49/transpose__538 for ONNX node: StatefulPartitionedCall/model/conv2d_49/transpose__538 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__1126:0 for ONNX tensor: QuantLinearNode__1126:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1126 [QuantizeLinear] outputs: [QuantLinearNode__1126:0 -> (64, 64, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__1114 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_48/transpose__526 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1112 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1114 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_48/transpose__526 -> (64, 64, 3, 3)[FLOAT]], [quant_scale__1112 -> (64)[FLOAT]], [zero_point__1033 -> (64)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_48/transpose__526 for ONNX node: StatefulPartitionedCall/model/conv2d_48/transpose__526 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__1114:0 for ONNX tensor: QuantLinearNode__1114:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1114 [QuantizeLinear] outputs: [QuantLinearNode__1114:0 -> (64, 64, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__1106 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_47/transpose__516 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1104 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1106 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_47/transpose__516 -> (64, 64, 3, 3)[FLOAT]], [quant_scale__1104 -> (64)[FLOAT]], [zero_point__1033 -> (64)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_47/transpose__516 for ONNX node: StatefulPartitionedCall/model/conv2d_47/transpose__516 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__1106:0 for ONNX tensor: QuantLinearNode__1106:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1106 [QuantizeLinear] outputs: [QuantLinearNode__1106:0 -> (64, 64, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__1094 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_46/transpose__504 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1092 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1094 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_46/transpose__504 -> (64, 64, 3, 3)[FLOAT]], [quant_scale__1092 -> (64)[FLOAT]], [zero_point__1033 -> (64)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_46/transpose__504 for ONNX node: StatefulPartitionedCall/model/conv2d_46/transpose__504 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__1094:0 for ONNX tensor: QuantLinearNode__1094:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1094 [QuantizeLinear] outputs: [QuantLinearNode__1094:0 -> (64, 64, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__1086 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_45/transpose__494 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1084 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1086 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_45/transpose__494 -> (64, 64, 3, 3)[FLOAT]], [quant_scale__1084 -> (64)[FLOAT]], [zero_point__1033 -> (64)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_45/transpose__494 for ONNX node: StatefulPartitionedCall/model/conv2d_45/transpose__494 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__1086:0 for ONNX tensor: QuantLinearNode__1086:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1086 [QuantizeLinear] outputs: [QuantLinearNode__1086:0 -> (64, 64, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__1074 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_44/transpose__482 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1072 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1074 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_44/transpose__482 -> (64, 64, 3, 3)[FLOAT]], [quant_scale__1072 -> (64)[FLOAT]], [zero_point__1033 -> (64)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_44/transpose__482 for ONNX node: StatefulPartitionedCall/model/conv2d_44/transpose__482 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__1074:0 for ONNX tensor: QuantLinearNode__1074:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1074 [QuantizeLinear] outputs: [QuantLinearNode__1074:0 -> (64, 64, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__1066 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_43/transpose__472 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1064 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1066 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_43/transpose__472 -> (64, 64, 3, 3)[FLOAT]], [quant_scale__1064 -> (64)[FLOAT]], [zero_point__1033 -> (64)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_43/transpose__472 for ONNX node: StatefulPartitionedCall/model/conv2d_43/transpose__472 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__1066:0 for ONNX tensor: QuantLinearNode__1066:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1066 [QuantizeLinear] outputs: [QuantLinearNode__1066:0 -> (64, 64, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__1054 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_42/transpose__460 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1052 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1054 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_42/transpose__460 -> (64, 64, 3, 3)[FLOAT]], [quant_scale__1052 -> (64)[FLOAT]], [zero_point__1033 -> (64)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_42/transpose__460 for ONNX node: StatefulPartitionedCall/model/conv2d_42/transpose__460 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__1054:0 for ONNX tensor: QuantLinearNode__1054:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1054 [QuantizeLinear] outputs: [QuantLinearNode__1054:0 -> (64, 64, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__1046 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_41/transpose__450 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1044 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1046 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_41/transpose__450 -> (64, 64, 3, 3)[FLOAT]], [quant_scale__1044 -> (64)[FLOAT]], [zero_point__1033 -> (64)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_41/transpose__450 for ONNX node: StatefulPartitionedCall/model/conv2d_41/transpose__450 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__1046:0 for ONNX tensor: QuantLinearNode__1046:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1046 [QuantizeLinear] outputs: [QuantLinearNode__1046:0 -> (64, 64, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__1034 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_39/transpose__438 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1032 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1034 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_39/transpose__438 -> (64, 64, 3, 3)[FLOAT]], [quant_scale__1032 -> (64)[FLOAT]], [zero_point__1033 -> (64)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_39/transpose__438 for ONNX node: StatefulPartitionedCall/model/conv2d_39/transpose__438 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__1034:0 for ONNX tensor: QuantLinearNode__1034:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1034 [QuantizeLinear] outputs: [QuantLinearNode__1034:0 -> (64, 64, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__1026 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_38/transpose__428 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1024 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1026 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_38/transpose__428 -> (64, 32, 3, 3)[FLOAT]], [quant_scale__1024 -> (64)[FLOAT]], [zero_point__1033 -> (64)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_38/transpose__428 for ONNX node: StatefulPartitionedCall/model/conv2d_38/transpose__428 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__1026:0 for ONNX tensor: QuantLinearNode__1026:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1026 [QuantizeLinear] outputs: [QuantLinearNode__1026:0 -> (64, 32, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__1014 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_40/transpose__420 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1012 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1014 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_40/transpose__420 -> (64, 32, 1, 1)[FLOAT]], [quant_scale__1012 -> (64)[FLOAT]], [zero_point__1033 -> (64)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_40/transpose__420 for ONNX node: StatefulPartitionedCall/model/conv2d_40/transpose__420 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__1014:0 for ONNX tensor: QuantLinearNode__1014:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1014 [QuantizeLinear] outputs: [QuantLinearNode__1014:0 -> (64, 32, 1, 1)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__1006 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_37/transpose__410 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1004 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1006 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_37/transpose__410 -> (32, 32, 3, 3)[FLOAT]], [quant_scale__1004 -> (32)[FLOAT]], [zero_point__917 -> (32)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_37/transpose__410 for ONNX node: StatefulPartitionedCall/model/conv2d_37/transpose__410 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__1006:0 for ONNX tensor: QuantLinearNode__1006:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__1006 [QuantizeLinear] outputs: [QuantLinearNode__1006:0 -> (32, 32, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__999 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__998:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__996 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__999 [DequantizeLinear] inputs: [QuantLinearNode__998:0 -> (32, 32, 3, 3)[FLOAT]], [quant_scale__996 -> (32)[FLOAT]], [zero_point__917 -> (32)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_36/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_36/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__999 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_36/quantize_and_dequantize_1:0 -> (32, 32, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__987 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__986:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__984 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__987 [DequantizeLinear] inputs: [QuantLinearNode__986:0 -> (32, 32, 3, 3)[FLOAT]], [quant_scale__984 -> (32)[FLOAT]], [zero_point__917 -> (32)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_35/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_35/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__987 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_35/quantize_and_dequantize_1:0 -> (32, 32, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__979 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__978:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__976 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__979 [DequantizeLinear] inputs: [QuantLinearNode__978:0 -> (32, 32, 3, 3)[FLOAT]], [quant_scale__976 -> (32)[FLOAT]], [zero_point__917 -> (32)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_34/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_34/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__979 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_34/quantize_and_dequantize_1:0 -> (32, 32, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__967 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__966:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__964 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__967 [DequantizeLinear] inputs: [QuantLinearNode__966:0 -> (32, 32, 3, 3)[FLOAT]], [quant_scale__964 -> (32)[FLOAT]], [zero_point__917 -> (32)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_33/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_33/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__967 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_33/quantize_and_dequantize_1:0 -> (32, 32, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__959 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__958:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__956 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__959 [DequantizeLinear] inputs: [QuantLinearNode__958:0 -> (32, 32, 3, 3)[FLOAT]], [quant_scale__956 -> (32)[FLOAT]], [zero_point__917 -> (32)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_32/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_32/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__959 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_32/quantize_and_dequantize_1:0 -> (32, 32, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__947 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__946:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__944 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__947 [DequantizeLinear] inputs: [QuantLinearNode__946:0 -> (32, 32, 3, 3)[FLOAT]], [quant_scale__944 -> (32)[FLOAT]], [zero_point__917 -> (32)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_31/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_31/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__947 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_31/quantize_and_dequantize_1:0 -> (32, 32, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__939 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__938:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__936 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__939 [DequantizeLinear] inputs: [QuantLinearNode__938:0 -> (32, 32, 3, 3)[FLOAT]], [quant_scale__936 -> (32)[FLOAT]], [zero_point__917 -> (32)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_30/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_30/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__939 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_30/quantize_and_dequantize_1:0 -> (32, 32, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__927 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__926:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__924 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__927 [DequantizeLinear] inputs: [QuantLinearNode__926:0 -> (32, 32, 3, 3)[FLOAT]], [quant_scale__924 -> (32)[FLOAT]], [zero_point__917 -> (32)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_29/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_29/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__927 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_29/quantize_and_dequantize_1:0 -> (32, 32, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__919 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__918:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__916 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__919 [DequantizeLinear] inputs: [QuantLinearNode__918:0 -> (32, 32, 3, 3)[FLOAT]], [quant_scale__916 -> (32)[FLOAT]], [zero_point__917 -> (32)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_28/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_28/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__919 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_28/quantize_and_dequantize_1:0 -> (32, 32, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__907 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__906:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__904 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__907 [DequantizeLinear] inputs: [QuantLinearNode__906:0 -> (32, 32, 3, 3)[FLOAT]], [quant_scale__904 -> (32)[FLOAT]], [zero_point__917 -> (32)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_27/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_27/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__907 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_27/quantize_and_dequantize_1:0 -> (32, 32, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__899 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__898:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__896 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__899 [DequantizeLinear] inputs: [QuantLinearNode__898:0 -> (32, 32, 3, 3)[FLOAT]], [quant_scale__896 -> (32)[FLOAT]], [zero_point__917 -> (32)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_26/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_26/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__899 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_26/quantize_and_dequantize_1:0 -> (32, 32, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__887 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__886:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__884 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__887 [DequantizeLinear] inputs: [QuantLinearNode__886:0 -> (32, 32, 3, 3)[FLOAT]], [quant_scale__884 -> (32)[FLOAT]], [zero_point__917 -> (32)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_25/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_25/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__887 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_25/quantize_and_dequantize_1:0 -> (32, 32, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__879 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__878:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__876 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__879 [DequantizeLinear] inputs: [QuantLinearNode__878:0 -> (32, 32, 3, 3)[FLOAT]], [quant_scale__876 -> (32)[FLOAT]], [zero_point__917 -> (32)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_24/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_24/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__879 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_24/quantize_and_dequantize_1:0 -> (32, 32, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__867 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__866:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__864 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__867 [DequantizeLinear] inputs: [QuantLinearNode__866:0 -> (32, 32, 3, 3)[FLOAT]], [quant_scale__864 -> (32)[FLOAT]], [zero_point__917 -> (32)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_23/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_23/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__867 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_23/quantize_and_dequantize_1:0 -> (32, 32, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__859 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__858:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__856 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__859 [DequantizeLinear] inputs: [QuantLinearNode__858:0 -> (32, 32, 3, 3)[FLOAT]], [quant_scale__856 -> (32)[FLOAT]], [zero_point__917 -> (32)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_22/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_22/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__859 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_22/quantize_and_dequantize_1:0 -> (32, 32, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__847 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__846:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__844 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__847 [DequantizeLinear] inputs: [QuantLinearNode__846:0 -> (32, 32, 3, 3)[FLOAT]], [quant_scale__844 -> (32)[FLOAT]], [zero_point__917 -> (32)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_20/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_20/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__847 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_20/quantize_and_dequantize_1:0 -> (32, 32, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__839 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__838:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__836 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__839 [DequantizeLinear] inputs: [QuantLinearNode__838:0 -> (32, 16, 3, 3)[FLOAT]], [quant_scale__836 -> (32)[FLOAT]], [zero_point__917 -> (32)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_19/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_19/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__839 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_19/quantize_and_dequantize_1:0 -> (32, 16, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__827 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__826:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__824 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__827 [DequantizeLinear] inputs: [QuantLinearNode__826:0 -> (32, 16, 1, 1)[FLOAT]], [quant_scale__824 -> (32)[FLOAT]], [zero_point__917 -> (32)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_21/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_21/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__827 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_21/quantize_and_dequantize_1:0 -> (32, 16, 1, 1)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__819 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__818:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__816 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__819 [DequantizeLinear] inputs: [QuantLinearNode__818:0 -> (16, 16, 3, 3)[FLOAT]], [quant_scale__816 -> (16)[FLOAT]], [zero_point__669 -> (16)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_18/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_18/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__819 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_18/quantize_and_dequantize_1:0 -> (16, 16, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__811 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__810:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__808 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__811 [DequantizeLinear] inputs: [QuantLinearNode__810:0 -> (16, 16, 3, 3)[FLOAT]], [quant_scale__808 -> (16)[FLOAT]], [zero_point__669 -> (16)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_17/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_17/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__811 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_17/quantize_and_dequantize_1:0 -> (16, 16, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__799 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__798:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__796 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__799 [DequantizeLinear] inputs: [QuantLinearNode__798:0 -> (16, 16, 3, 3)[FLOAT]], [quant_scale__796 -> (16)[FLOAT]], [zero_point__669 -> (16)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_16/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_16/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__799 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_16/quantize_and_dequantize_1:0 -> (16, 16, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__791 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__790:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__788 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__791 [DequantizeLinear] inputs: [QuantLinearNode__790:0 -> (16, 16, 3, 3)[FLOAT]], [quant_scale__788 -> (16)[FLOAT]], [zero_point__669 -> (16)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_15/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_15/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__791 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_15/quantize_and_dequantize_1:0 -> (16, 16, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__779 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__778:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__776 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__779 [DequantizeLinear] inputs: [QuantLinearNode__778:0 -> (16, 16, 3, 3)[FLOAT]], [quant_scale__776 -> (16)[FLOAT]], [zero_point__669 -> (16)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_14/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_14/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__779 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_14/quantize_and_dequantize_1:0 -> (16, 16, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__771 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__770:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__768 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__771 [DequantizeLinear] inputs: [QuantLinearNode__770:0 -> (16, 16, 3, 3)[FLOAT]], [quant_scale__768 -> (16)[FLOAT]], [zero_point__669 -> (16)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_13/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_13/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__771 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_13/quantize_and_dequantize_1:0 -> (16, 16, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__759 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__758:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__756 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__759 [DequantizeLinear] inputs: [QuantLinearNode__758:0 -> (16, 16, 3, 3)[FLOAT]], [quant_scale__756 -> (16)[FLOAT]], [zero_point__669 -> (16)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_12/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_12/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__759 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_12/quantize_and_dequantize_1:0 -> (16, 16, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__751 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__750:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__748 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__751 [DequantizeLinear] inputs: [QuantLinearNode__750:0 -> (16, 16, 3, 3)[FLOAT]], [quant_scale__748 -> (16)[FLOAT]], [zero_point__669 -> (16)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_11/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_11/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__751 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_11/quantize_and_dequantize_1:0 -> (16, 16, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__739 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__738:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__736 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__739 [DequantizeLinear] inputs: [QuantLinearNode__738:0 -> (16, 16, 3, 3)[FLOAT]], [quant_scale__736 -> (16)[FLOAT]], [zero_point__669 -> (16)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_10/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_10/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__739 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_10/quantize_and_dequantize_1:0 -> (16, 16, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__731 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__730:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__728 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__731 [DequantizeLinear] inputs: [QuantLinearNode__730:0 -> (16, 16, 3, 3)[FLOAT]], [quant_scale__728 -> (16)[FLOAT]], [zero_point__669 -> (16)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_9/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_9/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__731 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_9/quantize_and_dequantize_1:0 -> (16, 16, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__719 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__718:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__716 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__719 [DequantizeLinear] inputs: [QuantLinearNode__718:0 -> (16, 16, 3, 3)[FLOAT]], [quant_scale__716 -> (16)[FLOAT]], [zero_point__669 -> (16)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_8/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_8/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__719 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_8/quantize_and_dequantize_1:0 -> (16, 16, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__711 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__710:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__708 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__711 [DequantizeLinear] inputs: [QuantLinearNode__710:0 -> (16, 16, 3, 3)[FLOAT]], [quant_scale__708 -> (16)[FLOAT]], [zero_point__669 -> (16)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_7/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_7/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__711 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_7/quantize_and_dequantize_1:0 -> (16, 16, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__699 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__698:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__696 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__699 [DequantizeLinear] inputs: [QuantLinearNode__698:0 -> (16, 16, 3, 3)[FLOAT]], [quant_scale__696 -> (16)[FLOAT]], [zero_point__669 -> (16)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_6/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_6/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__699 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_6/quantize_and_dequantize_1:0 -> (16, 16, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__691 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__690:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__688 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__691 [DequantizeLinear] inputs: [QuantLinearNode__690:0 -> (16, 16, 3, 3)[FLOAT]], [quant_scale__688 -> (16)[FLOAT]], [zero_point__669 -> (16)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_5/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_5/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__691 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_5/quantize_and_dequantize_1:0 -> (16, 16, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__679 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__678:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__676 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__679 [DequantizeLinear] inputs: [QuantLinearNode__678:0 -> (16, 16, 3, 3)[FLOAT]], [quant_scale__676 -> (16)[FLOAT]], [zero_point__669 -> (16)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_4/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_4/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__679 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_4/quantize_and_dequantize_1:0 -> (16, 16, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__671 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__670:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__668 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__671 [DequantizeLinear] inputs: [QuantLinearNode__670:0 -> (16, 16, 3, 3)[FLOAT]], [quant_scale__668 -> (16)[FLOAT]], [zero_point__669 -> (16)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_3/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_3/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__671 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_3/quantize_and_dequantize_1:0 -> (16, 16, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__659 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__658:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__656 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__659 [DequantizeLinear] inputs: [QuantLinearNode__658:0 -> (16, 16, 3, 3)[FLOAT]], [quant_scale__656 -> (16)[FLOAT]], [zero_point__669 -> (16)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_2/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_2/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__659 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_2/quantize_and_dequantize_1:0 -> (16, 16, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__651 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__650:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__648 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__651 [DequantizeLinear] inputs: [QuantLinearNode__650:0 -> (16, 16, 3, 3)[FLOAT]], [quant_scale__648 -> (16)[FLOAT]], [zero_point__669 -> (16)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_1/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_1/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__651 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_1/quantize_and_dequantize_1:0 -> (16, 16, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__639 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__638:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__636 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__669 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__639 [DequantizeLinear] inputs: [QuantLinearNode__638:0 -> (16, 3, 3, 3)[FLOAT]], [quant_scale__636 -> (16)[FLOAT]], [zero_point__669 -> (16)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__639 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d/quantize_and_dequantize_1:0 -> (16, 3, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__635 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__634:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__632 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__635 [DequantizeLinear] inputs: [QuantLinearNode__634:0 -> (1, 3, 32, 32)[FLOAT]], [quant_scale__632 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d/quantize_and_dequantize:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__635 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d/quantize_and_dequantize:0 -> (1, 3, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__1207 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__1206:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1204 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1205 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1207 [DequantizeLinear] inputs: [QuantLinearNode__1206:0 -> (64, 10)[FLOAT]], [quant_scale__1204 -> (10)[FLOAT]], [zero_point__1205 -> (10)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/dense/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/dense/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1207 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/dense/quantize_and_dequantize_1:0 -> (64, 10)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__1195 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__1194:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1192 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1195 [DequantizeLinear] inputs: [QuantLinearNode__1194:0 -> (64, 64, 3, 3)[FLOAT]], [quant_scale__1192 -> (64)[FLOAT]], [zero_point__1033 -> (64)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_56/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_56/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1195 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_56/quantize_and_dequantize_1:0 -> (64, 64, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__1187 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__1186:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1184 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1187 [DequantizeLinear] inputs: [QuantLinearNode__1186:0 -> (64, 64, 3, 3)[FLOAT]], [quant_scale__1184 -> (64)[FLOAT]], [zero_point__1033 -> (64)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_55/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_55/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1187 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_55/quantize_and_dequantize_1:0 -> (64, 64, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__1175 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__1174:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1172 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1175 [DequantizeLinear] inputs: [QuantLinearNode__1174:0 -> (64, 64, 3, 3)[FLOAT]], [quant_scale__1172 -> (64)[FLOAT]], [zero_point__1033 -> (64)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_54/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_54/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1175 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_54/quantize_and_dequantize_1:0 -> (64, 64, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__1167 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__1166:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1164 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1167 [DequantizeLinear] inputs: [QuantLinearNode__1166:0 -> (64, 64, 3, 3)[FLOAT]], [quant_scale__1164 -> (64)[FLOAT]], [zero_point__1033 -> (64)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_53/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_53/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1167 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_53/quantize_and_dequantize_1:0 -> (64, 64, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__1155 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__1154:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1152 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1155 [DequantizeLinear] inputs: [QuantLinearNode__1154:0 -> (64, 64, 3, 3)[FLOAT]], [quant_scale__1152 -> (64)[FLOAT]], [zero_point__1033 -> (64)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_52/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_52/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1155 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_52/quantize_and_dequantize_1:0 -> (64, 64, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__1147 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__1146:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1144 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1147 [DequantizeLinear] inputs: [QuantLinearNode__1146:0 -> (64, 64, 3, 3)[FLOAT]], [quant_scale__1144 -> (64)[FLOAT]], [zero_point__1033 -> (64)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_51/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_51/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1147 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_51/quantize_and_dequantize_1:0 -> (64, 64, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__1135 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__1134:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1132 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1135 [DequantizeLinear] inputs: [QuantLinearNode__1134:0 -> (64, 64, 3, 3)[FLOAT]], [quant_scale__1132 -> (64)[FLOAT]], [zero_point__1033 -> (64)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_50/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_50/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1135 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_50/quantize_and_dequantize_1:0 -> (64, 64, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__1127 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__1126:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1124 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1127 [DequantizeLinear] inputs: [QuantLinearNode__1126:0 -> (64, 64, 3, 3)[FLOAT]], [quant_scale__1124 -> (64)[FLOAT]], [zero_point__1033 -> (64)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_49/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_49/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1127 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_49/quantize_and_dequantize_1:0 -> (64, 64, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__1115 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__1114:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1112 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1115 [DequantizeLinear] inputs: [QuantLinearNode__1114:0 -> (64, 64, 3, 3)[FLOAT]], [quant_scale__1112 -> (64)[FLOAT]], [zero_point__1033 -> (64)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_48/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_48/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1115 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_48/quantize_and_dequantize_1:0 -> (64, 64, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__1107 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__1106:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1104 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1107 [DequantizeLinear] inputs: [QuantLinearNode__1106:0 -> (64, 64, 3, 3)[FLOAT]], [quant_scale__1104 -> (64)[FLOAT]], [zero_point__1033 -> (64)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_47/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_47/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1107 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_47/quantize_and_dequantize_1:0 -> (64, 64, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__1095 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__1094:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1092 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1095 [DequantizeLinear] inputs: [QuantLinearNode__1094:0 -> (64, 64, 3, 3)[FLOAT]], [quant_scale__1092 -> (64)[FLOAT]], [zero_point__1033 -> (64)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_46/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_46/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1095 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_46/quantize_and_dequantize_1:0 -> (64, 64, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__1087 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__1086:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1084 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1087 [DequantizeLinear] inputs: [QuantLinearNode__1086:0 -> (64, 64, 3, 3)[FLOAT]], [quant_scale__1084 -> (64)[FLOAT]], [zero_point__1033 -> (64)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_45/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_45/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1087 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_45/quantize_and_dequantize_1:0 -> (64, 64, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__1075 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__1074:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1072 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1075 [DequantizeLinear] inputs: [QuantLinearNode__1074:0 -> (64, 64, 3, 3)[FLOAT]], [quant_scale__1072 -> (64)[FLOAT]], [zero_point__1033 -> (64)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_44/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_44/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1075 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_44/quantize_and_dequantize_1:0 -> (64, 64, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__1067 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__1066:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1064 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1067 [DequantizeLinear] inputs: [QuantLinearNode__1066:0 -> (64, 64, 3, 3)[FLOAT]], [quant_scale__1064 -> (64)[FLOAT]], [zero_point__1033 -> (64)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_43/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_43/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1067 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_43/quantize_and_dequantize_1:0 -> (64, 64, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__1055 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__1054:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1052 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1055 [DequantizeLinear] inputs: [QuantLinearNode__1054:0 -> (64, 64, 3, 3)[FLOAT]], [quant_scale__1052 -> (64)[FLOAT]], [zero_point__1033 -> (64)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_42/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_42/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1055 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_42/quantize_and_dequantize_1:0 -> (64, 64, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__1047 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__1046:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1044 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1047 [DequantizeLinear] inputs: [QuantLinearNode__1046:0 -> (64, 64, 3, 3)[FLOAT]], [quant_scale__1044 -> (64)[FLOAT]], [zero_point__1033 -> (64)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_41/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_41/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1047 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_41/quantize_and_dequantize_1:0 -> (64, 64, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__1035 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__1034:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1032 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1035 [DequantizeLinear] inputs: [QuantLinearNode__1034:0 -> (64, 64, 3, 3)[FLOAT]], [quant_scale__1032 -> (64)[FLOAT]], [zero_point__1033 -> (64)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_39/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_39/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1035 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_39/quantize_and_dequantize_1:0 -> (64, 64, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__1027 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__1026:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1024 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1027 [DequantizeLinear] inputs: [QuantLinearNode__1026:0 -> (64, 32, 3, 3)[FLOAT]], [quant_scale__1024 -> (64)[FLOAT]], [zero_point__1033 -> (64)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_38/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_38/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1027 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_38/quantize_and_dequantize_1:0 -> (64, 32, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__1015 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__1014:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1012 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__1033 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1015 [DequantizeLinear] inputs: [QuantLinearNode__1014:0 -> (64, 32, 1, 1)[FLOAT]], [quant_scale__1012 -> (64)[FLOAT]], [zero_point__1033 -> (64)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_40/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_40/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1015 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_40/quantize_and_dequantize_1:0 -> (64, 32, 1, 1)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__1007 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__1006:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__1004 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__917 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1007 [DequantizeLinear] inputs: [QuantLinearNode__1006:0 -> (32, 32, 3, 3)[FLOAT]], [quant_scale__1004 -> (32)[FLOAT]], [zero_point__917 -> (32)[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_37/quantize_and_dequantize_1:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_37/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__1007 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_37/quantize_and_dequantize_1:0 -> (32, 32, 3, 3)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d/BiasAdd [Conv] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d/quantize_and_dequantize:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d/BiasAdd/ReadVariableOp__11 [10/12/2021-21:19:59] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d/quantize_and_dequantize:0 -> (1, 3, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/conv2d/quantize_and_dequantize_1:0 -> (16, 3, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d/BiasAdd/ReadVariableOp__11 -> (16)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Convolution input dimensions: (1, 3, 32, 32) [10/12/2021-21:19:59] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d/BiasAdd [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d/BiasAdd:0 [10/12/2021-21:19:59] [V] [TRT] StatefulPartitionedCall/model/conv2d/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d/BiasAdd:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d/BiasAdd:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization/ReadVariableOp__12 [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization/ReadVariableOp_1__13 [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization/FusedBatchNormV3/ReadVariableOp__14 [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization/FusedBatchNormV3/ReadVariableOp_1__15 [10/12/2021-21:19:59] [V] [TRT] StatefulPartitionedCall/model/batch_normalization/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d/BiasAdd:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization/ReadVariableOp__12 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization/ReadVariableOp_1__13 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization/FusedBatchNormV3/ReadVariableOp__14 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization/FusedBatchNormV3/ReadVariableOp_1__15 -> (16)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization/FusedBatchNormV3 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization/FusedBatchNormV3:0 [10/12/2021-21:19:59] [V] [TRT] StatefulPartitionedCall/model/batch_normalization/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization/FusedBatchNormV3:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation/Relu [Relu] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization/FusedBatchNormV3:0 [10/12/2021-21:19:59] [V] [TRT] StatefulPartitionedCall/model/activation/Relu [Relu] inputs: [StatefulPartitionedCall/model/batch_normalization/FusedBatchNormV3:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation/Relu for ONNX node: StatefulPartitionedCall/model/activation/Relu [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation/Relu:0 [10/12/2021-21:19:59] [V] [TRT] StatefulPartitionedCall/model/activation/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__646 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation/Relu:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__644 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__646 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__644 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__646:0 for ONNX tensor: QuantLinearNode__646:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__646 [QuantizeLinear] outputs: [QuantLinearNode__646:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__642 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation/Relu:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__644 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__642 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__644 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__642:0 for ONNX tensor: QuantLinearNode__642:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__642 [QuantizeLinear] outputs: [QuantLinearNode__642:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__647 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__646:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__644 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__647 [DequantizeLinear] inputs: [QuantLinearNode__646:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__644 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_1/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_1/quantize_and_dequantize:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__647 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_1/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__643 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__642:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__644 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__643 [DequantizeLinear] inputs: [QuantLinearNode__642:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__644 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/identity/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/identity/quantize_and_dequantize:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__643 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/identity/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_1/BiasAdd [Conv] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_1/quantize_and_dequantize:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_1/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_1/BiasAdd/ReadVariableOp__23 [10/12/2021-21:19:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_1/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/conv2d_1/quantize_and_dequantize_1:0 -> (16, 16, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_1/BiasAdd/ReadVariableOp__23 -> (16)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Convolution input dimensions: (1, 16, 32, 32) [10/12/2021-21:19:59] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_1/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_1/BiasAdd [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_1/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_1/BiasAdd:0 [10/12/2021-21:19:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_1/BiasAdd:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_1/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_1/BiasAdd:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_1/ReadVariableOp__24 [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_1/ReadVariableOp_1__25 [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_1/FusedBatchNormV3/ReadVariableOp__26 [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_1/FusedBatchNormV3/ReadVariableOp_1__27 [10/12/2021-21:19:59] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_1/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_1/BiasAdd:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_1/ReadVariableOp__24 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_1/ReadVariableOp_1__25 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_1/FusedBatchNormV3/ReadVariableOp__26 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_1/FusedBatchNormV3/ReadVariableOp_1__27 -> (16)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_1/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_1/FusedBatchNormV3 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_1/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_1/FusedBatchNormV3:0 [10/12/2021-21:19:59] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_1/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_1/FusedBatchNormV3:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_1/Relu [Relu] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_1/FusedBatchNormV3:0 [10/12/2021-21:19:59] [V] [TRT] StatefulPartitionedCall/model/activation_1/Relu [Relu] inputs: [StatefulPartitionedCall/model/batch_normalization_1/FusedBatchNormV3:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_1/Relu for ONNX node: StatefulPartitionedCall/model/activation_1/Relu [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_1/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_1/Relu:0 [10/12/2021-21:19:59] [V] [TRT] StatefulPartitionedCall/model/activation_1/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_1/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__654 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_1/Relu:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__652 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__654 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_1/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__652 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__654:0 for ONNX tensor: QuantLinearNode__654:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__654 [QuantizeLinear] outputs: [QuantLinearNode__654:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__655 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__654:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__652 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__655 [DequantizeLinear] inputs: [QuantLinearNode__654:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__652 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_2/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_2/quantize_and_dequantize:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__655 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_2/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_2/BiasAdd [Conv] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_2/quantize_and_dequantize:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_2/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_2/BiasAdd/ReadVariableOp__33 [10/12/2021-21:19:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_2/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/conv2d_2/quantize_and_dequantize_1:0 -> (16, 16, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_2/BiasAdd/ReadVariableOp__33 -> (16)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Convolution input dimensions: (1, 16, 32, 32) [10/12/2021-21:19:59] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_2/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_2/BiasAdd [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_2/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_2/BiasAdd:0 [10/12/2021-21:19:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_2/BiasAdd:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_2/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_2/BiasAdd:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_2/ReadVariableOp__34 [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_2/ReadVariableOp_1__35 [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_2/FusedBatchNormV3/ReadVariableOp__36 [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_2/FusedBatchNormV3/ReadVariableOp_1__37 [10/12/2021-21:19:59] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_2/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_2/BiasAdd:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_2/ReadVariableOp__34 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_2/ReadVariableOp_1__35 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_2/FusedBatchNormV3/ReadVariableOp__36 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_2/FusedBatchNormV3/ReadVariableOp_1__37 -> (16)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_2/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_2/FusedBatchNormV3 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_2/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_2/FusedBatchNormV3:0 [10/12/2021-21:19:59] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_2/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_2/FusedBatchNormV3:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: StatefulPartitionedCall/model/add/add [Add] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/identity/quantize_and_dequantize:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_2/FusedBatchNormV3:0 [10/12/2021-21:19:59] [V] [TRT] StatefulPartitionedCall/model/add/add [Add] inputs: [StatefulPartitionedCall/model/identity/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_2/FusedBatchNormV3:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/add/add for ONNX node: StatefulPartitionedCall/model/add/add [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/add/add:0 for ONNX tensor: StatefulPartitionedCall/model/add/add:0 [10/12/2021-21:19:59] [V] [TRT] StatefulPartitionedCall/model/add/add [Add] outputs: [StatefulPartitionedCall/model/add/add:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_2/Relu [Relu] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/add/add:0 [10/12/2021-21:19:59] [V] [TRT] StatefulPartitionedCall/model/activation_2/Relu [Relu] inputs: [StatefulPartitionedCall/model/add/add:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_2/Relu for ONNX node: StatefulPartitionedCall/model/activation_2/Relu [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_2/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_2/Relu:0 [10/12/2021-21:19:59] [V] [TRT] StatefulPartitionedCall/model/activation_2/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_2/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__666 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_2/Relu:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__660 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__666 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_2/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__660 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__666:0 for ONNX tensor: QuantLinearNode__666:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__666 [QuantizeLinear] outputs: [QuantLinearNode__666:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__662 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_2/Relu:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__660 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__662 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_2/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__660 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__662:0 for ONNX tensor: QuantLinearNode__662:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__662 [QuantizeLinear] outputs: [QuantLinearNode__662:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__667 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__666:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__660 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__667 [DequantizeLinear] inputs: [QuantLinearNode__666:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__660 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_3/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_3/quantize_and_dequantize:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__667 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_3/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__663 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__662:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__660 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__663 [DequantizeLinear] inputs: [QuantLinearNode__662:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__660 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/identity_1/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/identity_1/quantize_and_dequantize:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__663 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/identity_1/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_3/BiasAdd [Conv] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_3/quantize_and_dequantize:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_3/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_3/BiasAdd/ReadVariableOp__45 [10/12/2021-21:19:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_3/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/conv2d_3/quantize_and_dequantize_1:0 -> (16, 16, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_3/BiasAdd/ReadVariableOp__45 -> (16)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Convolution input dimensions: (1, 16, 32, 32) [10/12/2021-21:19:59] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_3/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_3/BiasAdd [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_3/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_3/BiasAdd:0 [10/12/2021-21:19:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_3/BiasAdd:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_3/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_3/BiasAdd:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_3/ReadVariableOp__46 [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_3/ReadVariableOp_1__47 [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_3/FusedBatchNormV3/ReadVariableOp__48 [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_3/FusedBatchNormV3/ReadVariableOp_1__49 [10/12/2021-21:19:59] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_3/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_3/BiasAdd:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_3/ReadVariableOp__46 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_3/ReadVariableOp_1__47 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_3/FusedBatchNormV3/ReadVariableOp__48 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_3/FusedBatchNormV3/ReadVariableOp_1__49 -> (16)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_3/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_3/FusedBatchNormV3 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_3/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_3/FusedBatchNormV3:0 [10/12/2021-21:19:59] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_3/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_3/FusedBatchNormV3:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_3/Relu [Relu] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_3/FusedBatchNormV3:0 [10/12/2021-21:19:59] [V] [TRT] StatefulPartitionedCall/model/activation_3/Relu [Relu] inputs: [StatefulPartitionedCall/model/batch_normalization_3/FusedBatchNormV3:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_3/Relu for ONNX node: StatefulPartitionedCall/model/activation_3/Relu [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_3/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_3/Relu:0 [10/12/2021-21:19:59] [V] [TRT] StatefulPartitionedCall/model/activation_3/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_3/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__674 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_3/Relu:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__672 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__674 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_3/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__672 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__674:0 for ONNX tensor: QuantLinearNode__674:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__674 [QuantizeLinear] outputs: [QuantLinearNode__674:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__675 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__674:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__672 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__675 [DequantizeLinear] inputs: [QuantLinearNode__674:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__672 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_4/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_4/quantize_and_dequantize:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__675 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_4/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_4/BiasAdd [Conv] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_4/quantize_and_dequantize:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_4/quantize_and_dequantize_1:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_4/BiasAdd/ReadVariableOp__55 [10/12/2021-21:19:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_4/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/conv2d_4/quantize_and_dequantize_1:0 -> (16, 16, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_4/BiasAdd/ReadVariableOp__55 -> (16)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Convolution input dimensions: (1, 16, 32, 32) [10/12/2021-21:19:59] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_4/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_4/BiasAdd [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_4/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_4/BiasAdd:0 [10/12/2021-21:19:59] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_4/BiasAdd:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_4/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_4/BiasAdd:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_4/ReadVariableOp__56 [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_4/ReadVariableOp_1__57 [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_4/FusedBatchNormV3/ReadVariableOp__58 [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_4/FusedBatchNormV3/ReadVariableOp_1__59 [10/12/2021-21:19:59] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_4/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_4/BiasAdd:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_4/ReadVariableOp__56 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_4/ReadVariableOp_1__57 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_4/FusedBatchNormV3/ReadVariableOp__58 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_4/FusedBatchNormV3/ReadVariableOp_1__59 -> (16)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_4/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_4/FusedBatchNormV3 [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_4/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_4/FusedBatchNormV3:0 [10/12/2021-21:19:59] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_4/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_4/FusedBatchNormV3:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: StatefulPartitionedCall/model/add_1/add [Add] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/identity_1/quantize_and_dequantize:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_4/FusedBatchNormV3:0 [10/12/2021-21:19:59] [V] [TRT] StatefulPartitionedCall/model/add_1/add [Add] inputs: [StatefulPartitionedCall/model/identity_1/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_4/FusedBatchNormV3:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/add_1/add for ONNX node: StatefulPartitionedCall/model/add_1/add [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/add_1/add:0 for ONNX tensor: StatefulPartitionedCall/model/add_1/add:0 [10/12/2021-21:19:59] [V] [TRT] StatefulPartitionedCall/model/add_1/add [Add] outputs: [StatefulPartitionedCall/model/add_1/add:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_4/Relu [Relu] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/add_1/add:0 [10/12/2021-21:19:59] [V] [TRT] StatefulPartitionedCall/model/activation_4/Relu [Relu] inputs: [StatefulPartitionedCall/model/add_1/add:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_4/Relu for ONNX node: StatefulPartitionedCall/model/activation_4/Relu [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_4/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_4/Relu:0 [10/12/2021-21:19:59] [V] [TRT] StatefulPartitionedCall/model/activation_4/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_4/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__686 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_4/Relu:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__684 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__686 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_4/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__684 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__686:0 for ONNX tensor: QuantLinearNode__686:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__686 [QuantizeLinear] outputs: [QuantLinearNode__686:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: QuantLinearNode__682 [QuantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_4/Relu:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__684 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__682 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_4/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__684 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: QuantLinearNode__682:0 for ONNX tensor: QuantLinearNode__682:0 [10/12/2021-21:19:59] [V] [TRT] QuantLinearNode__682 [QuantizeLinear] outputs: [QuantLinearNode__682:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__687 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__686:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__684 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__687 [DequantizeLinear] inputs: [QuantLinearNode__686:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__684 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_5/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_5/quantize_and_dequantize:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__687 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_5/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: DequantLinearNode__683 [DequantizeLinear] [10/12/2021-21:19:59] [V] [TRT] Searching for input: QuantLinearNode__682:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: quant_scale__684 [10/12/2021-21:19:59] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__683 [DequantizeLinear] inputs: [QuantLinearNode__682:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__684 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:19:59] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/identity_2/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/identity_2/quantize_and_dequantize:0 [10/12/2021-21:19:59] [V] [TRT] DequantLinearNode__683 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/identity_2/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:19:59] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_5/BiasAdd [Conv] [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_5/quantize_and_dequantize:0 [10/12/2021-21:19:59] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_5/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_5/BiasAdd/ReadVariableOp__67 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_5/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/conv2d_5/quantize_and_dequantize_1:0 -> (16, 16, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_5/BiasAdd/ReadVariableOp__67 -> (16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 16, 32, 32) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_5/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_5/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_5/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_5/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_5/BiasAdd:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_5/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_5/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_5/ReadVariableOp__68 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_5/ReadVariableOp_1__69 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_5/FusedBatchNormV3/ReadVariableOp__70 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_5/FusedBatchNormV3/ReadVariableOp_1__71 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_5/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_5/BiasAdd:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_5/ReadVariableOp__68 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_5/ReadVariableOp_1__69 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_5/FusedBatchNormV3/ReadVariableOp__70 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_5/FusedBatchNormV3/ReadVariableOp_1__71 -> (16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_5/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_5/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_5/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_5/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_5/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_5/FusedBatchNormV3:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_5/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_5/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_5/Relu [Relu] inputs: [StatefulPartitionedCall/model/batch_normalization_5/FusedBatchNormV3:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_5/Relu for ONNX node: StatefulPartitionedCall/model/activation_5/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_5/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_5/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_5/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_5/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__694 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_5/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__692 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__694 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_5/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__692 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__694:0 for ONNX tensor: QuantLinearNode__694:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__694 [QuantizeLinear] outputs: [QuantLinearNode__694:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__695 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__694:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__692 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__695 [DequantizeLinear] inputs: [QuantLinearNode__694:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__692 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_6/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_6/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__695 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_6/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_6/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_6/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_6/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_6/BiasAdd/ReadVariableOp__77 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_6/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_6/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/conv2d_6/quantize_and_dequantize_1:0 -> (16, 16, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_6/BiasAdd/ReadVariableOp__77 -> (16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 16, 32, 32) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_6/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_6/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_6/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_6/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_6/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_6/BiasAdd:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_6/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_6/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_6/ReadVariableOp__78 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_6/ReadVariableOp_1__79 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_6/FusedBatchNormV3/ReadVariableOp__80 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_6/FusedBatchNormV3/ReadVariableOp_1__81 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_6/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_6/BiasAdd:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_6/ReadVariableOp__78 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_6/ReadVariableOp_1__79 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_6/FusedBatchNormV3/ReadVariableOp__80 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_6/FusedBatchNormV3/ReadVariableOp_1__81 -> (16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_6/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_6/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_6/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_6/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_6/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_6/FusedBatchNormV3:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/add_2/add [Add] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/identity_2/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_6/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_2/add [Add] inputs: [StatefulPartitionedCall/model/identity_2/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_6/FusedBatchNormV3:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/add_2/add for ONNX node: StatefulPartitionedCall/model/add_2/add [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/add_2/add:0 for ONNX tensor: StatefulPartitionedCall/model/add_2/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_2/add [Add] outputs: [StatefulPartitionedCall/model/add_2/add:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_6/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/add_2/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_6/Relu [Relu] inputs: [StatefulPartitionedCall/model/add_2/add:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_6/Relu for ONNX node: StatefulPartitionedCall/model/activation_6/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_6/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_6/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_6/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_6/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__706 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_6/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__700 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__706 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_6/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__700 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__706:0 for ONNX tensor: QuantLinearNode__706:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__706 [QuantizeLinear] outputs: [QuantLinearNode__706:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__702 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_6/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__700 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__702 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_6/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__700 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__702:0 for ONNX tensor: QuantLinearNode__702:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__702 [QuantizeLinear] outputs: [QuantLinearNode__702:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__707 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__706:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__700 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__707 [DequantizeLinear] inputs: [QuantLinearNode__706:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__700 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_7/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_7/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__707 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_7/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__703 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__702:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__700 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__703 [DequantizeLinear] inputs: [QuantLinearNode__702:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__700 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/identity_3/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/identity_3/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__703 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/identity_3/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_7/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_7/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_7/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_7/BiasAdd/ReadVariableOp__89 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_7/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_7/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/conv2d_7/quantize_and_dequantize_1:0 -> (16, 16, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_7/BiasAdd/ReadVariableOp__89 -> (16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 16, 32, 32) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_7/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_7/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_7/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_7/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_7/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_7/BiasAdd:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_7/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_7/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_7/ReadVariableOp__90 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_7/ReadVariableOp_1__91 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_7/FusedBatchNormV3/ReadVariableOp__92 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_7/FusedBatchNormV3/ReadVariableOp_1__93 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_7/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_7/BiasAdd:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_7/ReadVariableOp__90 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_7/ReadVariableOp_1__91 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_7/FusedBatchNormV3/ReadVariableOp__92 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_7/FusedBatchNormV3/ReadVariableOp_1__93 -> (16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_7/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_7/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_7/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_7/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_7/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_7/FusedBatchNormV3:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_7/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_7/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_7/Relu [Relu] inputs: [StatefulPartitionedCall/model/batch_normalization_7/FusedBatchNormV3:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_7/Relu for ONNX node: StatefulPartitionedCall/model/activation_7/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_7/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_7/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_7/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_7/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__714 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_7/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__712 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__714 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_7/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__712 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__714:0 for ONNX tensor: QuantLinearNode__714:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__714 [QuantizeLinear] outputs: [QuantLinearNode__714:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__715 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__714:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__712 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__715 [DequantizeLinear] inputs: [QuantLinearNode__714:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__712 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_8/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_8/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__715 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_8/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_8/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_8/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_8/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_8/BiasAdd/ReadVariableOp__99 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_8/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_8/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/conv2d_8/quantize_and_dequantize_1:0 -> (16, 16, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_8/BiasAdd/ReadVariableOp__99 -> (16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 16, 32, 32) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_8/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_8/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_8/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_8/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_8/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_8/BiasAdd:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_8/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_8/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_8/ReadVariableOp__100 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_8/ReadVariableOp_1__101 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_8/FusedBatchNormV3/ReadVariableOp__102 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_8/FusedBatchNormV3/ReadVariableOp_1__103 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_8/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_8/BiasAdd:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_8/ReadVariableOp__100 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_8/ReadVariableOp_1__101 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_8/FusedBatchNormV3/ReadVariableOp__102 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_8/FusedBatchNormV3/ReadVariableOp_1__103 -> (16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_8/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_8/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_8/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_8/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_8/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_8/FusedBatchNormV3:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/add_3/add [Add] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/identity_3/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_8/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_3/add [Add] inputs: [StatefulPartitionedCall/model/identity_3/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_8/FusedBatchNormV3:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/add_3/add for ONNX node: StatefulPartitionedCall/model/add_3/add [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/add_3/add:0 for ONNX tensor: StatefulPartitionedCall/model/add_3/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_3/add [Add] outputs: [StatefulPartitionedCall/model/add_3/add:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_8/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/add_3/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_8/Relu [Relu] inputs: [StatefulPartitionedCall/model/add_3/add:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_8/Relu for ONNX node: StatefulPartitionedCall/model/activation_8/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_8/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_8/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_8/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_8/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__726 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_8/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__720 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__726 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_8/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__720 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__726:0 for ONNX tensor: QuantLinearNode__726:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__726 [QuantizeLinear] outputs: [QuantLinearNode__726:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__722 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_8/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__720 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__722 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_8/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__720 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__722:0 for ONNX tensor: QuantLinearNode__722:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__722 [QuantizeLinear] outputs: [QuantLinearNode__722:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__727 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__726:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__720 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__727 [DequantizeLinear] inputs: [QuantLinearNode__726:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__720 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_9/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_9/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__727 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_9/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__723 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__722:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__720 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__723 [DequantizeLinear] inputs: [QuantLinearNode__722:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__720 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/identity_4/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/identity_4/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__723 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/identity_4/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_9/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_9/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_9/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_9/BiasAdd/ReadVariableOp__111 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_9/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_9/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/conv2d_9/quantize_and_dequantize_1:0 -> (16, 16, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_9/BiasAdd/ReadVariableOp__111 -> (16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 16, 32, 32) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_9/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_9/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_9/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_9/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_9/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_9/BiasAdd:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_9/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_9/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_9/ReadVariableOp__112 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_9/ReadVariableOp_1__113 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_9/FusedBatchNormV3/ReadVariableOp__114 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_9/FusedBatchNormV3/ReadVariableOp_1__115 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_9/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_9/BiasAdd:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_9/ReadVariableOp__112 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_9/ReadVariableOp_1__113 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_9/FusedBatchNormV3/ReadVariableOp__114 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_9/FusedBatchNormV3/ReadVariableOp_1__115 -> (16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_9/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_9/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_9/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_9/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_9/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_9/FusedBatchNormV3:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_9/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_9/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_9/Relu [Relu] inputs: [StatefulPartitionedCall/model/batch_normalization_9/FusedBatchNormV3:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_9/Relu for ONNX node: StatefulPartitionedCall/model/activation_9/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_9/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_9/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_9/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_9/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__734 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_9/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__732 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__734 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_9/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__732 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__734:0 for ONNX tensor: QuantLinearNode__734:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__734 [QuantizeLinear] outputs: [QuantLinearNode__734:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__735 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__734:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__732 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__735 [DequantizeLinear] inputs: [QuantLinearNode__734:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__732 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_10/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_10/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__735 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_10/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_10/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_10/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_10/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_10/BiasAdd/ReadVariableOp__121 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_10/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_10/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/conv2d_10/quantize_and_dequantize_1:0 -> (16, 16, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_10/BiasAdd/ReadVariableOp__121 -> (16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 16, 32, 32) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_10/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_10/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_10/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_10/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_10/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_10/BiasAdd:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_10/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_10/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_10/ReadVariableOp__122 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_10/ReadVariableOp_1__123 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_10/FusedBatchNormV3/ReadVariableOp__124 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_10/FusedBatchNormV3/ReadVariableOp_1__125 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_10/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_10/BiasAdd:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_10/ReadVariableOp__122 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_10/ReadVariableOp_1__123 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_10/FusedBatchNormV3/ReadVariableOp__124 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_10/FusedBatchNormV3/ReadVariableOp_1__125 -> (16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_10/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_10/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_10/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_10/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_10/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_10/FusedBatchNormV3:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/add_4/add [Add] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/identity_4/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_10/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_4/add [Add] inputs: [StatefulPartitionedCall/model/identity_4/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_10/FusedBatchNormV3:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/add_4/add for ONNX node: StatefulPartitionedCall/model/add_4/add [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/add_4/add:0 for ONNX tensor: StatefulPartitionedCall/model/add_4/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_4/add [Add] outputs: [StatefulPartitionedCall/model/add_4/add:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_10/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/add_4/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_10/Relu [Relu] inputs: [StatefulPartitionedCall/model/add_4/add:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_10/Relu for ONNX node: StatefulPartitionedCall/model/activation_10/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_10/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_10/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_10/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_10/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__746 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_10/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__744 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__746 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_10/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__744 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__746:0 for ONNX tensor: QuantLinearNode__746:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__746 [QuantizeLinear] outputs: [QuantLinearNode__746:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__742 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_10/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__744 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__742 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_10/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__744 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__742:0 for ONNX tensor: QuantLinearNode__742:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__742 [QuantizeLinear] outputs: [QuantLinearNode__742:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__747 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__746:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__744 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__747 [DequantizeLinear] inputs: [QuantLinearNode__746:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__744 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_11/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_11/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__747 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_11/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__743 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__742:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__744 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__743 [DequantizeLinear] inputs: [QuantLinearNode__742:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__744 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/identity_5/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/identity_5/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__743 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/identity_5/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_11/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_11/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_11/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_11/BiasAdd/ReadVariableOp__133 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_11/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_11/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/conv2d_11/quantize_and_dequantize_1:0 -> (16, 16, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_11/BiasAdd/ReadVariableOp__133 -> (16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 16, 32, 32) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_11/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_11/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_11/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_11/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_11/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_11/BiasAdd:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_11/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_11/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_11/ReadVariableOp__134 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_11/ReadVariableOp_1__135 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_11/FusedBatchNormV3/ReadVariableOp__136 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_11/FusedBatchNormV3/ReadVariableOp_1__137 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_11/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_11/BiasAdd:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_11/ReadVariableOp__134 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_11/ReadVariableOp_1__135 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_11/FusedBatchNormV3/ReadVariableOp__136 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_11/FusedBatchNormV3/ReadVariableOp_1__137 -> (16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_11/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_11/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_11/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_11/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_11/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_11/FusedBatchNormV3:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_11/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_11/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_11/Relu [Relu] inputs: [StatefulPartitionedCall/model/batch_normalization_11/FusedBatchNormV3:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_11/Relu for ONNX node: StatefulPartitionedCall/model/activation_11/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_11/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_11/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_11/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_11/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__754 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_11/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__752 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__754 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_11/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__752 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__754:0 for ONNX tensor: QuantLinearNode__754:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__754 [QuantizeLinear] outputs: [QuantLinearNode__754:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__755 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__754:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__752 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__755 [DequantizeLinear] inputs: [QuantLinearNode__754:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__752 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_12/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_12/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__755 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_12/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_12/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_12/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_12/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_12/BiasAdd/ReadVariableOp__143 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_12/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_12/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/conv2d_12/quantize_and_dequantize_1:0 -> (16, 16, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_12/BiasAdd/ReadVariableOp__143 -> (16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 16, 32, 32) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_12/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_12/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_12/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_12/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_12/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_12/BiasAdd:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_12/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_12/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_12/ReadVariableOp__144 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_12/ReadVariableOp_1__145 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_12/FusedBatchNormV3/ReadVariableOp__146 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_12/FusedBatchNormV3/ReadVariableOp_1__147 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_12/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_12/BiasAdd:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_12/ReadVariableOp__144 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_12/ReadVariableOp_1__145 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_12/FusedBatchNormV3/ReadVariableOp__146 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_12/FusedBatchNormV3/ReadVariableOp_1__147 -> (16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_12/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_12/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_12/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_12/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_12/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_12/FusedBatchNormV3:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/add_5/add [Add] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/identity_5/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_12/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_5/add [Add] inputs: [StatefulPartitionedCall/model/identity_5/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_12/FusedBatchNormV3:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/add_5/add for ONNX node: StatefulPartitionedCall/model/add_5/add [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/add_5/add:0 for ONNX tensor: StatefulPartitionedCall/model/add_5/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_5/add [Add] outputs: [StatefulPartitionedCall/model/add_5/add:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_12/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/add_5/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_12/Relu [Relu] inputs: [StatefulPartitionedCall/model/add_5/add:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_12/Relu for ONNX node: StatefulPartitionedCall/model/activation_12/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_12/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_12/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_12/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_12/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__766 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_12/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__760 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__766 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_12/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__760 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__766:0 for ONNX tensor: QuantLinearNode__766:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__766 [QuantizeLinear] outputs: [QuantLinearNode__766:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__762 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_12/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__760 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__762 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_12/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__760 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__762:0 for ONNX tensor: QuantLinearNode__762:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__762 [QuantizeLinear] outputs: [QuantLinearNode__762:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__767 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__766:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__760 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__767 [DequantizeLinear] inputs: [QuantLinearNode__766:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__760 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_13/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_13/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__767 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_13/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__763 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__762:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__760 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__763 [DequantizeLinear] inputs: [QuantLinearNode__762:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__760 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/identity_6/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/identity_6/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__763 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/identity_6/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_13/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_13/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_13/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_13/BiasAdd/ReadVariableOp__155 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_13/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_13/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/conv2d_13/quantize_and_dequantize_1:0 -> (16, 16, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_13/BiasAdd/ReadVariableOp__155 -> (16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 16, 32, 32) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_13/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_13/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_13/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_13/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_13/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_13/BiasAdd:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_13/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_13/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_13/ReadVariableOp__156 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_13/ReadVariableOp_1__157 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_13/FusedBatchNormV3/ReadVariableOp__158 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_13/FusedBatchNormV3/ReadVariableOp_1__159 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_13/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_13/BiasAdd:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_13/ReadVariableOp__156 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_13/ReadVariableOp_1__157 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_13/FusedBatchNormV3/ReadVariableOp__158 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_13/FusedBatchNormV3/ReadVariableOp_1__159 -> (16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_13/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_13/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_13/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_13/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_13/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_13/FusedBatchNormV3:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_13/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_13/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_13/Relu [Relu] inputs: [StatefulPartitionedCall/model/batch_normalization_13/FusedBatchNormV3:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_13/Relu for ONNX node: StatefulPartitionedCall/model/activation_13/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_13/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_13/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_13/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_13/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__774 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_13/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__772 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__774 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_13/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__772 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__774:0 for ONNX tensor: QuantLinearNode__774:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__774 [QuantizeLinear] outputs: [QuantLinearNode__774:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__775 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__774:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__772 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__775 [DequantizeLinear] inputs: [QuantLinearNode__774:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__772 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_14/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_14/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__775 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_14/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_14/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_14/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_14/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_14/BiasAdd/ReadVariableOp__165 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_14/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_14/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/conv2d_14/quantize_and_dequantize_1:0 -> (16, 16, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_14/BiasAdd/ReadVariableOp__165 -> (16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 16, 32, 32) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_14/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_14/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_14/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_14/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_14/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_14/BiasAdd:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_14/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_14/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_14/ReadVariableOp__166 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_14/ReadVariableOp_1__167 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_14/FusedBatchNormV3/ReadVariableOp__168 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_14/FusedBatchNormV3/ReadVariableOp_1__169 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_14/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_14/BiasAdd:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_14/ReadVariableOp__166 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_14/ReadVariableOp_1__167 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_14/FusedBatchNormV3/ReadVariableOp__168 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_14/FusedBatchNormV3/ReadVariableOp_1__169 -> (16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_14/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_14/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_14/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_14/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_14/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_14/FusedBatchNormV3:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/add_6/add [Add] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/identity_6/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_14/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_6/add [Add] inputs: [StatefulPartitionedCall/model/identity_6/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_14/FusedBatchNormV3:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/add_6/add for ONNX node: StatefulPartitionedCall/model/add_6/add [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/add_6/add:0 for ONNX tensor: StatefulPartitionedCall/model/add_6/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_6/add [Add] outputs: [StatefulPartitionedCall/model/add_6/add:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_14/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/add_6/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_14/Relu [Relu] inputs: [StatefulPartitionedCall/model/add_6/add:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_14/Relu for ONNX node: StatefulPartitionedCall/model/activation_14/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_14/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_14/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_14/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_14/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__786 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_14/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__784 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__786 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_14/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__784 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__786:0 for ONNX tensor: QuantLinearNode__786:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__786 [QuantizeLinear] outputs: [QuantLinearNode__786:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__782 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_14/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__784 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__782 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_14/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__784 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__782:0 for ONNX tensor: QuantLinearNode__782:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__782 [QuantizeLinear] outputs: [QuantLinearNode__782:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__787 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__786:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__784 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__787 [DequantizeLinear] inputs: [QuantLinearNode__786:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__784 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_15/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_15/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__787 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_15/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__783 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__782:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__784 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__783 [DequantizeLinear] inputs: [QuantLinearNode__782:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__784 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/identity_7/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/identity_7/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__783 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/identity_7/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_15/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_15/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_15/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_15/BiasAdd/ReadVariableOp__177 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_15/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_15/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/conv2d_15/quantize_and_dequantize_1:0 -> (16, 16, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_15/BiasAdd/ReadVariableOp__177 -> (16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 16, 32, 32) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_15/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_15/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_15/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_15/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_15/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_15/BiasAdd:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_15/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_15/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_15/ReadVariableOp__178 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_15/ReadVariableOp_1__179 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_15/FusedBatchNormV3/ReadVariableOp__180 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_15/FusedBatchNormV3/ReadVariableOp_1__181 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_15/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_15/BiasAdd:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_15/ReadVariableOp__178 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_15/ReadVariableOp_1__179 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_15/FusedBatchNormV3/ReadVariableOp__180 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_15/FusedBatchNormV3/ReadVariableOp_1__181 -> (16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_15/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_15/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_15/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_15/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_15/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_15/FusedBatchNormV3:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_15/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_15/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_15/Relu [Relu] inputs: [StatefulPartitionedCall/model/batch_normalization_15/FusedBatchNormV3:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_15/Relu for ONNX node: StatefulPartitionedCall/model/activation_15/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_15/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_15/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_15/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_15/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__794 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_15/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__792 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__794 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_15/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__792 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__794:0 for ONNX tensor: QuantLinearNode__794:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__794 [QuantizeLinear] outputs: [QuantLinearNode__794:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__795 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__794:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__792 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__795 [DequantizeLinear] inputs: [QuantLinearNode__794:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__792 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_16/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_16/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__795 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_16/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_16/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_16/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_16/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_16/BiasAdd/ReadVariableOp__187 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_16/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_16/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/conv2d_16/quantize_and_dequantize_1:0 -> (16, 16, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_16/BiasAdd/ReadVariableOp__187 -> (16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 16, 32, 32) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_16/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_16/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_16/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_16/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_16/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_16/BiasAdd:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_16/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_16/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_16/ReadVariableOp__188 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_16/ReadVariableOp_1__189 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_16/FusedBatchNormV3/ReadVariableOp__190 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_16/FusedBatchNormV3/ReadVariableOp_1__191 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_16/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_16/BiasAdd:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_16/ReadVariableOp__188 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_16/ReadVariableOp_1__189 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_16/FusedBatchNormV3/ReadVariableOp__190 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_16/FusedBatchNormV3/ReadVariableOp_1__191 -> (16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_16/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_16/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_16/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_16/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_16/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_16/FusedBatchNormV3:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/add_7/add [Add] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/identity_7/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_16/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_7/add [Add] inputs: [StatefulPartitionedCall/model/identity_7/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_16/FusedBatchNormV3:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/add_7/add for ONNX node: StatefulPartitionedCall/model/add_7/add [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/add_7/add:0 for ONNX tensor: StatefulPartitionedCall/model/add_7/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_7/add [Add] outputs: [StatefulPartitionedCall/model/add_7/add:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_16/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/add_7/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_16/Relu [Relu] inputs: [StatefulPartitionedCall/model/add_7/add:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_16/Relu for ONNX node: StatefulPartitionedCall/model/activation_16/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_16/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_16/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_16/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_16/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__806 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_16/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__804 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__806 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_16/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__804 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__806:0 for ONNX tensor: QuantLinearNode__806:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__806 [QuantizeLinear] outputs: [QuantLinearNode__806:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__802 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_16/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__804 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__802 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_16/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__804 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__802:0 for ONNX tensor: QuantLinearNode__802:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__802 [QuantizeLinear] outputs: [QuantLinearNode__802:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__807 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__806:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__804 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__807 [DequantizeLinear] inputs: [QuantLinearNode__806:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__804 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_17/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_17/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__807 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_17/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__803 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__802:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__804 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__803 [DequantizeLinear] inputs: [QuantLinearNode__802:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__804 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/identity_8/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/identity_8/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__803 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/identity_8/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_17/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_17/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_17/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_17/BiasAdd/ReadVariableOp__199 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_17/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_17/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/conv2d_17/quantize_and_dequantize_1:0 -> (16, 16, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_17/BiasAdd/ReadVariableOp__199 -> (16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 16, 32, 32) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_17/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_17/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_17/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_17/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_17/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_17/BiasAdd:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_17/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_17/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_17/ReadVariableOp__200 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_17/ReadVariableOp_1__201 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_17/FusedBatchNormV3/ReadVariableOp__202 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_17/FusedBatchNormV3/ReadVariableOp_1__203 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_17/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_17/BiasAdd:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_17/ReadVariableOp__200 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_17/ReadVariableOp_1__201 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_17/FusedBatchNormV3/ReadVariableOp__202 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_17/FusedBatchNormV3/ReadVariableOp_1__203 -> (16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_17/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_17/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_17/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_17/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_17/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_17/FusedBatchNormV3:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_17/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_17/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_17/Relu [Relu] inputs: [StatefulPartitionedCall/model/batch_normalization_17/FusedBatchNormV3:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_17/Relu for ONNX node: StatefulPartitionedCall/model/activation_17/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_17/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_17/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_17/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_17/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__814 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_17/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__812 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__814 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_17/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__812 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__814:0 for ONNX tensor: QuantLinearNode__814:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__814 [QuantizeLinear] outputs: [QuantLinearNode__814:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__815 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__814:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__812 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__815 [DequantizeLinear] inputs: [QuantLinearNode__814:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__812 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_18/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_18/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__815 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_18/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_18/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_18/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_18/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_18/BiasAdd/ReadVariableOp__209 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_18/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_18/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/conv2d_18/quantize_and_dequantize_1:0 -> (16, 16, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_18/BiasAdd/ReadVariableOp__209 -> (16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 16, 32, 32) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_18/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_18/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_18/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_18/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_18/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_18/BiasAdd:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_18/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_18/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_18/ReadVariableOp__210 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_18/ReadVariableOp_1__211 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_18/FusedBatchNormV3/ReadVariableOp__212 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_18/FusedBatchNormV3/ReadVariableOp_1__213 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_18/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_18/BiasAdd:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_18/ReadVariableOp__210 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_18/ReadVariableOp_1__211 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_18/FusedBatchNormV3/ReadVariableOp__212 -> (16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_18/FusedBatchNormV3/ReadVariableOp_1__213 -> (16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_18/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_18/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_18/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_18/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_18/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_18/FusedBatchNormV3:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/add_8/add [Add] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/identity_8/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_18/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_8/add [Add] inputs: [StatefulPartitionedCall/model/identity_8/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_18/FusedBatchNormV3:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/add_8/add for ONNX node: StatefulPartitionedCall/model/add_8/add [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/add_8/add:0 for ONNX tensor: StatefulPartitionedCall/model/add_8/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_8/add [Add] outputs: [StatefulPartitionedCall/model/add_8/add:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_18/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/add_8/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_18/Relu [Relu] inputs: [StatefulPartitionedCall/model/add_8/add:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_18/Relu for ONNX node: StatefulPartitionedCall/model/activation_18/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_18/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_18/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_18/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_18/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__834 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_18/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__832 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__834 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_18/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__832 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__834:0 for ONNX tensor: QuantLinearNode__834:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__834 [QuantizeLinear] outputs: [QuantLinearNode__834:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__822 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_18/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__832 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__822 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_18/Relu:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__832 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__822:0 for ONNX tensor: QuantLinearNode__822:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__822 [QuantizeLinear] outputs: [QuantLinearNode__822:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__835 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__834:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__832 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__835 [DequantizeLinear] inputs: [QuantLinearNode__834:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__832 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_19/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_19/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__835 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_19/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__823 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__822:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__832 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__823 [DequantizeLinear] inputs: [QuantLinearNode__822:0 -> (1, 16, 32, 32)[FLOAT]], [quant_scale__832 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_21/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_21/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__823 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_21/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_19/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_19/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_19/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_19/BiasAdd/ReadVariableOp__227 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_19/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_19/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/conv2d_19/quantize_and_dequantize_1:0 -> (32, 16, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_19/BiasAdd/ReadVariableOp__227 -> (32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 16, 32, 32) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_19/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_19/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_19/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_19/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_19/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_19/BiasAdd:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_21/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_21/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_21/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_21/BiasAdd/ReadVariableOp__219 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_21/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_21/quantize_and_dequantize:0 -> (1, 16, 32, 32)[FLOAT]], [StatefulPartitionedCall/model/conv2d_21/quantize_and_dequantize_1:0 -> (32, 16, 1, 1)[FLOAT]], [StatefulPartitionedCall/model/conv2d_21/BiasAdd/ReadVariableOp__219 -> (32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 16, 32, 32) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_21/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_21/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_21/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_21/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_21/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_21/BiasAdd:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_19/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_19/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_19/ReadVariableOp__228 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_19/ReadVariableOp_1__229 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_19/FusedBatchNormV3/ReadVariableOp__230 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_19/FusedBatchNormV3/ReadVariableOp_1__231 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_19/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_19/BiasAdd:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_19/ReadVariableOp__228 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_19/ReadVariableOp_1__229 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_19/FusedBatchNormV3/ReadVariableOp__230 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_19/FusedBatchNormV3/ReadVariableOp_1__231 -> (32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_19/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_19/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_19/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_19/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_19/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_19/FusedBatchNormV3:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__830 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_21/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__828 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__830 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_21/BiasAdd:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__828 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__830:0 for ONNX tensor: QuantLinearNode__830:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__830 [QuantizeLinear] outputs: [QuantLinearNode__830:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_19/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_19/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_19/Relu [Relu] inputs: [StatefulPartitionedCall/model/batch_normalization_19/FusedBatchNormV3:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_19/Relu for ONNX node: StatefulPartitionedCall/model/activation_19/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_19/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_19/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_19/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_19/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__831 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__830:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__828 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__831 [DequantizeLinear] inputs: [QuantLinearNode__830:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__828 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/identity_9/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/identity_9/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__831 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/identity_9/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__842 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_19/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__840 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__842 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_19/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__840 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__842:0 for ONNX tensor: QuantLinearNode__842:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__842 [QuantizeLinear] outputs: [QuantLinearNode__842:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__843 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__842:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__840 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__843 [DequantizeLinear] inputs: [QuantLinearNode__842:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__840 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_20/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_20/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__843 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_20/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_20/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_20/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_20/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_20/BiasAdd/ReadVariableOp__237 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_20/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_20/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/conv2d_20/quantize_and_dequantize_1:0 -> (32, 32, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_20/BiasAdd/ReadVariableOp__237 -> (32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 32, 16, 16) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_20/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_20/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_20/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_20/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_20/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_20/BiasAdd:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_20/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_20/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_20/ReadVariableOp__238 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_20/ReadVariableOp_1__239 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_20/FusedBatchNormV3/ReadVariableOp__240 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_20/FusedBatchNormV3/ReadVariableOp_1__241 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_20/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_20/BiasAdd:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_20/ReadVariableOp__238 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_20/ReadVariableOp_1__239 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_20/FusedBatchNormV3/ReadVariableOp__240 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_20/FusedBatchNormV3/ReadVariableOp_1__241 -> (32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_20/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_20/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_20/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_20/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_20/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_20/FusedBatchNormV3:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/add_9/add [Add] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/identity_9/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_20/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_9/add [Add] inputs: [StatefulPartitionedCall/model/identity_9/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_20/FusedBatchNormV3:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/add_9/add for ONNX node: StatefulPartitionedCall/model/add_9/add [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/add_9/add:0 for ONNX tensor: StatefulPartitionedCall/model/add_9/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_9/add [Add] outputs: [StatefulPartitionedCall/model/add_9/add:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_20/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/add_9/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_20/Relu [Relu] inputs: [StatefulPartitionedCall/model/add_9/add:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_20/Relu for ONNX node: StatefulPartitionedCall/model/activation_20/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_20/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_20/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_20/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_20/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__854 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_20/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__848 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__854 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_20/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__848 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__854:0 for ONNX tensor: QuantLinearNode__854:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__854 [QuantizeLinear] outputs: [QuantLinearNode__854:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__850 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_20/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__848 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__850 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_20/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__848 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__850:0 for ONNX tensor: QuantLinearNode__850:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__850 [QuantizeLinear] outputs: [QuantLinearNode__850:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__855 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__854:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__848 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__855 [DequantizeLinear] inputs: [QuantLinearNode__854:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__848 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_22/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_22/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__855 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_22/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__851 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__850:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__848 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__851 [DequantizeLinear] inputs: [QuantLinearNode__850:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__848 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/identity_10/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/identity_10/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__851 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/identity_10/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_22/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_22/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_22/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_22/BiasAdd/ReadVariableOp__249 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_22/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_22/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/conv2d_22/quantize_and_dequantize_1:0 -> (32, 32, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_22/BiasAdd/ReadVariableOp__249 -> (32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 32, 16, 16) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_22/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_22/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_22/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_22/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_22/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_22/BiasAdd:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_21/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_22/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_21/ReadVariableOp__250 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_21/ReadVariableOp_1__251 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_21/FusedBatchNormV3/ReadVariableOp__252 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_21/FusedBatchNormV3/ReadVariableOp_1__253 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_21/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_22/BiasAdd:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_21/ReadVariableOp__250 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_21/ReadVariableOp_1__251 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_21/FusedBatchNormV3/ReadVariableOp__252 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_21/FusedBatchNormV3/ReadVariableOp_1__253 -> (32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_21/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_21/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_21/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_21/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_21/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_21/FusedBatchNormV3:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_21/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_21/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_21/Relu [Relu] inputs: [StatefulPartitionedCall/model/batch_normalization_21/FusedBatchNormV3:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_21/Relu for ONNX node: StatefulPartitionedCall/model/activation_21/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_21/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_21/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_21/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_21/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__862 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_21/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__860 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__862 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_21/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__860 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__862:0 for ONNX tensor: QuantLinearNode__862:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__862 [QuantizeLinear] outputs: [QuantLinearNode__862:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__863 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__862:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__860 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__863 [DequantizeLinear] inputs: [QuantLinearNode__862:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__860 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_23/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_23/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__863 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_23/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_23/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_23/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_23/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_23/BiasAdd/ReadVariableOp__259 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_23/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_23/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/conv2d_23/quantize_and_dequantize_1:0 -> (32, 32, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_23/BiasAdd/ReadVariableOp__259 -> (32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 32, 16, 16) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_23/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_23/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_23/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_23/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_23/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_23/BiasAdd:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_22/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_23/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_22/ReadVariableOp__260 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_22/ReadVariableOp_1__261 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_22/FusedBatchNormV3/ReadVariableOp__262 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_22/FusedBatchNormV3/ReadVariableOp_1__263 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_22/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_23/BiasAdd:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_22/ReadVariableOp__260 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_22/ReadVariableOp_1__261 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_22/FusedBatchNormV3/ReadVariableOp__262 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_22/FusedBatchNormV3/ReadVariableOp_1__263 -> (32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_22/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_22/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_22/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_22/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_22/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_22/FusedBatchNormV3:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/add_10/add [Add] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/identity_10/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_22/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_10/add [Add] inputs: [StatefulPartitionedCall/model/identity_10/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_22/FusedBatchNormV3:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/add_10/add for ONNX node: StatefulPartitionedCall/model/add_10/add [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/add_10/add:0 for ONNX tensor: StatefulPartitionedCall/model/add_10/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_10/add [Add] outputs: [StatefulPartitionedCall/model/add_10/add:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_22/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/add_10/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_22/Relu [Relu] inputs: [StatefulPartitionedCall/model/add_10/add:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_22/Relu for ONNX node: StatefulPartitionedCall/model/activation_22/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_22/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_22/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_22/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_22/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__874 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_22/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__868 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__874 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_22/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__868 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__874:0 for ONNX tensor: QuantLinearNode__874:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__874 [QuantizeLinear] outputs: [QuantLinearNode__874:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__870 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_22/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__868 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__870 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_22/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__868 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__870:0 for ONNX tensor: QuantLinearNode__870:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__870 [QuantizeLinear] outputs: [QuantLinearNode__870:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__875 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__874:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__868 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__875 [DequantizeLinear] inputs: [QuantLinearNode__874:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__868 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_24/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_24/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__875 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_24/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__871 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__870:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__868 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__871 [DequantizeLinear] inputs: [QuantLinearNode__870:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__868 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/identity_11/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/identity_11/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__871 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/identity_11/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_24/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_24/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_24/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_24/BiasAdd/ReadVariableOp__271 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_24/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_24/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/conv2d_24/quantize_and_dequantize_1:0 -> (32, 32, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_24/BiasAdd/ReadVariableOp__271 -> (32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 32, 16, 16) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_24/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_24/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_24/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_24/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_24/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_24/BiasAdd:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_23/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_24/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_23/ReadVariableOp__272 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_23/ReadVariableOp_1__273 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_23/FusedBatchNormV3/ReadVariableOp__274 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_23/FusedBatchNormV3/ReadVariableOp_1__275 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_23/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_24/BiasAdd:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_23/ReadVariableOp__272 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_23/ReadVariableOp_1__273 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_23/FusedBatchNormV3/ReadVariableOp__274 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_23/FusedBatchNormV3/ReadVariableOp_1__275 -> (32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_23/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_23/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_23/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_23/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_23/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_23/FusedBatchNormV3:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_23/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_23/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_23/Relu [Relu] inputs: [StatefulPartitionedCall/model/batch_normalization_23/FusedBatchNormV3:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_23/Relu for ONNX node: StatefulPartitionedCall/model/activation_23/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_23/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_23/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_23/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_23/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__882 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_23/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__880 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__882 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_23/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__880 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__882:0 for ONNX tensor: QuantLinearNode__882:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__882 [QuantizeLinear] outputs: [QuantLinearNode__882:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__883 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__882:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__880 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__883 [DequantizeLinear] inputs: [QuantLinearNode__882:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__880 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_25/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_25/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__883 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_25/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_25/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_25/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_25/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_25/BiasAdd/ReadVariableOp__281 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_25/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_25/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/conv2d_25/quantize_and_dequantize_1:0 -> (32, 32, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_25/BiasAdd/ReadVariableOp__281 -> (32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 32, 16, 16) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_25/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_25/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_25/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_25/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_25/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_25/BiasAdd:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_24/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_25/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_24/ReadVariableOp__282 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_24/ReadVariableOp_1__283 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_24/FusedBatchNormV3/ReadVariableOp__284 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_24/FusedBatchNormV3/ReadVariableOp_1__285 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_24/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_25/BiasAdd:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_24/ReadVariableOp__282 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_24/ReadVariableOp_1__283 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_24/FusedBatchNormV3/ReadVariableOp__284 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_24/FusedBatchNormV3/ReadVariableOp_1__285 -> (32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_24/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_24/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_24/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_24/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_24/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_24/FusedBatchNormV3:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/add_11/add [Add] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/identity_11/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_24/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_11/add [Add] inputs: [StatefulPartitionedCall/model/identity_11/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_24/FusedBatchNormV3:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/add_11/add for ONNX node: StatefulPartitionedCall/model/add_11/add [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/add_11/add:0 for ONNX tensor: StatefulPartitionedCall/model/add_11/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_11/add [Add] outputs: [StatefulPartitionedCall/model/add_11/add:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_24/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/add_11/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_24/Relu [Relu] inputs: [StatefulPartitionedCall/model/add_11/add:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_24/Relu for ONNX node: StatefulPartitionedCall/model/activation_24/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_24/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_24/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_24/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_24/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__894 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_24/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__888 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__894 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_24/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__888 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__894:0 for ONNX tensor: QuantLinearNode__894:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__894 [QuantizeLinear] outputs: [QuantLinearNode__894:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__890 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_24/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__888 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__890 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_24/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__888 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__890:0 for ONNX tensor: QuantLinearNode__890:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__890 [QuantizeLinear] outputs: [QuantLinearNode__890:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__895 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__894:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__888 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__895 [DequantizeLinear] inputs: [QuantLinearNode__894:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__888 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_26/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_26/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__895 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_26/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__891 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__890:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__888 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__891 [DequantizeLinear] inputs: [QuantLinearNode__890:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__888 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/identity_12/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/identity_12/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__891 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/identity_12/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_26/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_26/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_26/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_26/BiasAdd/ReadVariableOp__293 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_26/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_26/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/conv2d_26/quantize_and_dequantize_1:0 -> (32, 32, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_26/BiasAdd/ReadVariableOp__293 -> (32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 32, 16, 16) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_26/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_26/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_26/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_26/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_26/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_26/BiasAdd:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_25/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_26/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_25/ReadVariableOp__294 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_25/ReadVariableOp_1__295 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_25/FusedBatchNormV3/ReadVariableOp__296 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_25/FusedBatchNormV3/ReadVariableOp_1__297 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_25/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_26/BiasAdd:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_25/ReadVariableOp__294 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_25/ReadVariableOp_1__295 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_25/FusedBatchNormV3/ReadVariableOp__296 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_25/FusedBatchNormV3/ReadVariableOp_1__297 -> (32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_25/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_25/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_25/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_25/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_25/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_25/FusedBatchNormV3:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_25/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_25/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_25/Relu [Relu] inputs: [StatefulPartitionedCall/model/batch_normalization_25/FusedBatchNormV3:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_25/Relu for ONNX node: StatefulPartitionedCall/model/activation_25/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_25/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_25/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_25/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_25/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__902 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_25/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__900 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__902 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_25/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__900 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__902:0 for ONNX tensor: QuantLinearNode__902:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__902 [QuantizeLinear] outputs: [QuantLinearNode__902:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__903 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__902:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__900 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__903 [DequantizeLinear] inputs: [QuantLinearNode__902:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__900 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_27/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_27/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__903 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_27/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_27/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_27/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_27/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_27/BiasAdd/ReadVariableOp__303 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_27/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_27/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/conv2d_27/quantize_and_dequantize_1:0 -> (32, 32, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_27/BiasAdd/ReadVariableOp__303 -> (32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 32, 16, 16) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_27/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_27/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_27/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_27/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_27/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_27/BiasAdd:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_26/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_27/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_26/ReadVariableOp__304 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_26/ReadVariableOp_1__305 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_26/FusedBatchNormV3/ReadVariableOp__306 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_26/FusedBatchNormV3/ReadVariableOp_1__307 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_26/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_27/BiasAdd:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_26/ReadVariableOp__304 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_26/ReadVariableOp_1__305 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_26/FusedBatchNormV3/ReadVariableOp__306 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_26/FusedBatchNormV3/ReadVariableOp_1__307 -> (32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_26/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_26/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_26/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_26/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_26/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_26/FusedBatchNormV3:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/add_12/add [Add] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/identity_12/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_26/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_12/add [Add] inputs: [StatefulPartitionedCall/model/identity_12/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_26/FusedBatchNormV3:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/add_12/add for ONNX node: StatefulPartitionedCall/model/add_12/add [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/add_12/add:0 for ONNX tensor: StatefulPartitionedCall/model/add_12/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_12/add [Add] outputs: [StatefulPartitionedCall/model/add_12/add:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_26/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/add_12/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_26/Relu [Relu] inputs: [StatefulPartitionedCall/model/add_12/add:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_26/Relu for ONNX node: StatefulPartitionedCall/model/activation_26/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_26/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_26/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_26/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_26/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__914 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_26/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__908 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__914 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_26/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__908 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__914:0 for ONNX tensor: QuantLinearNode__914:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__914 [QuantizeLinear] outputs: [QuantLinearNode__914:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__910 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_26/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__908 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__910 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_26/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__908 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__910:0 for ONNX tensor: QuantLinearNode__910:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__910 [QuantizeLinear] outputs: [QuantLinearNode__910:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__915 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__914:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__908 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__915 [DequantizeLinear] inputs: [QuantLinearNode__914:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__908 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_28/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_28/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__915 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_28/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__911 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__910:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__908 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__911 [DequantizeLinear] inputs: [QuantLinearNode__910:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__908 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/identity_13/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/identity_13/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__911 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/identity_13/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_28/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_28/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_28/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_28/BiasAdd/ReadVariableOp__315 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_28/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_28/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/conv2d_28/quantize_and_dequantize_1:0 -> (32, 32, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_28/BiasAdd/ReadVariableOp__315 -> (32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 32, 16, 16) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_28/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_28/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_28/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_28/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_28/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_28/BiasAdd:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_27/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_28/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_27/ReadVariableOp__316 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_27/ReadVariableOp_1__317 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_27/FusedBatchNormV3/ReadVariableOp__318 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_27/FusedBatchNormV3/ReadVariableOp_1__319 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_27/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_28/BiasAdd:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_27/ReadVariableOp__316 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_27/ReadVariableOp_1__317 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_27/FusedBatchNormV3/ReadVariableOp__318 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_27/FusedBatchNormV3/ReadVariableOp_1__319 -> (32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_27/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_27/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_27/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_27/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_27/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_27/FusedBatchNormV3:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_27/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_27/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_27/Relu [Relu] inputs: [StatefulPartitionedCall/model/batch_normalization_27/FusedBatchNormV3:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_27/Relu for ONNX node: StatefulPartitionedCall/model/activation_27/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_27/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_27/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_27/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_27/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__922 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_27/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__920 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__922 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_27/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__920 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__922:0 for ONNX tensor: QuantLinearNode__922:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__922 [QuantizeLinear] outputs: [QuantLinearNode__922:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__923 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__922:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__920 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__923 [DequantizeLinear] inputs: [QuantLinearNode__922:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__920 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_29/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_29/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__923 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_29/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_29/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_29/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_29/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_29/BiasAdd/ReadVariableOp__325 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_29/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_29/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/conv2d_29/quantize_and_dequantize_1:0 -> (32, 32, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_29/BiasAdd/ReadVariableOp__325 -> (32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 32, 16, 16) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_29/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_29/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_29/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_29/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_29/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_29/BiasAdd:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_28/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_29/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_28/ReadVariableOp__326 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_28/ReadVariableOp_1__327 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_28/FusedBatchNormV3/ReadVariableOp__328 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_28/FusedBatchNormV3/ReadVariableOp_1__329 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_28/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_29/BiasAdd:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_28/ReadVariableOp__326 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_28/ReadVariableOp_1__327 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_28/FusedBatchNormV3/ReadVariableOp__328 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_28/FusedBatchNormV3/ReadVariableOp_1__329 -> (32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_28/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_28/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_28/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_28/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_28/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_28/FusedBatchNormV3:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/add_13/add [Add] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/identity_13/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_28/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_13/add [Add] inputs: [StatefulPartitionedCall/model/identity_13/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_28/FusedBatchNormV3:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/add_13/add for ONNX node: StatefulPartitionedCall/model/add_13/add [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/add_13/add:0 for ONNX tensor: StatefulPartitionedCall/model/add_13/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_13/add [Add] outputs: [StatefulPartitionedCall/model/add_13/add:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_28/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/add_13/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_28/Relu [Relu] inputs: [StatefulPartitionedCall/model/add_13/add:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_28/Relu for ONNX node: StatefulPartitionedCall/model/activation_28/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_28/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_28/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_28/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_28/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__934 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_28/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__928 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__934 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_28/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__928 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__934:0 for ONNX tensor: QuantLinearNode__934:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__934 [QuantizeLinear] outputs: [QuantLinearNode__934:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__930 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_28/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__928 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__930 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_28/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__928 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__930:0 for ONNX tensor: QuantLinearNode__930:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__930 [QuantizeLinear] outputs: [QuantLinearNode__930:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__935 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__934:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__928 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__935 [DequantizeLinear] inputs: [QuantLinearNode__934:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__928 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_30/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_30/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__935 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_30/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__931 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__930:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__928 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__931 [DequantizeLinear] inputs: [QuantLinearNode__930:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__928 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/identity_14/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/identity_14/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__931 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/identity_14/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_30/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_30/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_30/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_30/BiasAdd/ReadVariableOp__337 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_30/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_30/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/conv2d_30/quantize_and_dequantize_1:0 -> (32, 32, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_30/BiasAdd/ReadVariableOp__337 -> (32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 32, 16, 16) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_30/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_30/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_30/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_30/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_30/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_30/BiasAdd:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_29/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_30/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_29/ReadVariableOp__338 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_29/ReadVariableOp_1__339 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_29/FusedBatchNormV3/ReadVariableOp__340 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_29/FusedBatchNormV3/ReadVariableOp_1__341 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_29/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_30/BiasAdd:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_29/ReadVariableOp__338 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_29/ReadVariableOp_1__339 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_29/FusedBatchNormV3/ReadVariableOp__340 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_29/FusedBatchNormV3/ReadVariableOp_1__341 -> (32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_29/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_29/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_29/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_29/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_29/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_29/FusedBatchNormV3:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_29/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_29/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_29/Relu [Relu] inputs: [StatefulPartitionedCall/model/batch_normalization_29/FusedBatchNormV3:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_29/Relu for ONNX node: StatefulPartitionedCall/model/activation_29/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_29/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_29/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_29/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_29/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__942 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_29/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__940 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__942 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_29/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__940 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__942:0 for ONNX tensor: QuantLinearNode__942:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__942 [QuantizeLinear] outputs: [QuantLinearNode__942:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__943 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__942:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__940 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__943 [DequantizeLinear] inputs: [QuantLinearNode__942:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__940 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_31/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_31/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__943 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_31/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_31/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_31/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_31/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_31/BiasAdd/ReadVariableOp__347 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_31/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_31/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/conv2d_31/quantize_and_dequantize_1:0 -> (32, 32, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_31/BiasAdd/ReadVariableOp__347 -> (32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 32, 16, 16) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_31/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_31/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_31/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_31/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_31/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_31/BiasAdd:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_30/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_31/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_30/ReadVariableOp__348 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_30/ReadVariableOp_1__349 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_30/FusedBatchNormV3/ReadVariableOp__350 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_30/FusedBatchNormV3/ReadVariableOp_1__351 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_30/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_31/BiasAdd:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_30/ReadVariableOp__348 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_30/ReadVariableOp_1__349 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_30/FusedBatchNormV3/ReadVariableOp__350 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_30/FusedBatchNormV3/ReadVariableOp_1__351 -> (32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_30/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_30/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_30/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_30/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_30/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_30/FusedBatchNormV3:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/add_14/add [Add] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/identity_14/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_30/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_14/add [Add] inputs: [StatefulPartitionedCall/model/identity_14/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_30/FusedBatchNormV3:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/add_14/add for ONNX node: StatefulPartitionedCall/model/add_14/add [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/add_14/add:0 for ONNX tensor: StatefulPartitionedCall/model/add_14/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_14/add [Add] outputs: [StatefulPartitionedCall/model/add_14/add:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_30/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/add_14/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_30/Relu [Relu] inputs: [StatefulPartitionedCall/model/add_14/add:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_30/Relu for ONNX node: StatefulPartitionedCall/model/activation_30/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_30/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_30/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_30/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_30/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__954 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_30/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__952 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__954 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_30/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__952 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__954:0 for ONNX tensor: QuantLinearNode__954:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__954 [QuantizeLinear] outputs: [QuantLinearNode__954:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__950 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_30/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__952 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__950 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_30/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__952 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__950:0 for ONNX tensor: QuantLinearNode__950:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__950 [QuantizeLinear] outputs: [QuantLinearNode__950:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__955 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__954:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__952 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__955 [DequantizeLinear] inputs: [QuantLinearNode__954:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__952 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_32/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_32/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__955 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_32/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__951 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__950:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__952 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__951 [DequantizeLinear] inputs: [QuantLinearNode__950:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__952 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/identity_15/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/identity_15/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__951 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/identity_15/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_32/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_32/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_32/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_32/BiasAdd/ReadVariableOp__359 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_32/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_32/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/conv2d_32/quantize_and_dequantize_1:0 -> (32, 32, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_32/BiasAdd/ReadVariableOp__359 -> (32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 32, 16, 16) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_32/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_32/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_32/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_32/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_32/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_32/BiasAdd:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_31/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_32/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_31/ReadVariableOp__360 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_31/ReadVariableOp_1__361 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_31/FusedBatchNormV3/ReadVariableOp__362 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_31/FusedBatchNormV3/ReadVariableOp_1__363 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_31/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_32/BiasAdd:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_31/ReadVariableOp__360 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_31/ReadVariableOp_1__361 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_31/FusedBatchNormV3/ReadVariableOp__362 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_31/FusedBatchNormV3/ReadVariableOp_1__363 -> (32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_31/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_31/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_31/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_31/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_31/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_31/FusedBatchNormV3:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_31/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_31/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_31/Relu [Relu] inputs: [StatefulPartitionedCall/model/batch_normalization_31/FusedBatchNormV3:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_31/Relu for ONNX node: StatefulPartitionedCall/model/activation_31/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_31/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_31/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_31/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_31/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__962 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_31/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__960 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__962 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_31/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__960 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__962:0 for ONNX tensor: QuantLinearNode__962:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__962 [QuantizeLinear] outputs: [QuantLinearNode__962:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__963 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__962:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__960 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__963 [DequantizeLinear] inputs: [QuantLinearNode__962:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__960 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_33/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_33/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__963 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_33/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_33/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_33/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_33/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_33/BiasAdd/ReadVariableOp__369 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_33/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_33/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/conv2d_33/quantize_and_dequantize_1:0 -> (32, 32, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_33/BiasAdd/ReadVariableOp__369 -> (32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 32, 16, 16) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_33/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_33/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_33/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_33/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_33/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_33/BiasAdd:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_32/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_33/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_32/ReadVariableOp__370 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_32/ReadVariableOp_1__371 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_32/FusedBatchNormV3/ReadVariableOp__372 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_32/FusedBatchNormV3/ReadVariableOp_1__373 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_32/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_33/BiasAdd:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_32/ReadVariableOp__370 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_32/ReadVariableOp_1__371 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_32/FusedBatchNormV3/ReadVariableOp__372 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_32/FusedBatchNormV3/ReadVariableOp_1__373 -> (32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_32/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_32/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_32/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_32/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_32/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_32/FusedBatchNormV3:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/add_15/add [Add] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/identity_15/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_32/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_15/add [Add] inputs: [StatefulPartitionedCall/model/identity_15/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_32/FusedBatchNormV3:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/add_15/add for ONNX node: StatefulPartitionedCall/model/add_15/add [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/add_15/add:0 for ONNX tensor: StatefulPartitionedCall/model/add_15/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_15/add [Add] outputs: [StatefulPartitionedCall/model/add_15/add:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_32/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/add_15/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_32/Relu [Relu] inputs: [StatefulPartitionedCall/model/add_15/add:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_32/Relu for ONNX node: StatefulPartitionedCall/model/activation_32/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_32/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_32/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_32/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_32/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__974 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_32/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__972 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__974 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_32/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__972 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__974:0 for ONNX tensor: QuantLinearNode__974:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__974 [QuantizeLinear] outputs: [QuantLinearNode__974:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__970 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_32/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__972 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__970 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_32/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__972 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__970:0 for ONNX tensor: QuantLinearNode__970:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__970 [QuantizeLinear] outputs: [QuantLinearNode__970:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__975 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__974:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__972 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__975 [DequantizeLinear] inputs: [QuantLinearNode__974:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__972 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_34/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_34/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__975 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_34/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__971 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__970:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__972 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__971 [DequantizeLinear] inputs: [QuantLinearNode__970:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__972 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/identity_16/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/identity_16/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__971 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/identity_16/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_34/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_34/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_34/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_34/BiasAdd/ReadVariableOp__381 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_34/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_34/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/conv2d_34/quantize_and_dequantize_1:0 -> (32, 32, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_34/BiasAdd/ReadVariableOp__381 -> (32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 32, 16, 16) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_34/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_34/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_34/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_34/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_34/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_34/BiasAdd:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_33/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_34/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_33/ReadVariableOp__382 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_33/ReadVariableOp_1__383 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_33/FusedBatchNormV3/ReadVariableOp__384 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_33/FusedBatchNormV3/ReadVariableOp_1__385 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_33/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_34/BiasAdd:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_33/ReadVariableOp__382 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_33/ReadVariableOp_1__383 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_33/FusedBatchNormV3/ReadVariableOp__384 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_33/FusedBatchNormV3/ReadVariableOp_1__385 -> (32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_33/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_33/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_33/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_33/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_33/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_33/FusedBatchNormV3:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_33/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_33/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_33/Relu [Relu] inputs: [StatefulPartitionedCall/model/batch_normalization_33/FusedBatchNormV3:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_33/Relu for ONNX node: StatefulPartitionedCall/model/activation_33/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_33/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_33/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_33/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_33/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__982 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_33/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__980 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__982 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_33/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__980 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__982:0 for ONNX tensor: QuantLinearNode__982:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__982 [QuantizeLinear] outputs: [QuantLinearNode__982:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__983 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__982:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__980 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__983 [DequantizeLinear] inputs: [QuantLinearNode__982:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__980 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_35/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_35/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__983 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_35/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_35/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_35/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_35/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_35/BiasAdd/ReadVariableOp__391 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_35/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_35/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/conv2d_35/quantize_and_dequantize_1:0 -> (32, 32, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_35/BiasAdd/ReadVariableOp__391 -> (32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 32, 16, 16) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_35/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_35/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_35/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_35/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_35/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_35/BiasAdd:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_34/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_35/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_34/ReadVariableOp__392 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_34/ReadVariableOp_1__393 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_34/FusedBatchNormV3/ReadVariableOp__394 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_34/FusedBatchNormV3/ReadVariableOp_1__395 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_34/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_35/BiasAdd:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_34/ReadVariableOp__392 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_34/ReadVariableOp_1__393 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_34/FusedBatchNormV3/ReadVariableOp__394 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_34/FusedBatchNormV3/ReadVariableOp_1__395 -> (32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_34/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_34/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_34/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_34/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_34/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_34/FusedBatchNormV3:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/add_16/add [Add] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/identity_16/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_34/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_16/add [Add] inputs: [StatefulPartitionedCall/model/identity_16/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_34/FusedBatchNormV3:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/add_16/add for ONNX node: StatefulPartitionedCall/model/add_16/add [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/add_16/add:0 for ONNX tensor: StatefulPartitionedCall/model/add_16/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_16/add [Add] outputs: [StatefulPartitionedCall/model/add_16/add:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_34/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/add_16/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_34/Relu [Relu] inputs: [StatefulPartitionedCall/model/add_16/add:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_34/Relu for ONNX node: StatefulPartitionedCall/model/activation_34/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_34/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_34/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_34/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_34/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__994 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_34/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__992 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__994 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_34/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__992 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__994:0 for ONNX tensor: QuantLinearNode__994:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__994 [QuantizeLinear] outputs: [QuantLinearNode__994:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__990 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_34/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__992 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__990 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_34/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__992 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__990:0 for ONNX tensor: QuantLinearNode__990:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__990 [QuantizeLinear] outputs: [QuantLinearNode__990:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__995 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__994:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__992 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__995 [DequantizeLinear] inputs: [QuantLinearNode__994:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__992 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_36/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_36/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__995 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_36/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__991 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__990:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__992 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__991 [DequantizeLinear] inputs: [QuantLinearNode__990:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__992 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/identity_17/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/identity_17/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__991 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/identity_17/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_36/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_36/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_36/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_36/BiasAdd/ReadVariableOp__403 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_36/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_36/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/conv2d_36/quantize_and_dequantize_1:0 -> (32, 32, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_36/BiasAdd/ReadVariableOp__403 -> (32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 32, 16, 16) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_36/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_36/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_36/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_36/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_36/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_36/BiasAdd:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_35/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_36/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_35/ReadVariableOp__404 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_35/ReadVariableOp_1__405 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_35/FusedBatchNormV3/ReadVariableOp__406 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_35/FusedBatchNormV3/ReadVariableOp_1__407 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_35/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_36/BiasAdd:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_35/ReadVariableOp__404 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_35/ReadVariableOp_1__405 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_35/FusedBatchNormV3/ReadVariableOp__406 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_35/FusedBatchNormV3/ReadVariableOp_1__407 -> (32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_35/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_35/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_35/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_35/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_35/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_35/FusedBatchNormV3:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_35/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_35/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_35/Relu [Relu] inputs: [StatefulPartitionedCall/model/batch_normalization_35/FusedBatchNormV3:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_35/Relu for ONNX node: StatefulPartitionedCall/model/activation_35/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_35/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_35/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_35/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_35/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__1002 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_35/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1000 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1002 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_35/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__1000 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__1002:0 for ONNX tensor: QuantLinearNode__1002:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1002 [QuantizeLinear] outputs: [QuantLinearNode__1002:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__1003 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__1002:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1000 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1003 [DequantizeLinear] inputs: [QuantLinearNode__1002:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__1000 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_37/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_37/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1003 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_37/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_37/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_37/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_37/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_37/BiasAdd/ReadVariableOp__413 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_37/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_37/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/conv2d_37/quantize_and_dequantize_1:0 -> (32, 32, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_37/BiasAdd/ReadVariableOp__413 -> (32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 32, 16, 16) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_37/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_37/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_37/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_37/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_37/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_37/BiasAdd:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_36/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_37/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_36/ReadVariableOp__414 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_36/ReadVariableOp_1__415 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_36/FusedBatchNormV3/ReadVariableOp__416 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_36/FusedBatchNormV3/ReadVariableOp_1__417 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_36/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_37/BiasAdd:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_36/ReadVariableOp__414 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_36/ReadVariableOp_1__415 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_36/FusedBatchNormV3/ReadVariableOp__416 -> (32)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_36/FusedBatchNormV3/ReadVariableOp_1__417 -> (32)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_36/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_36/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_36/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_36/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_36/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_36/FusedBatchNormV3:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/add_17/add [Add] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/identity_17/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_36/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_17/add [Add] inputs: [StatefulPartitionedCall/model/identity_17/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_36/FusedBatchNormV3:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/add_17/add for ONNX node: StatefulPartitionedCall/model/add_17/add [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/add_17/add:0 for ONNX tensor: StatefulPartitionedCall/model/add_17/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_17/add [Add] outputs: [StatefulPartitionedCall/model/add_17/add:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_36/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/add_17/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_36/Relu [Relu] inputs: [StatefulPartitionedCall/model/add_17/add:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_36/Relu for ONNX node: StatefulPartitionedCall/model/activation_36/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_36/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_36/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_36/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_36/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__1022 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_36/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1008 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1022 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_36/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__1008 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__1022:0 for ONNX tensor: QuantLinearNode__1022:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1022 [QuantizeLinear] outputs: [QuantLinearNode__1022:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__1010 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_36/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1008 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1010 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_36/Relu:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__1008 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__1010:0 for ONNX tensor: QuantLinearNode__1010:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1010 [QuantizeLinear] outputs: [QuantLinearNode__1010:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__1023 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__1022:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1008 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1023 [DequantizeLinear] inputs: [QuantLinearNode__1022:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__1008 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_38/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_38/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1023 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_38/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__1011 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__1010:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1008 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1011 [DequantizeLinear] inputs: [QuantLinearNode__1010:0 -> (1, 32, 16, 16)[FLOAT]], [quant_scale__1008 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_40/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_40/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1011 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_40/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_38/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_38/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_38/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_38/BiasAdd/ReadVariableOp__431 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_38/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_38/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/conv2d_38/quantize_and_dequantize_1:0 -> (64, 32, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_38/BiasAdd/ReadVariableOp__431 -> (64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 32, 16, 16) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_38/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_38/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_38/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_38/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_38/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_38/BiasAdd:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_40/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_40/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_40/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_40/BiasAdd/ReadVariableOp__423 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_40/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_40/quantize_and_dequantize:0 -> (1, 32, 16, 16)[FLOAT]], [StatefulPartitionedCall/model/conv2d_40/quantize_and_dequantize_1:0 -> (64, 32, 1, 1)[FLOAT]], [StatefulPartitionedCall/model/conv2d_40/BiasAdd/ReadVariableOp__423 -> (64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 32, 16, 16) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_40/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_40/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_40/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_40/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_40/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_40/BiasAdd:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_37/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_38/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_37/ReadVariableOp__432 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_37/ReadVariableOp_1__433 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_37/FusedBatchNormV3/ReadVariableOp__434 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_37/FusedBatchNormV3/ReadVariableOp_1__435 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_37/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_38/BiasAdd:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_37/ReadVariableOp__432 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_37/ReadVariableOp_1__433 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_37/FusedBatchNormV3/ReadVariableOp__434 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_37/FusedBatchNormV3/ReadVariableOp_1__435 -> (64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_37/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_37/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_37/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_37/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_37/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_37/FusedBatchNormV3:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__1018 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_40/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1016 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1018 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/conv2d_40/BiasAdd:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1016 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__1018:0 for ONNX tensor: QuantLinearNode__1018:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1018 [QuantizeLinear] outputs: [QuantLinearNode__1018:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_37/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_37/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_37/Relu [Relu] inputs: [StatefulPartitionedCall/model/batch_normalization_37/FusedBatchNormV3:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_37/Relu for ONNX node: StatefulPartitionedCall/model/activation_37/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_37/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_37/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_37/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_37/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__1019 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__1018:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1016 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1019 [DequantizeLinear] inputs: [QuantLinearNode__1018:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1016 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/identity_18/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/identity_18/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1019 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/identity_18/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__1030 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_37/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1028 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1030 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_37/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1028 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__1030:0 for ONNX tensor: QuantLinearNode__1030:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1030 [QuantizeLinear] outputs: [QuantLinearNode__1030:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__1031 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__1030:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1028 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1031 [DequantizeLinear] inputs: [QuantLinearNode__1030:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1028 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_39/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_39/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1031 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_39/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_39/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_39/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_39/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_39/BiasAdd/ReadVariableOp__441 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_39/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_39/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/conv2d_39/quantize_and_dequantize_1:0 -> (64, 64, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_39/BiasAdd/ReadVariableOp__441 -> (64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 64, 8, 8) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_39/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_39/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_39/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_39/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_39/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_39/BiasAdd:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_38/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_39/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_38/ReadVariableOp__442 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_38/ReadVariableOp_1__443 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_38/FusedBatchNormV3/ReadVariableOp__444 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_38/FusedBatchNormV3/ReadVariableOp_1__445 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_38/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_39/BiasAdd:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_38/ReadVariableOp__442 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_38/ReadVariableOp_1__443 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_38/FusedBatchNormV3/ReadVariableOp__444 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_38/FusedBatchNormV3/ReadVariableOp_1__445 -> (64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_38/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_38/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_38/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_38/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_38/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_38/FusedBatchNormV3:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/add_18/add [Add] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/identity_18/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_38/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_18/add [Add] inputs: [StatefulPartitionedCall/model/identity_18/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_38/FusedBatchNormV3:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/add_18/add for ONNX node: StatefulPartitionedCall/model/add_18/add [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/add_18/add:0 for ONNX tensor: StatefulPartitionedCall/model/add_18/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_18/add [Add] outputs: [StatefulPartitionedCall/model/add_18/add:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_38/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/add_18/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_38/Relu [Relu] inputs: [StatefulPartitionedCall/model/add_18/add:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_38/Relu for ONNX node: StatefulPartitionedCall/model/activation_38/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_38/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_38/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_38/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_38/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__1042 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_38/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1040 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1042 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_38/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1040 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__1042:0 for ONNX tensor: QuantLinearNode__1042:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1042 [QuantizeLinear] outputs: [QuantLinearNode__1042:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__1038 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_38/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1040 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1038 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_38/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1040 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__1038:0 for ONNX tensor: QuantLinearNode__1038:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1038 [QuantizeLinear] outputs: [QuantLinearNode__1038:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__1043 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__1042:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1040 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1043 [DequantizeLinear] inputs: [QuantLinearNode__1042:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1040 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_41/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_41/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1043 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_41/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__1039 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__1038:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1040 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1039 [DequantizeLinear] inputs: [QuantLinearNode__1038:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1040 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/identity_19/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/identity_19/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1039 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/identity_19/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_41/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_41/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_41/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_41/BiasAdd/ReadVariableOp__453 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_41/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_41/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/conv2d_41/quantize_and_dequantize_1:0 -> (64, 64, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_41/BiasAdd/ReadVariableOp__453 -> (64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 64, 8, 8) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_41/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_41/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_41/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_41/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_41/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_41/BiasAdd:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_39/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_41/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_39/ReadVariableOp__454 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_39/ReadVariableOp_1__455 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_39/FusedBatchNormV3/ReadVariableOp__456 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_39/FusedBatchNormV3/ReadVariableOp_1__457 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_39/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_41/BiasAdd:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_39/ReadVariableOp__454 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_39/ReadVariableOp_1__455 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_39/FusedBatchNormV3/ReadVariableOp__456 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_39/FusedBatchNormV3/ReadVariableOp_1__457 -> (64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_39/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_39/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_39/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_39/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_39/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_39/FusedBatchNormV3:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_39/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_39/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_39/Relu [Relu] inputs: [StatefulPartitionedCall/model/batch_normalization_39/FusedBatchNormV3:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_39/Relu for ONNX node: StatefulPartitionedCall/model/activation_39/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_39/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_39/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_39/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_39/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__1050 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_39/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1048 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1050 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_39/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1048 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__1050:0 for ONNX tensor: QuantLinearNode__1050:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1050 [QuantizeLinear] outputs: [QuantLinearNode__1050:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__1051 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__1050:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1048 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1051 [DequantizeLinear] inputs: [QuantLinearNode__1050:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1048 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_42/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_42/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1051 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_42/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_42/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_42/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_42/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_42/BiasAdd/ReadVariableOp__463 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_42/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_42/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/conv2d_42/quantize_and_dequantize_1:0 -> (64, 64, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_42/BiasAdd/ReadVariableOp__463 -> (64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 64, 8, 8) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_42/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_42/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_42/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_42/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_42/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_42/BiasAdd:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_40/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_42/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_40/ReadVariableOp__464 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_40/ReadVariableOp_1__465 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_40/FusedBatchNormV3/ReadVariableOp__466 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_40/FusedBatchNormV3/ReadVariableOp_1__467 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_40/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_42/BiasAdd:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_40/ReadVariableOp__464 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_40/ReadVariableOp_1__465 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_40/FusedBatchNormV3/ReadVariableOp__466 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_40/FusedBatchNormV3/ReadVariableOp_1__467 -> (64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_40/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_40/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_40/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_40/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_40/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_40/FusedBatchNormV3:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/add_19/add [Add] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/identity_19/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_40/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_19/add [Add] inputs: [StatefulPartitionedCall/model/identity_19/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_40/FusedBatchNormV3:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/add_19/add for ONNX node: StatefulPartitionedCall/model/add_19/add [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/add_19/add:0 for ONNX tensor: StatefulPartitionedCall/model/add_19/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_19/add [Add] outputs: [StatefulPartitionedCall/model/add_19/add:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_40/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/add_19/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_40/Relu [Relu] inputs: [StatefulPartitionedCall/model/add_19/add:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_40/Relu for ONNX node: StatefulPartitionedCall/model/activation_40/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_40/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_40/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_40/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_40/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__1062 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_40/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1060 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1062 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_40/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1060 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__1062:0 for ONNX tensor: QuantLinearNode__1062:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1062 [QuantizeLinear] outputs: [QuantLinearNode__1062:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__1058 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_40/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1060 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1058 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_40/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1060 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__1058:0 for ONNX tensor: QuantLinearNode__1058:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1058 [QuantizeLinear] outputs: [QuantLinearNode__1058:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__1063 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__1062:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1060 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1063 [DequantizeLinear] inputs: [QuantLinearNode__1062:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1060 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_43/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_43/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1063 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_43/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__1059 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__1058:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1060 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1059 [DequantizeLinear] inputs: [QuantLinearNode__1058:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1060 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/identity_20/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/identity_20/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1059 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/identity_20/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_43/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_43/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_43/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_43/BiasAdd/ReadVariableOp__475 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_43/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_43/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/conv2d_43/quantize_and_dequantize_1:0 -> (64, 64, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_43/BiasAdd/ReadVariableOp__475 -> (64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 64, 8, 8) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_43/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_43/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_43/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_43/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_43/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_43/BiasAdd:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_41/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_43/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_41/ReadVariableOp__476 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_41/ReadVariableOp_1__477 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_41/FusedBatchNormV3/ReadVariableOp__478 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_41/FusedBatchNormV3/ReadVariableOp_1__479 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_41/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_43/BiasAdd:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_41/ReadVariableOp__476 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_41/ReadVariableOp_1__477 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_41/FusedBatchNormV3/ReadVariableOp__478 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_41/FusedBatchNormV3/ReadVariableOp_1__479 -> (64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_41/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_41/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_41/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_41/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_41/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_41/FusedBatchNormV3:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_41/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_41/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_41/Relu [Relu] inputs: [StatefulPartitionedCall/model/batch_normalization_41/FusedBatchNormV3:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_41/Relu for ONNX node: StatefulPartitionedCall/model/activation_41/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_41/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_41/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_41/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_41/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__1070 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_41/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1068 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1070 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_41/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1068 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__1070:0 for ONNX tensor: QuantLinearNode__1070:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1070 [QuantizeLinear] outputs: [QuantLinearNode__1070:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__1071 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__1070:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1068 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1071 [DequantizeLinear] inputs: [QuantLinearNode__1070:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1068 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_44/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_44/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1071 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_44/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_44/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_44/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_44/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_44/BiasAdd/ReadVariableOp__485 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_44/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_44/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/conv2d_44/quantize_and_dequantize_1:0 -> (64, 64, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_44/BiasAdd/ReadVariableOp__485 -> (64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 64, 8, 8) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_44/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_44/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_44/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_44/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_44/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_44/BiasAdd:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_42/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_44/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_42/ReadVariableOp__486 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_42/ReadVariableOp_1__487 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_42/FusedBatchNormV3/ReadVariableOp__488 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_42/FusedBatchNormV3/ReadVariableOp_1__489 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_42/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_44/BiasAdd:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_42/ReadVariableOp__486 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_42/ReadVariableOp_1__487 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_42/FusedBatchNormV3/ReadVariableOp__488 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_42/FusedBatchNormV3/ReadVariableOp_1__489 -> (64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_42/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_42/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_42/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_42/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_42/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_42/FusedBatchNormV3:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/add_20/add [Add] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/identity_20/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_42/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_20/add [Add] inputs: [StatefulPartitionedCall/model/identity_20/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_42/FusedBatchNormV3:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/add_20/add for ONNX node: StatefulPartitionedCall/model/add_20/add [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/add_20/add:0 for ONNX tensor: StatefulPartitionedCall/model/add_20/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_20/add [Add] outputs: [StatefulPartitionedCall/model/add_20/add:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_42/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/add_20/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_42/Relu [Relu] inputs: [StatefulPartitionedCall/model/add_20/add:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_42/Relu for ONNX node: StatefulPartitionedCall/model/activation_42/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_42/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_42/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_42/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_42/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__1082 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_42/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1076 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1082 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_42/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1076 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__1082:0 for ONNX tensor: QuantLinearNode__1082:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1082 [QuantizeLinear] outputs: [QuantLinearNode__1082:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__1078 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_42/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1076 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1078 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_42/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1076 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__1078:0 for ONNX tensor: QuantLinearNode__1078:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1078 [QuantizeLinear] outputs: [QuantLinearNode__1078:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__1083 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__1082:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1076 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1083 [DequantizeLinear] inputs: [QuantLinearNode__1082:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1076 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_45/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_45/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1083 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_45/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__1079 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__1078:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1076 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1079 [DequantizeLinear] inputs: [QuantLinearNode__1078:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1076 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/identity_21/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/identity_21/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1079 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/identity_21/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_45/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_45/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_45/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_45/BiasAdd/ReadVariableOp__497 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_45/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_45/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/conv2d_45/quantize_and_dequantize_1:0 -> (64, 64, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_45/BiasAdd/ReadVariableOp__497 -> (64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 64, 8, 8) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_45/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_45/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_45/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_45/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_45/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_45/BiasAdd:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_43/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_45/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_43/ReadVariableOp__498 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_43/ReadVariableOp_1__499 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_43/FusedBatchNormV3/ReadVariableOp__500 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_43/FusedBatchNormV3/ReadVariableOp_1__501 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_43/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_45/BiasAdd:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_43/ReadVariableOp__498 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_43/ReadVariableOp_1__499 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_43/FusedBatchNormV3/ReadVariableOp__500 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_43/FusedBatchNormV3/ReadVariableOp_1__501 -> (64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_43/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_43/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_43/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_43/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_43/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_43/FusedBatchNormV3:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_43/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_43/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_43/Relu [Relu] inputs: [StatefulPartitionedCall/model/batch_normalization_43/FusedBatchNormV3:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_43/Relu for ONNX node: StatefulPartitionedCall/model/activation_43/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_43/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_43/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_43/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_43/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__1090 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_43/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1088 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1090 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_43/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1088 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__1090:0 for ONNX tensor: QuantLinearNode__1090:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1090 [QuantizeLinear] outputs: [QuantLinearNode__1090:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__1091 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__1090:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1088 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1091 [DequantizeLinear] inputs: [QuantLinearNode__1090:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1088 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_46/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_46/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1091 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_46/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_46/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_46/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_46/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_46/BiasAdd/ReadVariableOp__507 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_46/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_46/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/conv2d_46/quantize_and_dequantize_1:0 -> (64, 64, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_46/BiasAdd/ReadVariableOp__507 -> (64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 64, 8, 8) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_46/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_46/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_46/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_46/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_46/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_46/BiasAdd:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_44/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_46/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_44/ReadVariableOp__508 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_44/ReadVariableOp_1__509 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_44/FusedBatchNormV3/ReadVariableOp__510 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_44/FusedBatchNormV3/ReadVariableOp_1__511 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_44/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_46/BiasAdd:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_44/ReadVariableOp__508 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_44/ReadVariableOp_1__509 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_44/FusedBatchNormV3/ReadVariableOp__510 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_44/FusedBatchNormV3/ReadVariableOp_1__511 -> (64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_44/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_44/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_44/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_44/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_44/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_44/FusedBatchNormV3:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/add_21/add [Add] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/identity_21/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_44/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_21/add [Add] inputs: [StatefulPartitionedCall/model/identity_21/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_44/FusedBatchNormV3:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/add_21/add for ONNX node: StatefulPartitionedCall/model/add_21/add [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/add_21/add:0 for ONNX tensor: StatefulPartitionedCall/model/add_21/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_21/add [Add] outputs: [StatefulPartitionedCall/model/add_21/add:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_44/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/add_21/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_44/Relu [Relu] inputs: [StatefulPartitionedCall/model/add_21/add:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_44/Relu for ONNX node: StatefulPartitionedCall/model/activation_44/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_44/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_44/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_44/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_44/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__1102 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_44/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1096 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1102 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_44/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1096 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__1102:0 for ONNX tensor: QuantLinearNode__1102:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1102 [QuantizeLinear] outputs: [QuantLinearNode__1102:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__1098 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_44/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1096 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1098 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_44/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1096 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__1098:0 for ONNX tensor: QuantLinearNode__1098:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1098 [QuantizeLinear] outputs: [QuantLinearNode__1098:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__1103 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__1102:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1096 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1103 [DequantizeLinear] inputs: [QuantLinearNode__1102:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1096 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_47/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_47/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1103 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_47/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__1099 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__1098:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1096 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1099 [DequantizeLinear] inputs: [QuantLinearNode__1098:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1096 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/identity_22/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/identity_22/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1099 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/identity_22/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_47/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_47/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_47/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_47/BiasAdd/ReadVariableOp__519 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_47/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_47/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/conv2d_47/quantize_and_dequantize_1:0 -> (64, 64, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_47/BiasAdd/ReadVariableOp__519 -> (64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 64, 8, 8) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_47/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_47/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_47/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_47/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_47/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_47/BiasAdd:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_45/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_47/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_45/ReadVariableOp__520 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_45/ReadVariableOp_1__521 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_45/FusedBatchNormV3/ReadVariableOp__522 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_45/FusedBatchNormV3/ReadVariableOp_1__523 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_45/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_47/BiasAdd:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_45/ReadVariableOp__520 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_45/ReadVariableOp_1__521 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_45/FusedBatchNormV3/ReadVariableOp__522 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_45/FusedBatchNormV3/ReadVariableOp_1__523 -> (64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_45/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_45/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_45/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_45/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_45/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_45/FusedBatchNormV3:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_45/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_45/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_45/Relu [Relu] inputs: [StatefulPartitionedCall/model/batch_normalization_45/FusedBatchNormV3:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_45/Relu for ONNX node: StatefulPartitionedCall/model/activation_45/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_45/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_45/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_45/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_45/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__1110 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_45/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1108 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1110 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_45/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1108 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__1110:0 for ONNX tensor: QuantLinearNode__1110:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1110 [QuantizeLinear] outputs: [QuantLinearNode__1110:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__1111 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__1110:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1108 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1111 [DequantizeLinear] inputs: [QuantLinearNode__1110:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1108 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_48/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_48/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1111 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_48/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_48/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_48/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_48/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_48/BiasAdd/ReadVariableOp__529 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_48/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_48/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/conv2d_48/quantize_and_dequantize_1:0 -> (64, 64, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_48/BiasAdd/ReadVariableOp__529 -> (64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 64, 8, 8) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_48/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_48/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_48/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_48/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_48/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_48/BiasAdd:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_46/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_48/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_46/ReadVariableOp__530 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_46/ReadVariableOp_1__531 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_46/FusedBatchNormV3/ReadVariableOp__532 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_46/FusedBatchNormV3/ReadVariableOp_1__533 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_46/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_48/BiasAdd:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_46/ReadVariableOp__530 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_46/ReadVariableOp_1__531 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_46/FusedBatchNormV3/ReadVariableOp__532 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_46/FusedBatchNormV3/ReadVariableOp_1__533 -> (64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_46/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_46/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_46/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_46/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_46/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_46/FusedBatchNormV3:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/add_22/add [Add] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/identity_22/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_46/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_22/add [Add] inputs: [StatefulPartitionedCall/model/identity_22/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_46/FusedBatchNormV3:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/add_22/add for ONNX node: StatefulPartitionedCall/model/add_22/add [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/add_22/add:0 for ONNX tensor: StatefulPartitionedCall/model/add_22/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_22/add [Add] outputs: [StatefulPartitionedCall/model/add_22/add:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_46/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/add_22/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_46/Relu [Relu] inputs: [StatefulPartitionedCall/model/add_22/add:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_46/Relu for ONNX node: StatefulPartitionedCall/model/activation_46/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_46/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_46/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_46/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_46/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__1122 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_46/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1120 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1122 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_46/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1120 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__1122:0 for ONNX tensor: QuantLinearNode__1122:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1122 [QuantizeLinear] outputs: [QuantLinearNode__1122:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__1118 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_46/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1120 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1118 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_46/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1120 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__1118:0 for ONNX tensor: QuantLinearNode__1118:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1118 [QuantizeLinear] outputs: [QuantLinearNode__1118:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__1123 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__1122:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1120 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1123 [DequantizeLinear] inputs: [QuantLinearNode__1122:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1120 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_49/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_49/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1123 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_49/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__1119 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__1118:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1120 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1119 [DequantizeLinear] inputs: [QuantLinearNode__1118:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1120 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/identity_23/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/identity_23/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1119 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/identity_23/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_49/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_49/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_49/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_49/BiasAdd/ReadVariableOp__541 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_49/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_49/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/conv2d_49/quantize_and_dequantize_1:0 -> (64, 64, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_49/BiasAdd/ReadVariableOp__541 -> (64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 64, 8, 8) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_49/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_49/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_49/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_49/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_49/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_49/BiasAdd:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_47/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_49/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_47/ReadVariableOp__542 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_47/ReadVariableOp_1__543 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_47/FusedBatchNormV3/ReadVariableOp__544 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_47/FusedBatchNormV3/ReadVariableOp_1__545 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_47/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_49/BiasAdd:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_47/ReadVariableOp__542 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_47/ReadVariableOp_1__543 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_47/FusedBatchNormV3/ReadVariableOp__544 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_47/FusedBatchNormV3/ReadVariableOp_1__545 -> (64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_47/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_47/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_47/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_47/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_47/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_47/FusedBatchNormV3:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_47/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_47/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_47/Relu [Relu] inputs: [StatefulPartitionedCall/model/batch_normalization_47/FusedBatchNormV3:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_47/Relu for ONNX node: StatefulPartitionedCall/model/activation_47/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_47/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_47/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_47/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_47/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__1130 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_47/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1128 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1130 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_47/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1128 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__1130:0 for ONNX tensor: QuantLinearNode__1130:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1130 [QuantizeLinear] outputs: [QuantLinearNode__1130:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__1131 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__1130:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1128 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1131 [DequantizeLinear] inputs: [QuantLinearNode__1130:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1128 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_50/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_50/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1131 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_50/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_50/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_50/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_50/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_50/BiasAdd/ReadVariableOp__551 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_50/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_50/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/conv2d_50/quantize_and_dequantize_1:0 -> (64, 64, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_50/BiasAdd/ReadVariableOp__551 -> (64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 64, 8, 8) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_50/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_50/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_50/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_50/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_50/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_50/BiasAdd:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_48/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_50/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_48/ReadVariableOp__552 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_48/ReadVariableOp_1__553 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_48/FusedBatchNormV3/ReadVariableOp__554 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_48/FusedBatchNormV3/ReadVariableOp_1__555 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_48/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_50/BiasAdd:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_48/ReadVariableOp__552 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_48/ReadVariableOp_1__553 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_48/FusedBatchNormV3/ReadVariableOp__554 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_48/FusedBatchNormV3/ReadVariableOp_1__555 -> (64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_48/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_48/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_48/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_48/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_48/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_48/FusedBatchNormV3:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/add_23/add [Add] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/identity_23/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_48/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_23/add [Add] inputs: [StatefulPartitionedCall/model/identity_23/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_48/FusedBatchNormV3:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/add_23/add for ONNX node: StatefulPartitionedCall/model/add_23/add [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/add_23/add:0 for ONNX tensor: StatefulPartitionedCall/model/add_23/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_23/add [Add] outputs: [StatefulPartitionedCall/model/add_23/add:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_48/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/add_23/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_48/Relu [Relu] inputs: [StatefulPartitionedCall/model/add_23/add:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_48/Relu for ONNX node: StatefulPartitionedCall/model/activation_48/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_48/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_48/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_48/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_48/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__1142 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_48/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1136 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1142 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_48/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1136 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__1142:0 for ONNX tensor: QuantLinearNode__1142:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1142 [QuantizeLinear] outputs: [QuantLinearNode__1142:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__1138 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_48/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1136 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1138 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_48/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1136 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__1138:0 for ONNX tensor: QuantLinearNode__1138:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1138 [QuantizeLinear] outputs: [QuantLinearNode__1138:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__1143 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__1142:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1136 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1143 [DequantizeLinear] inputs: [QuantLinearNode__1142:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1136 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_51/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_51/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1143 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_51/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__1139 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__1138:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1136 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1139 [DequantizeLinear] inputs: [QuantLinearNode__1138:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1136 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/identity_24/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/identity_24/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1139 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/identity_24/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_51/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_51/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_51/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_51/BiasAdd/ReadVariableOp__563 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_51/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_51/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/conv2d_51/quantize_and_dequantize_1:0 -> (64, 64, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_51/BiasAdd/ReadVariableOp__563 -> (64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 64, 8, 8) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_51/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_51/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_51/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_51/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_51/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_51/BiasAdd:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_49/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_51/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_49/ReadVariableOp__564 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_49/ReadVariableOp_1__565 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_49/FusedBatchNormV3/ReadVariableOp__566 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_49/FusedBatchNormV3/ReadVariableOp_1__567 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_49/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_51/BiasAdd:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_49/ReadVariableOp__564 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_49/ReadVariableOp_1__565 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_49/FusedBatchNormV3/ReadVariableOp__566 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_49/FusedBatchNormV3/ReadVariableOp_1__567 -> (64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_49/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_49/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_49/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_49/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_49/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_49/FusedBatchNormV3:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_49/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_49/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_49/Relu [Relu] inputs: [StatefulPartitionedCall/model/batch_normalization_49/FusedBatchNormV3:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_49/Relu for ONNX node: StatefulPartitionedCall/model/activation_49/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_49/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_49/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_49/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_49/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__1150 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_49/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1148 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1150 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_49/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1148 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__1150:0 for ONNX tensor: QuantLinearNode__1150:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1150 [QuantizeLinear] outputs: [QuantLinearNode__1150:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__1151 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__1150:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1148 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1151 [DequantizeLinear] inputs: [QuantLinearNode__1150:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1148 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_52/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_52/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1151 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_52/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_52/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_52/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_52/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_52/BiasAdd/ReadVariableOp__573 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_52/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_52/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/conv2d_52/quantize_and_dequantize_1:0 -> (64, 64, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_52/BiasAdd/ReadVariableOp__573 -> (64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 64, 8, 8) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_52/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_52/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_52/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_52/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_52/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_52/BiasAdd:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_50/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_52/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_50/ReadVariableOp__574 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_50/ReadVariableOp_1__575 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_50/FusedBatchNormV3/ReadVariableOp__576 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_50/FusedBatchNormV3/ReadVariableOp_1__577 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_50/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_52/BiasAdd:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_50/ReadVariableOp__574 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_50/ReadVariableOp_1__575 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_50/FusedBatchNormV3/ReadVariableOp__576 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_50/FusedBatchNormV3/ReadVariableOp_1__577 -> (64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_50/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_50/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_50/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_50/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_50/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_50/FusedBatchNormV3:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/add_24/add [Add] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/identity_24/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_50/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_24/add [Add] inputs: [StatefulPartitionedCall/model/identity_24/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_50/FusedBatchNormV3:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/add_24/add for ONNX node: StatefulPartitionedCall/model/add_24/add [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/add_24/add:0 for ONNX tensor: StatefulPartitionedCall/model/add_24/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_24/add [Add] outputs: [StatefulPartitionedCall/model/add_24/add:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_50/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/add_24/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_50/Relu [Relu] inputs: [StatefulPartitionedCall/model/add_24/add:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_50/Relu for ONNX node: StatefulPartitionedCall/model/activation_50/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_50/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_50/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_50/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_50/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__1162 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_50/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1160 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1162 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_50/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1160 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__1162:0 for ONNX tensor: QuantLinearNode__1162:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1162 [QuantizeLinear] outputs: [QuantLinearNode__1162:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__1158 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_50/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1160 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1158 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_50/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1160 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__1158:0 for ONNX tensor: QuantLinearNode__1158:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1158 [QuantizeLinear] outputs: [QuantLinearNode__1158:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__1163 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__1162:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1160 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1163 [DequantizeLinear] inputs: [QuantLinearNode__1162:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1160 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_53/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_53/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1163 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_53/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__1159 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__1158:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1160 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1159 [DequantizeLinear] inputs: [QuantLinearNode__1158:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1160 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/identity_25/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/identity_25/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1159 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/identity_25/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_53/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_53/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_53/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_53/BiasAdd/ReadVariableOp__585 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_53/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_53/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/conv2d_53/quantize_and_dequantize_1:0 -> (64, 64, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_53/BiasAdd/ReadVariableOp__585 -> (64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 64, 8, 8) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_53/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_53/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_53/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_53/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_53/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_53/BiasAdd:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_51/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_53/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_51/ReadVariableOp__586 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_51/ReadVariableOp_1__587 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_51/FusedBatchNormV3/ReadVariableOp__588 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_51/FusedBatchNormV3/ReadVariableOp_1__589 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_51/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_53/BiasAdd:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_51/ReadVariableOp__586 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_51/ReadVariableOp_1__587 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_51/FusedBatchNormV3/ReadVariableOp__588 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_51/FusedBatchNormV3/ReadVariableOp_1__589 -> (64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_51/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_51/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_51/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_51/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_51/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_51/FusedBatchNormV3:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_51/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_51/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_51/Relu [Relu] inputs: [StatefulPartitionedCall/model/batch_normalization_51/FusedBatchNormV3:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_51/Relu for ONNX node: StatefulPartitionedCall/model/activation_51/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_51/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_51/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_51/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_51/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__1170 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_51/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1168 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1170 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_51/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1168 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__1170:0 for ONNX tensor: QuantLinearNode__1170:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1170 [QuantizeLinear] outputs: [QuantLinearNode__1170:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__1171 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__1170:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1168 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1171 [DequantizeLinear] inputs: [QuantLinearNode__1170:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1168 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_54/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_54/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1171 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_54/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_54/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_54/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_54/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_54/BiasAdd/ReadVariableOp__595 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_54/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_54/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/conv2d_54/quantize_and_dequantize_1:0 -> (64, 64, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_54/BiasAdd/ReadVariableOp__595 -> (64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 64, 8, 8) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_54/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_54/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_54/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_54/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_54/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_54/BiasAdd:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_52/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_54/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_52/ReadVariableOp__596 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_52/ReadVariableOp_1__597 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_52/FusedBatchNormV3/ReadVariableOp__598 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_52/FusedBatchNormV3/ReadVariableOp_1__599 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_52/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_54/BiasAdd:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_52/ReadVariableOp__596 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_52/ReadVariableOp_1__597 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_52/FusedBatchNormV3/ReadVariableOp__598 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_52/FusedBatchNormV3/ReadVariableOp_1__599 -> (64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_52/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_52/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_52/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_52/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_52/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_52/FusedBatchNormV3:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/add_25/add [Add] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/identity_25/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_52/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_25/add [Add] inputs: [StatefulPartitionedCall/model/identity_25/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_52/FusedBatchNormV3:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/add_25/add for ONNX node: StatefulPartitionedCall/model/add_25/add [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/add_25/add:0 for ONNX tensor: StatefulPartitionedCall/model/add_25/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_25/add [Add] outputs: [StatefulPartitionedCall/model/add_25/add:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_52/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/add_25/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_52/Relu [Relu] inputs: [StatefulPartitionedCall/model/add_25/add:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_52/Relu for ONNX node: StatefulPartitionedCall/model/activation_52/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_52/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_52/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_52/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_52/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__1182 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_52/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1180 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1182 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_52/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1180 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__1182:0 for ONNX tensor: QuantLinearNode__1182:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1182 [QuantizeLinear] outputs: [QuantLinearNode__1182:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__1178 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_52/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1180 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1178 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_52/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1180 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__1178:0 for ONNX tensor: QuantLinearNode__1178:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1178 [QuantizeLinear] outputs: [QuantLinearNode__1178:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__1183 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__1182:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1180 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1183 [DequantizeLinear] inputs: [QuantLinearNode__1182:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1180 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_55/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_55/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1183 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_55/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__1179 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__1178:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1180 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1179 [DequantizeLinear] inputs: [QuantLinearNode__1178:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1180 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/identity_26/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/identity_26/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1179 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/identity_26/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_55/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_55/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_55/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_55/BiasAdd/ReadVariableOp__607 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_55/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_55/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/conv2d_55/quantize_and_dequantize_1:0 -> (64, 64, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_55/BiasAdd/ReadVariableOp__607 -> (64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 64, 8, 8) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_55/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_55/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_55/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_55/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_55/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_55/BiasAdd:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_53/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_55/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_53/ReadVariableOp__608 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_53/ReadVariableOp_1__609 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_53/FusedBatchNormV3/ReadVariableOp__610 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_53/FusedBatchNormV3/ReadVariableOp_1__611 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_53/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_55/BiasAdd:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_53/ReadVariableOp__608 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_53/ReadVariableOp_1__609 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_53/FusedBatchNormV3/ReadVariableOp__610 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_53/FusedBatchNormV3/ReadVariableOp_1__611 -> (64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_53/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_53/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_53/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_53/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_53/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_53/FusedBatchNormV3:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_53/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_53/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_53/Relu [Relu] inputs: [StatefulPartitionedCall/model/batch_normalization_53/FusedBatchNormV3:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_53/Relu for ONNX node: StatefulPartitionedCall/model/activation_53/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_53/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_53/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_53/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_53/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__1190 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_53/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1188 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1190 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_53/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1188 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__1190:0 for ONNX tensor: QuantLinearNode__1190:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1190 [QuantizeLinear] outputs: [QuantLinearNode__1190:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__1191 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__1190:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1188 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1191 [DequantizeLinear] inputs: [QuantLinearNode__1190:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1188 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_56/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_56/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1191 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/conv2d_56/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/conv2d_56/BiasAdd [Conv] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_56/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_56/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_56/BiasAdd/ReadVariableOp__617 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_56/BiasAdd [Conv] inputs: [StatefulPartitionedCall/model/conv2d_56/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/conv2d_56/quantize_and_dequantize_1:0 -> (64, 64, 3, 3)[FLOAT]], [StatefulPartitionedCall/model/conv2d_56/BiasAdd/ReadVariableOp__617 -> (64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Convolution input dimensions: (1, 64, 8, 8) [10/12/2021-21:20:00] [V] [TRT] Kernel weights are not set yet. Kernel weights must be set using setInput(1, kernel_tensor) API call. [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/conv2d_56/BiasAdd for ONNX node: StatefulPartitionedCall/model/conv2d_56/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/conv2d_56/BiasAdd:0 for ONNX tensor: StatefulPartitionedCall/model/conv2d_56/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/conv2d_56/BiasAdd [Conv] outputs: [StatefulPartitionedCall/model/conv2d_56/BiasAdd:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/batch_normalization_54/FusedBatchNormV3 [BatchNormalization] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/conv2d_56/BiasAdd:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_54/ReadVariableOp__618 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_54/ReadVariableOp_1__619 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_54/FusedBatchNormV3/ReadVariableOp__620 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_54/FusedBatchNormV3/ReadVariableOp_1__621 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_54/FusedBatchNormV3 [BatchNormalization] inputs: [StatefulPartitionedCall/model/conv2d_56/BiasAdd:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_54/ReadVariableOp__618 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_54/ReadVariableOp_1__619 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_54/FusedBatchNormV3/ReadVariableOp__620 -> (64)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_54/FusedBatchNormV3/ReadVariableOp_1__621 -> (64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/batch_normalization_54/FusedBatchNormV3 for ONNX node: StatefulPartitionedCall/model/batch_normalization_54/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/batch_normalization_54/FusedBatchNormV3:0 for ONNX tensor: StatefulPartitionedCall/model/batch_normalization_54/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/batch_normalization_54/FusedBatchNormV3 [BatchNormalization] outputs: [StatefulPartitionedCall/model/batch_normalization_54/FusedBatchNormV3:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/add_26/add [Add] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/identity_26/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/batch_normalization_54/FusedBatchNormV3:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_26/add [Add] inputs: [StatefulPartitionedCall/model/identity_26/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [StatefulPartitionedCall/model/batch_normalization_54/FusedBatchNormV3:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/add_26/add for ONNX node: StatefulPartitionedCall/model/add_26/add [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/add_26/add:0 for ONNX tensor: StatefulPartitionedCall/model/add_26/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/add_26/add [Add] outputs: [StatefulPartitionedCall/model/add_26/add:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/activation_54/Relu [Relu] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/add_26/add:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_54/Relu [Relu] inputs: [StatefulPartitionedCall/model/add_26/add:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/activation_54/Relu for ONNX node: StatefulPartitionedCall/model/activation_54/Relu [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/activation_54/Relu:0 for ONNX tensor: StatefulPartitionedCall/model/activation_54/Relu:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/activation_54/Relu [Relu] outputs: [StatefulPartitionedCall/model/activation_54/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: QuantLinearNode__1198 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/activation_54/Relu:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1196 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1198 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/activation_54/Relu:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1196 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: QuantLinearNode__1198:0 for ONNX tensor: QuantLinearNode__1198:0 [10/12/2021-21:20:00] [V] [TRT] QuantLinearNode__1198 [QuantizeLinear] outputs: [QuantLinearNode__1198:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__1199 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: QuantLinearNode__1198:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1196 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1199 [DequantizeLinear] inputs: [QuantLinearNode__1198:0 -> (1, 64, 8, 8)[FLOAT]], [quant_scale__1196 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/identity_27/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/identity_27/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1199 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/identity_27/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/global_average_pooling2d/Mean [GlobalAveragePool] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/identity_27/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/global_average_pooling2d/Mean [GlobalAveragePool] inputs: [StatefulPartitionedCall/model/identity_27/quantize_and_dequantize:0 -> (1, 64, 8, 8)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/global_average_pooling2d/Mean for ONNX node: StatefulPartitionedCall/model/global_average_pooling2d/Mean [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/global_average_pooling2d/Mean:0 for ONNX tensor: StatefulPartitionedCall/model/global_average_pooling2d/Mean:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/global_average_pooling2d/Mean [GlobalAveragePool] outputs: [StatefulPartitionedCall/model/global_average_pooling2d/Mean:0 -> (1, 64, 1, 1)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/global_average_pooling2d/Mean_Squeeze__2038 [Squeeze] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/global_average_pooling2d/Mean:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: const_axes__2037 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/global_average_pooling2d/Mean_Squeeze__2038 [Squeeze] inputs: [StatefulPartitionedCall/model/global_average_pooling2d/Mean:0 -> (1, 64, 1, 1)[FLOAT]], [const_axes__2037 -> (2)[INT32]], [10/12/2021-21:20:00] [V] [TRT] Original shape: (1, 64, 1, 1), squeezing to: (1, 64) [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/global_average_pooling2d/Mean_Squeeze__2038 for ONNX node: StatefulPartitionedCall/model/global_average_pooling2d/Mean_Squeeze__2038 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/global_average_pooling2d/Mean_Squeeze__2038:0 for ONNX tensor: StatefulPartitionedCall/model/global_average_pooling2d/Mean_Squeeze__2038:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/global_average_pooling2d/Mean_Squeeze__2038 [Squeeze] outputs: [StatefulPartitionedCall/model/global_average_pooling2d/Mean_Squeeze__2038:0 -> (1, 64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: StatefulPartitionedCall/model/global_average_pooling2d/Mean_Squeeze__2038_QuantizeLinear__2039 [QuantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/global_average_pooling2d/Mean_Squeeze__2038:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1200 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/global_average_pooling2d/Mean_Squeeze__2038_QuantizeLinear__2039 [QuantizeLinear] inputs: [StatefulPartitionedCall/model/global_average_pooling2d/Mean_Squeeze__2038:0 -> (1, 64)[FLOAT]], [quant_scale__1200 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/global_average_pooling2d/Mean_Squeeze__2038_QuantizeLinear__2039:0 for ONNX tensor: StatefulPartitionedCall/model/global_average_pooling2d/Mean_Squeeze__2038_QuantizeLinear__2039:0 [10/12/2021-21:20:00] [V] [TRT] StatefulPartitionedCall/model/global_average_pooling2d/Mean_Squeeze__2038_QuantizeLinear__2039 [QuantizeLinear] outputs: [StatefulPartitionedCall/model/global_average_pooling2d/Mean_Squeeze__2038_QuantizeLinear__2039:0 -> (1, 64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: DequantLinearNode__1203 [DequantizeLinear] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/global_average_pooling2d/Mean_Squeeze__2038_QuantizeLinear__2039:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: quant_scale__1200 [10/12/2021-21:20:00] [V] [TRT] Searching for input: zero_point__933 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1203 [DequantizeLinear] inputs: [StatefulPartitionedCall/model/global_average_pooling2d/Mean_Squeeze__2038_QuantizeLinear__2039:0 -> (1, 64)[FLOAT]], [quant_scale__1200 -> ()[FLOAT]], [zero_point__933 -> ()[INT8]], [10/12/2021-21:20:00] [V] [TRT] Registering tensor: StatefulPartitionedCall/model/dense/quantize_and_dequantize:0 for ONNX tensor: StatefulPartitionedCall/model/dense/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] DequantLinearNode__1203 [DequantizeLinear] outputs: [StatefulPartitionedCall/model/dense/quantize_and_dequantize:0 -> (1, 64)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Parsing node: node_of_dense [Gemm] [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/dense/quantize_and_dequantize:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/dense/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Searching for input: StatefulPartitionedCall/model/dense/BiasAdd/ReadVariableOp__629 [10/12/2021-21:20:00] [V] [TRT] node_of_dense [Gemm] inputs: [StatefulPartitionedCall/model/dense/quantize_and_dequantize:0 -> (1, 64)[FLOAT]], [StatefulPartitionedCall/model/dense/quantize_and_dequantize_1:0 -> (64, 10)[FLOAT]], [StatefulPartitionedCall/model/dense/BiasAdd/ReadVariableOp__629 -> (10)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Using opA: 0 opB: 0 [10/12/2021-21:20:00] [V] [TRT] GEMM: A, after squeezing: (1, 64) [10/12/2021-21:20:00] [V] [TRT] Registering layer: node_of_dense for ONNX node: node_of_dense [10/12/2021-21:20:00] [V] [TRT] Registering layer: StatefulPartitionedCall/model/dense/BiasAdd/ReadVariableOp__629 for ONNX node: StatefulPartitionedCall/model/dense/BiasAdd/ReadVariableOp__629 [10/12/2021-21:20:00] [V] [TRT] Registering tensor: dense_0 for ONNX tensor: dense [10/12/2021-21:20:00] [V] [TRT] node_of_dense [Gemm] outputs: [dense -> (1, 10)[FLOAT]], [10/12/2021-21:20:00] [V] [TRT] Marking dense_0 as output: dense [10/12/2021-21:20:00] [I] Finish parsing network model [10/12/2021-21:20:00] [I] [TRT] [MemUsageChange] Init CUDA: CPU +0, GPU +0, now: CPU 9060, GPU 977 (MiB) [10/12/2021-21:20:00] [I] [TRT] [MemUsageSnapshot] Builder begin: CPU 9060 MiB, GPU 979 MiB [10/12/2021-21:20:00] [10/12/2021-21:20:00] [10/12/2021-21:20:00] [V] [TRT] Applying generic optimizations to the graph for inference. [10/12/2021-21:20:00] [V] [TRT] Original: 1122 layers [10/12/2021-21:20:00] [V] [TRT] After dead-layer removal: 1122 layers [10/12/2021-21:20:00] [V] [TRT] QDQ graph optimizer - constant folding of Q/DQ initializers [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 2) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 10) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 9) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 18) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 17) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 26) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 25) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 34) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 33) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 42) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 41) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 50) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 49) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 58) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 57) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 66) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 65) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 74) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 73) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 82) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 81) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 90) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 89) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 98) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 97) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 106) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 105) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 114) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 113) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 122) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 121) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 130) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 129) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 138) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 137) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 146) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 145) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 153) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 152) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 161) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 160) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 169) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 168) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 177) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 176) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 185) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 184) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 193) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 192) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 201) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 200) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 209) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 208) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 217) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 216) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 225) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 224) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 233) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 232) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 239) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 238) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 245) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 244) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 251) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 250) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 257) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 256) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 263) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 262) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 269) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 268) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 275) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 274) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 281) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 280) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 287) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 286) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 293) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 292) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 299) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 298) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 305) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 304) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 311) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 310) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 317) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 316) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 323) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 322) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 329) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 328) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 335) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 334) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 341) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 340) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 347) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 346) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 353) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 352) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 359) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 358) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 365) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 364) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 371) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 370) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 377) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 376) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 383) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 382) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 389) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 388) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 395) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 394) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 401) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 400) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 407) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 406) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 416) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 415) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 422) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 421) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 431) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 430) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 441) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 440) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 447) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 446) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 456) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 455) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 466) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 465) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 472) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 471) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 481) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 480) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 491) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 490) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 497) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 496) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 506) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 505) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 516) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 515) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 522) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 521) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 531) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 530) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 541) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 540) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 547) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 546) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 556) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 555) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 566) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 565) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 572) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 571) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 581) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 580) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 591) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 590) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 597) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 596) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 606) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 605) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 616) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 615) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 622) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 621) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 631) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 630) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 641) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 640) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 647) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 646) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 656) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 655) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 660) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 659) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 666) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 665) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 673) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 672) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 679) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 678) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 688) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 687) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 698) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 697) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 704) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 703) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 713) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 712) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 723) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 722) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 729) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 728) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 738) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 737) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 748) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 747) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 754) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 753) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 763) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 762) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 773) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 772) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 779) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 778) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 788) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 787) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 798) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 797) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 804) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 803) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 813) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 812) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 823) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 822) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 829) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 828) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 838) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 837) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 848) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 847) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 854) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 853) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 863) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 862) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 873) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 872) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 879) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 878) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 888) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 887) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 892) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 891) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 898) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 897) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 905) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 904) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 911) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 910) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 920) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 919) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 930) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 929) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 936) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 935) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 945) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 944) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 955) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 954) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 961) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 960) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 970) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 969) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 980) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 979) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 986) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 985) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 995) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 994) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1005) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1004) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1011) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1010) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1020) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1019) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1030) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1029) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1036) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1035) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1045) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1044) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1055) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1054) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1061) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1060) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1070) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1069) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1080) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1079) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1086) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1085) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1095) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1094) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1105) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1104) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1113) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1112) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 6) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 5) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 14) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 13) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 22) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 21) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 30) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 29) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 38) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 37) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 46) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 45) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 54) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 53) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 62) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 61) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 70) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 69) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 78) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 77) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 86) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 85) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 94) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 93) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 102) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 101) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 110) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 109) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 118) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 117) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 126) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 125) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 134) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 133) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 142) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 141) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 149) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 148) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 157) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 156) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 165) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 164) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 173) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 172) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 181) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 180) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 189) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 188) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 197) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 196) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 205) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 204) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 213) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 212) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 221) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 220) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 229) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 228) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 236) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 235) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 242) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 241) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 248) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 247) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 254) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 253) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 260) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 259) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 266) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 265) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 272) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 271) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 278) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 277) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 284) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 283) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 290) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 289) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 296) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 295) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 302) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 301) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 308) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 307) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 314) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 313) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 320) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 319) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 326) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 325) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 332) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 331) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 338) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 337) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 344) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 343) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 350) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 349) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 356) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 355) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 362) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 361) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 368) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 367) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 374) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 373) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 380) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 379) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 386) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 385) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 392) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 391) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 398) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 397) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 404) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 403) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 410) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 409) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 419) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 418) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 425) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 424) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 434) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 433) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 444) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 443) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 450) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 449) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 459) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 458) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 469) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 468) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 475) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 474) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 484) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 483) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 494) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 493) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 500) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 499) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 509) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 508) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 519) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 518) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 525) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 524) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 534) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 533) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 544) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 543) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 550) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 549) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 559) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 558) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 569) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 568) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 575) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 574) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 584) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 583) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 594) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 593) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 600) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 599) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 609) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 608) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 619) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 618) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 625) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 624) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 634) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 633) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 644) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 643) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 650) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 649) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 663) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 662) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 676) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 675) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 682) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 681) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 691) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 690) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 701) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 700) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 707) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 706) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 716) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 715) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 726) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 725) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 732) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 731) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 741) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 740) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 751) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 750) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 757) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 756) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 766) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 765) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 776) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 775) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 782) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 781) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 791) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 790) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 801) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 800) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 807) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 806) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 816) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 815) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 826) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 825) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 832) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 831) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 841) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 840) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 851) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 850) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 857) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 856) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 866) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 865) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 876) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 875) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 882) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 881) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 895) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 894) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 908) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 907) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 914) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 913) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 923) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 922) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 933) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 932) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 939) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 938) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 948) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 947) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 958) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 957) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 964) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 963) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 973) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 972) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 983) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 982) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 989) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 988) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 998) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 997) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1008) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1007) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1014) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1013) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1023) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1022) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1033) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1032) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1039) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1038) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1048) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1047) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1058) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1057) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1064) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1063) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1073) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1072) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1083) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1082) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1089) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1088) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1098) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1097) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1108) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1107) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1116) [Constant] [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1115) [Constant] [10/12/2021-21:20:00] [V] [TRT] ConstShuffleFusion: Fusing StatefulPartitionedCall/model/dense/BiasAdd/ReadVariableOp__629 with (Unnamed Layer* 1120) [Shuffle] [10/12/2021-21:20:00] [V] [TRT] After Myelin optimization: 545 layers [10/12/2021-21:20:00] [V] [TRT] After scale fusion: 545 layers [10/12/2021-21:20:00] [V] [TRT] QDQ graph optimizer - constant folding of Q/DQ initializers [10/12/2021-21:20:00] [V] [TRT] QDQ graph optimizer forward pass - DQ motions and fusions [10/12/2021-21:20:00] [V] [TRT] EltReluFusion: Fusing StatefulPartitionedCall/model/add/add with StatefulPartitionedCall/model/activation_2/Relu [10/12/2021-21:20:00] [V] [TRT] EltReluFusion: Fusing StatefulPartitionedCall/model/add_1/add with StatefulPartitionedCall/model/activation_4/Relu [10/12/2021-21:20:00] [V] [TRT] EltReluFusion: Fusing StatefulPartitionedCall/model/add_2/add with StatefulPartitionedCall/model/activation_6/Relu [10/12/2021-21:20:00] [V] [TRT] EltReluFusion: Fusing StatefulPartitionedCall/model/add_3/add with StatefulPartitionedCall/model/activation_8/Relu [10/12/2021-21:20:00] [V] [TRT] EltReluFusion: Fusing StatefulPartitionedCall/model/add_4/add with StatefulPartitionedCall/model/activation_10/Relu [10/12/2021-21:20:00] [V] [TRT] EltReluFusion: Fusing StatefulPartitionedCall/model/add_5/add with StatefulPartitionedCall/model/activation_12/Relu [10/12/2021-21:20:00] [V] [TRT] EltReluFusion: Fusing StatefulPartitionedCall/model/add_6/add with StatefulPartitionedCall/model/activation_14/Relu [10/12/2021-21:20:00] [V] [TRT] EltReluFusion: Fusing StatefulPartitionedCall/model/add_7/add with StatefulPartitionedCall/model/activation_16/Relu [10/12/2021-21:20:00] [V] [TRT] EltReluFusion: Fusing StatefulPartitionedCall/model/add_8/add with StatefulPartitionedCall/model/activation_18/Relu [10/12/2021-21:20:00] [V] [TRT] EltReluFusion: Fusing StatefulPartitionedCall/model/add_9/add with StatefulPartitionedCall/model/activation_20/Relu [10/12/2021-21:20:00] [V] [TRT] EltReluFusion: Fusing StatefulPartitionedCall/model/add_10/add with StatefulPartitionedCall/model/activation_22/Relu [10/12/2021-21:20:00] [V] [TRT] EltReluFusion: Fusing StatefulPartitionedCall/model/add_11/add with StatefulPartitionedCall/model/activation_24/Relu [10/12/2021-21:20:00] [V] [TRT] EltReluFusion: Fusing StatefulPartitionedCall/model/add_12/add with StatefulPartitionedCall/model/activation_26/Relu [10/12/2021-21:20:00] [V] [TRT] EltReluFusion: Fusing StatefulPartitionedCall/model/add_13/add with StatefulPartitionedCall/model/activation_28/Relu [10/12/2021-21:20:00] [V] [TRT] EltReluFusion: Fusing StatefulPartitionedCall/model/add_14/add with StatefulPartitionedCall/model/activation_30/Relu [10/12/2021-21:20:00] [V] [TRT] EltReluFusion: Fusing StatefulPartitionedCall/model/add_15/add with StatefulPartitionedCall/model/activation_32/Relu [10/12/2021-21:20:00] [V] [TRT] EltReluFusion: Fusing StatefulPartitionedCall/model/add_16/add with StatefulPartitionedCall/model/activation_34/Relu [10/12/2021-21:20:00] [V] [TRT] EltReluFusion: Fusing StatefulPartitionedCall/model/add_17/add with StatefulPartitionedCall/model/activation_36/Relu [10/12/2021-21:20:00] [V] [TRT] EltReluFusion: Fusing StatefulPartitionedCall/model/add_18/add with StatefulPartitionedCall/model/activation_38/Relu [10/12/2021-21:20:00] [V] [TRT] EltReluFusion: Fusing StatefulPartitionedCall/model/add_19/add with StatefulPartitionedCall/model/activation_40/Relu [10/12/2021-21:20:00] [V] [TRT] EltReluFusion: Fusing StatefulPartitionedCall/model/add_20/add with StatefulPartitionedCall/model/activation_42/Relu [10/12/2021-21:20:00] [V] [TRT] EltReluFusion: Fusing StatefulPartitionedCall/model/add_21/add with StatefulPartitionedCall/model/activation_44/Relu [10/12/2021-21:20:00] [V] [TRT] EltReluFusion: Fusing StatefulPartitionedCall/model/add_22/add with StatefulPartitionedCall/model/activation_46/Relu [10/12/2021-21:20:00] [V] [TRT] EltReluFusion: Fusing StatefulPartitionedCall/model/add_23/add with StatefulPartitionedCall/model/activation_48/Relu [10/12/2021-21:20:00] [V] [TRT] EltReluFusion: Fusing StatefulPartitionedCall/model/add_24/add with StatefulPartitionedCall/model/activation_50/Relu [10/12/2021-21:20:00] [V] [TRT] EltReluFusion: Fusing StatefulPartitionedCall/model/add_25/add with StatefulPartitionedCall/model/activation_52/Relu [10/12/2021-21:20:00] [V] [TRT] EltReluFusion: Fusing StatefulPartitionedCall/model/add_26/add with StatefulPartitionedCall/model/activation_54/Relu [10/12/2021-21:20:00] [V] [TRT] Convert layer node_of_dense from MATRIX_MULTIPLY to FULLY_CONNECTED [10/12/2021-21:20:00] [V] [TRT] Removing (Unnamed Layer* 1121) [ElementWise] [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/dense/BiasAdd/ReadVariableOp__629 + (Unnamed Layer* 1120) [Shuffle] [10/12/2021-21:20:00] [V] [TRT] Swap the layer type of StatefulPartitionedCall/model/global_average_pooling2d/Mean from REDUCE to POOLING [10/12/2021-21:20:00] [V] [TRT] Swapping DequantLinearNode__1207_quantize_scale_node with shuffle_after_StatefulPartitionedCall/model/dense/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_36/transpose__400 with QuantLinearNode__998_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_35/transpose__388 with QuantLinearNode__986_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_34/transpose__378 with QuantLinearNode__978_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_33/transpose__366 with QuantLinearNode__966_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_32/transpose__356 with QuantLinearNode__958_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_31/transpose__344 with QuantLinearNode__946_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_30/transpose__334 with QuantLinearNode__938_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_29/transpose__322 with QuantLinearNode__926_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_28/transpose__312 with QuantLinearNode__918_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_27/transpose__300 with QuantLinearNode__906_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_26/transpose__290 with QuantLinearNode__898_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_25/transpose__278 with QuantLinearNode__886_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_24/transpose__268 with QuantLinearNode__878_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_23/transpose__256 with QuantLinearNode__866_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_22/transpose__246 with QuantLinearNode__858_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_20/transpose__234 with QuantLinearNode__846_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_19/transpose__224 with QuantLinearNode__838_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_21/transpose__216 with QuantLinearNode__826_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_18/transpose__206 with QuantLinearNode__818_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_17/transpose__196 with QuantLinearNode__810_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_16/transpose__184 with QuantLinearNode__798_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_15/transpose__174 with QuantLinearNode__790_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_14/transpose__162 with QuantLinearNode__778_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_13/transpose__152 with QuantLinearNode__770_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_12/transpose__140 with QuantLinearNode__758_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_11/transpose__130 with QuantLinearNode__750_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_10/transpose__118 with QuantLinearNode__738_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_9/transpose__108 with QuantLinearNode__730_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_8/transpose__96 with QuantLinearNode__718_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_7/transpose__86 with QuantLinearNode__710_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_6/transpose__74 with QuantLinearNode__698_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_5/transpose__64 with QuantLinearNode__690_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_4/transpose__52 with QuantLinearNode__678_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_3/transpose__42 with QuantLinearNode__670_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_2/transpose__30 with QuantLinearNode__658_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_1/transpose__20 with QuantLinearNode__650_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d/transpose__8 with QuantLinearNode__638_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/dense/quantize_and_dequantize_1/ReadVariableOp__626 with QuantLinearNode__1206_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_56/transpose__614 with QuantLinearNode__1194_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_55/transpose__604 with QuantLinearNode__1186_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_54/transpose__592 with QuantLinearNode__1174_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_53/transpose__582 with QuantLinearNode__1166_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_52/transpose__570 with QuantLinearNode__1154_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_51/transpose__560 with QuantLinearNode__1146_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_50/transpose__548 with QuantLinearNode__1134_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_49/transpose__538 with QuantLinearNode__1126_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_48/transpose__526 with QuantLinearNode__1114_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_47/transpose__516 with QuantLinearNode__1106_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_46/transpose__504 with QuantLinearNode__1094_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_45/transpose__494 with QuantLinearNode__1086_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_44/transpose__482 with QuantLinearNode__1074_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_43/transpose__472 with QuantLinearNode__1066_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_42/transpose__460 with QuantLinearNode__1054_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_41/transpose__450 with QuantLinearNode__1046_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_39/transpose__438 with QuantLinearNode__1034_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_38/transpose__428 with QuantLinearNode__1026_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_40/transpose__420 with QuantLinearNode__1014_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsQuantizeFusion: Fusing StatefulPartitionedCall/model/conv2d_37/transpose__410 with QuantLinearNode__1006_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstShuffleFusion: Fusing StatefulPartitionedCall/model/dense/quantize_and_dequantize_1/ReadVariableOp__626 + QuantLinearNode__1206_quantize_scale_node with shuffle_after_StatefulPartitionedCall/model/dense/quantize_and_dequantize_1:0 [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/activation_1/Relu with QuantLinearNode__654_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/activation_3/Relu with QuantLinearNode__674_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/activation_5/Relu with QuantLinearNode__694_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/activation_7/Relu with QuantLinearNode__714_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/activation_9/Relu with QuantLinearNode__734_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/activation_11/Relu with QuantLinearNode__754_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/activation_13/Relu with QuantLinearNode__774_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/activation_15/Relu with QuantLinearNode__794_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/activation_17/Relu with QuantLinearNode__814_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/activation_19/Relu with QuantLinearNode__842_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/activation_21/Relu with QuantLinearNode__862_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/activation_23/Relu with QuantLinearNode__882_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/activation_25/Relu with QuantLinearNode__902_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/activation_27/Relu with QuantLinearNode__922_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/activation_29/Relu with QuantLinearNode__942_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/activation_31/Relu with QuantLinearNode__962_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/activation_33/Relu with QuantLinearNode__982_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/activation_35/Relu with QuantLinearNode__1002_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/activation_37/Relu with QuantLinearNode__1030_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/activation_39/Relu with QuantLinearNode__1050_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/activation_41/Relu with QuantLinearNode__1070_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/activation_43/Relu with QuantLinearNode__1090_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/activation_45/Relu with QuantLinearNode__1110_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/activation_47/Relu with QuantLinearNode__1130_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/activation_49/Relu with QuantLinearNode__1150_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/activation_51/Relu with QuantLinearNode__1170_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/activation_53/Relu with QuantLinearNode__1190_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/global_average_pooling2d/Mean_Squeeze__2038 with StatefulPartitionedCall/model/global_average_pooling2d/Mean_Squeeze__2038_QuantizeLinear__2039_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Eliminating QuantLinearNode__642_quantize_scale_node which duplicates (Q) QuantLinearNode__646_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__642_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Eliminating QuantLinearNode__662_quantize_scale_node which duplicates (Q) QuantLinearNode__666_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__662_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Eliminating QuantLinearNode__682_quantize_scale_node which duplicates (Q) QuantLinearNode__686_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__682_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Eliminating QuantLinearNode__702_quantize_scale_node which duplicates (Q) QuantLinearNode__706_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__702_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Eliminating QuantLinearNode__722_quantize_scale_node which duplicates (Q) QuantLinearNode__726_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__722_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Eliminating QuantLinearNode__742_quantize_scale_node which duplicates (Q) QuantLinearNode__746_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__742_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Eliminating QuantLinearNode__762_quantize_scale_node which duplicates (Q) QuantLinearNode__766_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__762_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Eliminating QuantLinearNode__782_quantize_scale_node which duplicates (Q) QuantLinearNode__786_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__782_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Eliminating QuantLinearNode__802_quantize_scale_node which duplicates (Q) QuantLinearNode__806_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__802_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Eliminating QuantLinearNode__822_quantize_scale_node which duplicates (Q) QuantLinearNode__834_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__822_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Eliminating QuantLinearNode__850_quantize_scale_node which duplicates (Q) QuantLinearNode__854_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__850_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Eliminating QuantLinearNode__870_quantize_scale_node which duplicates (Q) QuantLinearNode__874_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__870_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Eliminating QuantLinearNode__890_quantize_scale_node which duplicates (Q) QuantLinearNode__894_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__890_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Eliminating QuantLinearNode__910_quantize_scale_node which duplicates (Q) QuantLinearNode__914_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__910_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Eliminating QuantLinearNode__930_quantize_scale_node which duplicates (Q) QuantLinearNode__934_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__930_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Eliminating QuantLinearNode__950_quantize_scale_node which duplicates (Q) QuantLinearNode__954_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__950_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Eliminating QuantLinearNode__970_quantize_scale_node which duplicates (Q) QuantLinearNode__974_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__970_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Eliminating QuantLinearNode__990_quantize_scale_node which duplicates (Q) QuantLinearNode__994_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__990_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Eliminating QuantLinearNode__1010_quantize_scale_node which duplicates (Q) QuantLinearNode__1022_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__1010_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Eliminating QuantLinearNode__1038_quantize_scale_node which duplicates (Q) QuantLinearNode__1042_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__1038_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Eliminating QuantLinearNode__1058_quantize_scale_node which duplicates (Q) QuantLinearNode__1062_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__1058_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Eliminating QuantLinearNode__1078_quantize_scale_node which duplicates (Q) QuantLinearNode__1082_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__1078_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Eliminating QuantLinearNode__1098_quantize_scale_node which duplicates (Q) QuantLinearNode__1102_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__1098_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Eliminating QuantLinearNode__1118_quantize_scale_node which duplicates (Q) QuantLinearNode__1122_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__1118_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Eliminating QuantLinearNode__1138_quantize_scale_node which duplicates (Q) QuantLinearNode__1142_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__1138_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Eliminating QuantLinearNode__1158_quantize_scale_node which duplicates (Q) QuantLinearNode__1162_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__1158_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Eliminating QuantLinearNode__1178_quantize_scale_node which duplicates (Q) QuantLinearNode__1182_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__1178_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/activation/Relu with QuantLinearNode__646_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QDQ graph optimizer quantization pass - Generate quantized ops [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_1/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_2/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_3/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_4/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_5/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_6/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_7/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_8/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_9/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_10/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_11/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_12/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_13/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_14/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_15/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_16/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_17/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_18/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_19/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_20/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_21/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_22/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_23/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_24/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_25/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_26/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_27/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_28/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_29/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_30/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_31/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_32/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_33/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_34/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_35/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_36/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_37/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_38/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_39/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_40/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_41/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_42/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_43/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_44/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_45/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_46/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_47/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_48/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_49/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_50/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_51/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_52/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_53/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/batch_normalization_54/FusedBatchNormV3 [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/add/add + StatefulPartitionedCall/model/activation_2/Relu with QuantLinearNode__666_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__666_quantize_scale_node into StatefulPartitionedCall/model/conv2d_2/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__655_quantize_scale_node and DequantLinearNode__659_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_2/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__666_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__655_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__659_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_2/transpose__30 + QuantLinearNode__658_quantize_scale_node with StatefulPartitionedCall/model/conv2d_2/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/model/conv2d_2/transpose__30 + QuantLinearNode__658_quantize_scale_node + StatefulPartitionedCall/model/conv2d_2/BiasAdd with StatefulPartitionedCall/model/add/add + StatefulPartitionedCall/model/activation_2/Relu [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__643_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/add_1/add + StatefulPartitionedCall/model/activation_4/Relu with QuantLinearNode__686_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__686_quantize_scale_node into StatefulPartitionedCall/model/conv2d_4/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__675_quantize_scale_node and DequantLinearNode__679_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_4/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__686_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__675_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__679_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_4/transpose__52 + QuantLinearNode__678_quantize_scale_node with StatefulPartitionedCall/model/conv2d_4/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/model/conv2d_4/transpose__52 + QuantLinearNode__678_quantize_scale_node + StatefulPartitionedCall/model/conv2d_4/BiasAdd with StatefulPartitionedCall/model/add_1/add + StatefulPartitionedCall/model/activation_4/Relu [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__663_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/add_2/add + StatefulPartitionedCall/model/activation_6/Relu with QuantLinearNode__706_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__706_quantize_scale_node into StatefulPartitionedCall/model/conv2d_6/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__695_quantize_scale_node and DequantLinearNode__699_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_6/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__706_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__695_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__699_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_6/transpose__74 + QuantLinearNode__698_quantize_scale_node with StatefulPartitionedCall/model/conv2d_6/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/model/conv2d_6/transpose__74 + QuantLinearNode__698_quantize_scale_node + StatefulPartitionedCall/model/conv2d_6/BiasAdd with StatefulPartitionedCall/model/add_2/add + StatefulPartitionedCall/model/activation_6/Relu [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__683_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/add_3/add + StatefulPartitionedCall/model/activation_8/Relu with QuantLinearNode__726_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__726_quantize_scale_node into StatefulPartitionedCall/model/conv2d_8/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__715_quantize_scale_node and DequantLinearNode__719_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_8/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__726_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__715_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__719_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_8/transpose__96 + QuantLinearNode__718_quantize_scale_node with StatefulPartitionedCall/model/conv2d_8/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/model/conv2d_8/transpose__96 + QuantLinearNode__718_quantize_scale_node + StatefulPartitionedCall/model/conv2d_8/BiasAdd with StatefulPartitionedCall/model/add_3/add + StatefulPartitionedCall/model/activation_8/Relu [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__703_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/add_4/add + StatefulPartitionedCall/model/activation_10/Relu with QuantLinearNode__746_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__746_quantize_scale_node into StatefulPartitionedCall/model/conv2d_10/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__735_quantize_scale_node and DequantLinearNode__739_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_10/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__746_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__735_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__739_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_10/transpose__118 + QuantLinearNode__738_quantize_scale_node with StatefulPartitionedCall/model/conv2d_10/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/model/conv2d_10/transpose__118 + QuantLinearNode__738_quantize_scale_node + StatefulPartitionedCall/model/conv2d_10/BiasAdd with StatefulPartitionedCall/model/add_4/add + StatefulPartitionedCall/model/activation_10/Relu [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__723_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/add_5/add + StatefulPartitionedCall/model/activation_12/Relu with QuantLinearNode__766_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__766_quantize_scale_node into StatefulPartitionedCall/model/conv2d_12/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__755_quantize_scale_node and DequantLinearNode__759_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_12/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__766_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__755_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__759_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_12/transpose__140 + QuantLinearNode__758_quantize_scale_node with StatefulPartitionedCall/model/conv2d_12/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/model/conv2d_12/transpose__140 + QuantLinearNode__758_quantize_scale_node + StatefulPartitionedCall/model/conv2d_12/BiasAdd with StatefulPartitionedCall/model/add_5/add + StatefulPartitionedCall/model/activation_12/Relu [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__743_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/add_6/add + StatefulPartitionedCall/model/activation_14/Relu with QuantLinearNode__786_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__786_quantize_scale_node into StatefulPartitionedCall/model/conv2d_14/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__775_quantize_scale_node and DequantLinearNode__779_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_14/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__786_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__775_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__779_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_14/transpose__162 + QuantLinearNode__778_quantize_scale_node with StatefulPartitionedCall/model/conv2d_14/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/model/conv2d_14/transpose__162 + QuantLinearNode__778_quantize_scale_node + StatefulPartitionedCall/model/conv2d_14/BiasAdd with StatefulPartitionedCall/model/add_6/add + StatefulPartitionedCall/model/activation_14/Relu [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__763_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/add_7/add + StatefulPartitionedCall/model/activation_16/Relu with QuantLinearNode__806_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__806_quantize_scale_node into StatefulPartitionedCall/model/conv2d_16/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__795_quantize_scale_node and DequantLinearNode__799_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_16/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__806_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__795_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__799_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_16/transpose__184 + QuantLinearNode__798_quantize_scale_node with StatefulPartitionedCall/model/conv2d_16/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/model/conv2d_16/transpose__184 + QuantLinearNode__798_quantize_scale_node + StatefulPartitionedCall/model/conv2d_16/BiasAdd with StatefulPartitionedCall/model/add_7/add + StatefulPartitionedCall/model/activation_16/Relu [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__783_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/add_8/add + StatefulPartitionedCall/model/activation_18/Relu with QuantLinearNode__834_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__834_quantize_scale_node into StatefulPartitionedCall/model/conv2d_18/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__815_quantize_scale_node and DequantLinearNode__819_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_18/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__834_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__815_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__819_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_18/transpose__206 + QuantLinearNode__818_quantize_scale_node with StatefulPartitionedCall/model/conv2d_18/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/model/conv2d_18/transpose__206 + QuantLinearNode__818_quantize_scale_node + StatefulPartitionedCall/model/conv2d_18/BiasAdd with StatefulPartitionedCall/model/add_8/add + StatefulPartitionedCall/model/activation_18/Relu [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__803_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/add_9/add + StatefulPartitionedCall/model/activation_20/Relu with QuantLinearNode__854_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__854_quantize_scale_node into StatefulPartitionedCall/model/conv2d_20/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__843_quantize_scale_node and DequantLinearNode__847_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_20/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__854_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__843_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__847_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_20/transpose__234 + QuantLinearNode__846_quantize_scale_node with StatefulPartitionedCall/model/conv2d_20/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/model/conv2d_20/transpose__234 + QuantLinearNode__846_quantize_scale_node + StatefulPartitionedCall/model/conv2d_20/BiasAdd with StatefulPartitionedCall/model/add_9/add + StatefulPartitionedCall/model/activation_20/Relu [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__831_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/add_10/add + StatefulPartitionedCall/model/activation_22/Relu with QuantLinearNode__874_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__874_quantize_scale_node into StatefulPartitionedCall/model/conv2d_23/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__863_quantize_scale_node and DequantLinearNode__867_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_23/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__874_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__863_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__867_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_23/transpose__256 + QuantLinearNode__866_quantize_scale_node with StatefulPartitionedCall/model/conv2d_23/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/model/conv2d_23/transpose__256 + QuantLinearNode__866_quantize_scale_node + StatefulPartitionedCall/model/conv2d_23/BiasAdd with StatefulPartitionedCall/model/add_10/add + StatefulPartitionedCall/model/activation_22/Relu [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__851_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/add_11/add + StatefulPartitionedCall/model/activation_24/Relu with QuantLinearNode__894_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__894_quantize_scale_node into StatefulPartitionedCall/model/conv2d_25/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__883_quantize_scale_node and DequantLinearNode__887_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_25/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__894_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__883_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__887_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_25/transpose__278 + QuantLinearNode__886_quantize_scale_node with StatefulPartitionedCall/model/conv2d_25/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/model/conv2d_25/transpose__278 + QuantLinearNode__886_quantize_scale_node + StatefulPartitionedCall/model/conv2d_25/BiasAdd with StatefulPartitionedCall/model/add_11/add + StatefulPartitionedCall/model/activation_24/Relu [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__871_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/add_12/add + StatefulPartitionedCall/model/activation_26/Relu with QuantLinearNode__914_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__914_quantize_scale_node into StatefulPartitionedCall/model/conv2d_27/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__903_quantize_scale_node and DequantLinearNode__907_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_27/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__914_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__903_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__907_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_27/transpose__300 + QuantLinearNode__906_quantize_scale_node with StatefulPartitionedCall/model/conv2d_27/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/model/conv2d_27/transpose__300 + QuantLinearNode__906_quantize_scale_node + StatefulPartitionedCall/model/conv2d_27/BiasAdd with StatefulPartitionedCall/model/add_12/add + StatefulPartitionedCall/model/activation_26/Relu [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__891_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/add_13/add + StatefulPartitionedCall/model/activation_28/Relu with QuantLinearNode__934_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__934_quantize_scale_node into StatefulPartitionedCall/model/conv2d_29/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__923_quantize_scale_node and DequantLinearNode__927_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_29/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__934_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__923_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__927_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_29/transpose__322 + QuantLinearNode__926_quantize_scale_node with StatefulPartitionedCall/model/conv2d_29/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/model/conv2d_29/transpose__322 + QuantLinearNode__926_quantize_scale_node + StatefulPartitionedCall/model/conv2d_29/BiasAdd with StatefulPartitionedCall/model/add_13/add + StatefulPartitionedCall/model/activation_28/Relu [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__911_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/add_14/add + StatefulPartitionedCall/model/activation_30/Relu with QuantLinearNode__954_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__954_quantize_scale_node into StatefulPartitionedCall/model/conv2d_31/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__943_quantize_scale_node and DequantLinearNode__947_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_31/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__954_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__943_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__947_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_31/transpose__344 + QuantLinearNode__946_quantize_scale_node with StatefulPartitionedCall/model/conv2d_31/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/model/conv2d_31/transpose__344 + QuantLinearNode__946_quantize_scale_node + StatefulPartitionedCall/model/conv2d_31/BiasAdd with StatefulPartitionedCall/model/add_14/add + StatefulPartitionedCall/model/activation_30/Relu [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__931_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/add_15/add + StatefulPartitionedCall/model/activation_32/Relu with QuantLinearNode__974_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__974_quantize_scale_node into StatefulPartitionedCall/model/conv2d_33/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__963_quantize_scale_node and DequantLinearNode__967_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_33/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__974_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__963_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__967_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_33/transpose__366 + QuantLinearNode__966_quantize_scale_node with StatefulPartitionedCall/model/conv2d_33/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/model/conv2d_33/transpose__366 + QuantLinearNode__966_quantize_scale_node + StatefulPartitionedCall/model/conv2d_33/BiasAdd with StatefulPartitionedCall/model/add_15/add + StatefulPartitionedCall/model/activation_32/Relu [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__951_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/add_16/add + StatefulPartitionedCall/model/activation_34/Relu with QuantLinearNode__994_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__994_quantize_scale_node into StatefulPartitionedCall/model/conv2d_35/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__983_quantize_scale_node and DequantLinearNode__987_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_35/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__994_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__983_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__987_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_35/transpose__388 + QuantLinearNode__986_quantize_scale_node with StatefulPartitionedCall/model/conv2d_35/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/model/conv2d_35/transpose__388 + QuantLinearNode__986_quantize_scale_node + StatefulPartitionedCall/model/conv2d_35/BiasAdd with StatefulPartitionedCall/model/add_16/add + StatefulPartitionedCall/model/activation_34/Relu [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__971_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/add_17/add + StatefulPartitionedCall/model/activation_36/Relu with QuantLinearNode__1022_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__1022_quantize_scale_node into StatefulPartitionedCall/model/conv2d_37/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__1003_quantize_scale_node and DequantLinearNode__1007_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_37/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__1022_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1003_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1007_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_37/transpose__410 + QuantLinearNode__1006_quantize_scale_node with StatefulPartitionedCall/model/conv2d_37/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/model/conv2d_37/transpose__410 + QuantLinearNode__1006_quantize_scale_node + StatefulPartitionedCall/model/conv2d_37/BiasAdd with StatefulPartitionedCall/model/add_17/add + StatefulPartitionedCall/model/activation_36/Relu [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__991_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/add_18/add + StatefulPartitionedCall/model/activation_38/Relu with QuantLinearNode__1042_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__1042_quantize_scale_node into StatefulPartitionedCall/model/conv2d_39/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__1031_quantize_scale_node and DequantLinearNode__1035_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_39/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__1042_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1031_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1035_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_39/transpose__438 + QuantLinearNode__1034_quantize_scale_node with StatefulPartitionedCall/model/conv2d_39/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/model/conv2d_39/transpose__438 + QuantLinearNode__1034_quantize_scale_node + StatefulPartitionedCall/model/conv2d_39/BiasAdd with StatefulPartitionedCall/model/add_18/add + StatefulPartitionedCall/model/activation_38/Relu [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1019_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/add_19/add + StatefulPartitionedCall/model/activation_40/Relu with QuantLinearNode__1062_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__1062_quantize_scale_node into StatefulPartitionedCall/model/conv2d_42/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__1051_quantize_scale_node and DequantLinearNode__1055_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_42/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__1062_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1051_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1055_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_42/transpose__460 + QuantLinearNode__1054_quantize_scale_node with StatefulPartitionedCall/model/conv2d_42/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/model/conv2d_42/transpose__460 + QuantLinearNode__1054_quantize_scale_node + StatefulPartitionedCall/model/conv2d_42/BiasAdd with StatefulPartitionedCall/model/add_19/add + StatefulPartitionedCall/model/activation_40/Relu [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1039_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/add_20/add + StatefulPartitionedCall/model/activation_42/Relu with QuantLinearNode__1082_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__1082_quantize_scale_node into StatefulPartitionedCall/model/conv2d_44/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__1071_quantize_scale_node and DequantLinearNode__1075_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_44/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__1082_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1071_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1075_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_44/transpose__482 + QuantLinearNode__1074_quantize_scale_node with StatefulPartitionedCall/model/conv2d_44/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/model/conv2d_44/transpose__482 + QuantLinearNode__1074_quantize_scale_node + StatefulPartitionedCall/model/conv2d_44/BiasAdd with StatefulPartitionedCall/model/add_20/add + StatefulPartitionedCall/model/activation_42/Relu [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1059_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/add_21/add + StatefulPartitionedCall/model/activation_44/Relu with QuantLinearNode__1102_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__1102_quantize_scale_node into StatefulPartitionedCall/model/conv2d_46/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__1091_quantize_scale_node and DequantLinearNode__1095_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_46/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__1102_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1091_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1095_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_46/transpose__504 + QuantLinearNode__1094_quantize_scale_node with StatefulPartitionedCall/model/conv2d_46/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/model/conv2d_46/transpose__504 + QuantLinearNode__1094_quantize_scale_node + StatefulPartitionedCall/model/conv2d_46/BiasAdd with StatefulPartitionedCall/model/add_21/add + StatefulPartitionedCall/model/activation_44/Relu [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1079_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/add_22/add + StatefulPartitionedCall/model/activation_46/Relu with QuantLinearNode__1122_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__1122_quantize_scale_node into StatefulPartitionedCall/model/conv2d_48/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__1111_quantize_scale_node and DequantLinearNode__1115_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_48/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__1122_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1111_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1115_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_48/transpose__526 + QuantLinearNode__1114_quantize_scale_node with StatefulPartitionedCall/model/conv2d_48/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/model/conv2d_48/transpose__526 + QuantLinearNode__1114_quantize_scale_node + StatefulPartitionedCall/model/conv2d_48/BiasAdd with StatefulPartitionedCall/model/add_22/add + StatefulPartitionedCall/model/activation_46/Relu [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1099_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/add_23/add + StatefulPartitionedCall/model/activation_48/Relu with QuantLinearNode__1142_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__1142_quantize_scale_node into StatefulPartitionedCall/model/conv2d_50/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__1131_quantize_scale_node and DequantLinearNode__1135_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_50/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__1142_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1131_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1135_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_50/transpose__548 + QuantLinearNode__1134_quantize_scale_node with StatefulPartitionedCall/model/conv2d_50/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/model/conv2d_50/transpose__548 + QuantLinearNode__1134_quantize_scale_node + StatefulPartitionedCall/model/conv2d_50/BiasAdd with StatefulPartitionedCall/model/add_23/add + StatefulPartitionedCall/model/activation_48/Relu [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1119_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/add_24/add + StatefulPartitionedCall/model/activation_50/Relu with QuantLinearNode__1162_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__1162_quantize_scale_node into StatefulPartitionedCall/model/conv2d_52/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__1151_quantize_scale_node and DequantLinearNode__1155_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_52/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__1162_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1151_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1155_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_52/transpose__570 + QuantLinearNode__1154_quantize_scale_node with StatefulPartitionedCall/model/conv2d_52/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/model/conv2d_52/transpose__570 + QuantLinearNode__1154_quantize_scale_node + StatefulPartitionedCall/model/conv2d_52/BiasAdd with StatefulPartitionedCall/model/add_24/add + StatefulPartitionedCall/model/activation_50/Relu [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1139_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/add_25/add + StatefulPartitionedCall/model/activation_52/Relu with QuantLinearNode__1182_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__1182_quantize_scale_node into StatefulPartitionedCall/model/conv2d_54/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__1171_quantize_scale_node and DequantLinearNode__1175_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_54/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__1182_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1171_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1175_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_54/transpose__592 + QuantLinearNode__1174_quantize_scale_node with StatefulPartitionedCall/model/conv2d_54/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/model/conv2d_54/transpose__592 + QuantLinearNode__1174_quantize_scale_node + StatefulPartitionedCall/model/conv2d_54/BiasAdd with StatefulPartitionedCall/model/add_25/add + StatefulPartitionedCall/model/activation_52/Relu [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1159_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Swapping StatefulPartitionedCall/model/add_26/add + StatefulPartitionedCall/model/activation_54/Relu with QuantLinearNode__1198_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__1198_quantize_scale_node into StatefulPartitionedCall/model/conv2d_56/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__1191_quantize_scale_node and DequantLinearNode__1195_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_56/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__1198_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1191_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1195_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_56/transpose__614 + QuantLinearNode__1194_quantize_scale_node with StatefulPartitionedCall/model/conv2d_56/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConvEltwiseSumFusion: Fusing StatefulPartitionedCall/model/conv2d_56/transpose__614 + QuantLinearNode__1194_quantize_scale_node + StatefulPartitionedCall/model/conv2d_56/BiasAdd with StatefulPartitionedCall/model/add_26/add + StatefulPartitionedCall/model/activation_54/Relu [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1179_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__646_quantize_scale_node into StatefulPartitionedCall/model/conv2d/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__635_quantize_scale_node and DequantLinearNode__639_quantize_scale_node) into StatefulPartitionedCall/model/conv2d/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__646_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__635_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__639_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__654_quantize_scale_node into StatefulPartitionedCall/model/conv2d_1/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__647_quantize_scale_node and DequantLinearNode__651_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_1/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__654_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__647_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__651_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__674_quantize_scale_node into StatefulPartitionedCall/model/conv2d_3/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__667_quantize_scale_node and DequantLinearNode__671_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_3/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__674_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__667_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__671_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__694_quantize_scale_node into StatefulPartitionedCall/model/conv2d_5/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__687_quantize_scale_node and DequantLinearNode__691_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_5/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__694_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__687_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__691_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__714_quantize_scale_node into StatefulPartitionedCall/model/conv2d_7/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__707_quantize_scale_node and DequantLinearNode__711_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_7/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__714_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__707_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__711_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__734_quantize_scale_node into StatefulPartitionedCall/model/conv2d_9/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__727_quantize_scale_node and DequantLinearNode__731_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_9/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__734_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__727_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__731_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__754_quantize_scale_node into StatefulPartitionedCall/model/conv2d_11/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__747_quantize_scale_node and DequantLinearNode__751_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_11/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__754_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__747_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__751_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__774_quantize_scale_node into StatefulPartitionedCall/model/conv2d_13/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__767_quantize_scale_node and DequantLinearNode__771_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_13/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__774_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__767_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__771_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__794_quantize_scale_node into StatefulPartitionedCall/model/conv2d_15/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__787_quantize_scale_node and DequantLinearNode__791_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_15/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__794_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__787_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__791_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__814_quantize_scale_node into StatefulPartitionedCall/model/conv2d_17/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__807_quantize_scale_node and DequantLinearNode__811_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_17/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__814_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__807_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__811_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__842_quantize_scale_node into StatefulPartitionedCall/model/conv2d_19/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__835_quantize_scale_node and DequantLinearNode__839_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_19/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__842_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__835_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__839_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__862_quantize_scale_node into StatefulPartitionedCall/model/conv2d_22/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__855_quantize_scale_node and DequantLinearNode__859_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_22/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__862_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__855_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__859_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__882_quantize_scale_node into StatefulPartitionedCall/model/conv2d_24/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__875_quantize_scale_node and DequantLinearNode__879_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_24/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__882_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__875_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__879_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__902_quantize_scale_node into StatefulPartitionedCall/model/conv2d_26/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__895_quantize_scale_node and DequantLinearNode__899_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_26/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__902_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__895_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__899_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__922_quantize_scale_node into StatefulPartitionedCall/model/conv2d_28/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__915_quantize_scale_node and DequantLinearNode__919_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_28/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__922_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__915_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__919_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__942_quantize_scale_node into StatefulPartitionedCall/model/conv2d_30/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__935_quantize_scale_node and DequantLinearNode__939_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_30/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__942_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__935_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__939_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__962_quantize_scale_node into StatefulPartitionedCall/model/conv2d_32/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__955_quantize_scale_node and DequantLinearNode__959_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_32/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__962_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__955_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__959_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__982_quantize_scale_node into StatefulPartitionedCall/model/conv2d_34/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__975_quantize_scale_node and DequantLinearNode__979_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_34/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__982_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__975_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__979_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__1002_quantize_scale_node into StatefulPartitionedCall/model/conv2d_36/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__995_quantize_scale_node and DequantLinearNode__999_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_36/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__1002_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__995_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__999_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__1030_quantize_scale_node into StatefulPartitionedCall/model/conv2d_38/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__1023_quantize_scale_node and DequantLinearNode__1027_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_38/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__1030_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1023_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1027_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__1050_quantize_scale_node into StatefulPartitionedCall/model/conv2d_41/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__1043_quantize_scale_node and DequantLinearNode__1047_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_41/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__1050_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1043_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1047_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__1070_quantize_scale_node into StatefulPartitionedCall/model/conv2d_43/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__1063_quantize_scale_node and DequantLinearNode__1067_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_43/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__1070_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1063_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1067_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__1090_quantize_scale_node into StatefulPartitionedCall/model/conv2d_45/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__1083_quantize_scale_node and DequantLinearNode__1087_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_45/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__1090_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1083_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1087_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__1110_quantize_scale_node into StatefulPartitionedCall/model/conv2d_47/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__1103_quantize_scale_node and DequantLinearNode__1107_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_47/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__1110_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1103_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1107_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__1130_quantize_scale_node into StatefulPartitionedCall/model/conv2d_49/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__1123_quantize_scale_node and DequantLinearNode__1127_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_49/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__1130_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1123_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1127_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__1150_quantize_scale_node into StatefulPartitionedCall/model/conv2d_51/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__1143_quantize_scale_node and DequantLinearNode__1147_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_51/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__1150_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1143_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1147_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__1170_quantize_scale_node into StatefulPartitionedCall/model/conv2d_53/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__1163_quantize_scale_node and DequantLinearNode__1167_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_53/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__1170_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1163_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1167_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__1190_quantize_scale_node into StatefulPartitionedCall/model/conv2d_55/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__1183_quantize_scale_node and DequantLinearNode__1187_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_55/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__1190_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1183_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1187_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__1203_quantize_scale_node and DequantLinearNode__1207_quantize_scale_node) into node_of_dense + to_FC [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1203_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1207_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__830_quantize_scale_node into StatefulPartitionedCall/model/conv2d_21/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__823_quantize_scale_node and DequantLinearNode__827_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_21/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__830_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__823_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__827_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing QuantLinearNode__1018_quantize_scale_node into StatefulPartitionedCall/model/conv2d_40/BiasAdd [10/12/2021-21:20:00] [V] [TRT] QuantizeDoubleInputNodes: fusing (DequantLinearNode__1011_quantize_scale_node and DequantLinearNode__1015_quantize_scale_node) into StatefulPartitionedCall/model/conv2d_40/BiasAdd [10/12/2021-21:20:00] [V] [TRT] Removing QuantLinearNode__1018_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1011_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1015_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing StatefulPartitionedCall/model/global_average_pooling2d/Mean_Squeeze__2038_QuantizeLinear__2039_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] Removing DequantLinearNode__1199_quantize_scale_node [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_36/transpose__400 + QuantLinearNode__998_quantize_scale_node with StatefulPartitionedCall/model/conv2d_36/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_34/transpose__378 + QuantLinearNode__978_quantize_scale_node with StatefulPartitionedCall/model/conv2d_34/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_32/transpose__356 + QuantLinearNode__958_quantize_scale_node with StatefulPartitionedCall/model/conv2d_32/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_30/transpose__334 + QuantLinearNode__938_quantize_scale_node with StatefulPartitionedCall/model/conv2d_30/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_28/transpose__312 + QuantLinearNode__918_quantize_scale_node with StatefulPartitionedCall/model/conv2d_28/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_26/transpose__290 + QuantLinearNode__898_quantize_scale_node with StatefulPartitionedCall/model/conv2d_26/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_24/transpose__268 + QuantLinearNode__878_quantize_scale_node with StatefulPartitionedCall/model/conv2d_24/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_22/transpose__246 + QuantLinearNode__858_quantize_scale_node with StatefulPartitionedCall/model/conv2d_22/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_19/transpose__224 + QuantLinearNode__838_quantize_scale_node with StatefulPartitionedCall/model/conv2d_19/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_21/transpose__216 + QuantLinearNode__826_quantize_scale_node with StatefulPartitionedCall/model/conv2d_21/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_17/transpose__196 + QuantLinearNode__810_quantize_scale_node with StatefulPartitionedCall/model/conv2d_17/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_15/transpose__174 + QuantLinearNode__790_quantize_scale_node with StatefulPartitionedCall/model/conv2d_15/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_13/transpose__152 + QuantLinearNode__770_quantize_scale_node with StatefulPartitionedCall/model/conv2d_13/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_11/transpose__130 + QuantLinearNode__750_quantize_scale_node with StatefulPartitionedCall/model/conv2d_11/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_9/transpose__108 + QuantLinearNode__730_quantize_scale_node with StatefulPartitionedCall/model/conv2d_9/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_7/transpose__86 + QuantLinearNode__710_quantize_scale_node with StatefulPartitionedCall/model/conv2d_7/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_5/transpose__64 + QuantLinearNode__690_quantize_scale_node with StatefulPartitionedCall/model/conv2d_5/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_3/transpose__42 + QuantLinearNode__670_quantize_scale_node with StatefulPartitionedCall/model/conv2d_3/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_1/transpose__20 + QuantLinearNode__650_quantize_scale_node with StatefulPartitionedCall/model/conv2d_1/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d/transpose__8 + QuantLinearNode__638_quantize_scale_node with StatefulPartitionedCall/model/conv2d/BiasAdd [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/dense/quantize_and_dequantize_1/ReadVariableOp__626 + QuantLinearNode__1206_quantize_scale_node + shuffle_after_StatefulPartitionedCall/model/dense/quantize_and_dequantize_1:0 with node_of_dense + to_FC [10/12/2021-21:20:00] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_55/transpose__604 + QuantLinearNode__1186_quantize_scale_node with StatefulPartitionedCall/model/conv2d_55/BiasAdd [10/12/2021-21:20:01] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_53/transpose__582 + QuantLinearNode__1166_quantize_scale_node with StatefulPartitionedCall/model/conv2d_53/BiasAdd [10/12/2021-21:20:01] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_51/transpose__560 + QuantLinearNode__1146_quantize_scale_node with StatefulPartitionedCall/model/conv2d_51/BiasAdd [10/12/2021-21:20:01] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_49/transpose__538 + QuantLinearNode__1126_quantize_scale_node with StatefulPartitionedCall/model/conv2d_49/BiasAdd [10/12/2021-21:20:01] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_47/transpose__516 + QuantLinearNode__1106_quantize_scale_node with StatefulPartitionedCall/model/conv2d_47/BiasAdd [10/12/2021-21:20:01] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_45/transpose__494 + QuantLinearNode__1086_quantize_scale_node with StatefulPartitionedCall/model/conv2d_45/BiasAdd [10/12/2021-21:20:01] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_43/transpose__472 + QuantLinearNode__1066_quantize_scale_node with StatefulPartitionedCall/model/conv2d_43/BiasAdd [10/12/2021-21:20:01] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_41/transpose__450 + QuantLinearNode__1046_quantize_scale_node with StatefulPartitionedCall/model/conv2d_41/BiasAdd [10/12/2021-21:20:01] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_38/transpose__428 + QuantLinearNode__1026_quantize_scale_node with StatefulPartitionedCall/model/conv2d_38/BiasAdd [10/12/2021-21:20:01] [V] [TRT] ConstWeightsFusion: Fusing StatefulPartitionedCall/model/conv2d_40/transpose__420 + QuantLinearNode__1014_quantize_scale_node with StatefulPartitionedCall/model/conv2d_40/BiasAdd [10/12/2021-21:20:01] [V] [TRT] ConvReluFusion: Fusing StatefulPartitionedCall/model/conv2d/transpose__8 + QuantLinearNode__638_quantize_scale_node + StatefulPartitionedCall/model/conv2d/BiasAdd with StatefulPartitionedCall/model/activation/Relu [10/12/2021-21:20:01] [V] [TRT] ConvReluFusion: Fusing StatefulPartitionedCall/model/conv2d_1/transpose__20 + QuantLinearNode__650_quantize_scale_node + StatefulPartitionedCall/model/conv2d_1/BiasAdd with StatefulPartitionedCall/model/activation_1/Relu [10/12/2021-21:20:01] [V] [TRT] ConvReluFusion: Fusing StatefulPartitionedCall/model/conv2d_3/transpose__42 + QuantLinearNode__670_quantize_scale_node + StatefulPartitionedCall/model/conv2d_3/BiasAdd with StatefulPartitionedCall/model/activation_3/Relu [10/12/2021-21:20:01] [V] [TRT] ConvReluFusion: Fusing StatefulPartitionedCall/model/conv2d_5/transpose__64 + QuantLinearNode__690_quantize_scale_node + StatefulPartitionedCall/model/conv2d_5/BiasAdd with StatefulPartitionedCall/model/activation_5/Relu [10/12/2021-21:20:01] [V] [TRT] ConvReluFusion: Fusing StatefulPartitionedCall/model/conv2d_7/transpose__86 + QuantLinearNode__710_quantize_scale_node + StatefulPartitionedCall/model/conv2d_7/BiasAdd with StatefulPartitionedCall/model/activation_7/Relu [10/12/2021-21:20:01] [V] [TRT] ConvReluFusion: Fusing StatefulPartitionedCall/model/conv2d_9/transpose__108 + QuantLinearNode__730_quantize_scale_node + StatefulPartitionedCall/model/conv2d_9/BiasAdd with StatefulPartitionedCall/model/activation_9/Relu [10/12/2021-21:20:01] [V] [TRT] ConvReluFusion: Fusing StatefulPartitionedCall/model/conv2d_11/transpose__130 + QuantLinearNode__750_quantize_scale_node + StatefulPartitionedCall/model/conv2d_11/BiasAdd with StatefulPartitionedCall/model/activation_11/Relu [10/12/2021-21:20:01] [V] [TRT] ConvReluFusion: Fusing StatefulPartitionedCall/model/conv2d_13/transpose__152 + QuantLinearNode__770_quantize_scale_node + StatefulPartitionedCall/model/conv2d_13/BiasAdd with StatefulPartitionedCall/model/activation_13/Relu [10/12/2021-21:20:01] [V] [TRT] ConvReluFusion: Fusing StatefulPartitionedCall/model/conv2d_15/transpose__174 + QuantLinearNode__790_quantize_scale_node + StatefulPartitionedCall/model/conv2d_15/BiasAdd with StatefulPartitionedCall/model/activation_15/Relu [10/12/2021-21:20:01] [V] [TRT] ConvReluFusion: Fusing StatefulPartitionedCall/model/conv2d_17/transpose__196 + QuantLinearNode__810_quantize_scale_node + StatefulPartitionedCall/model/conv2d_17/BiasAdd with StatefulPartitionedCall/model/activation_17/Relu [10/12/2021-21:20:01] [V] [TRT] ConvReluFusion: Fusing StatefulPartitionedCall/model/conv2d_19/transpose__224 + QuantLinearNode__838_quantize_scale_node + StatefulPartitionedCall/model/conv2d_19/BiasAdd with StatefulPartitionedCall/model/activation_19/Relu [10/12/2021-21:20:01] [V] [TRT] ConvReluFusion: Fusing StatefulPartitionedCall/model/conv2d_22/transpose__246 + QuantLinearNode__858_quantize_scale_node + StatefulPartitionedCall/model/conv2d_22/BiasAdd with StatefulPartitionedCall/model/activation_21/Relu [10/12/2021-21:20:01] [V] [TRT] ConvReluFusion: Fusing StatefulPartitionedCall/model/conv2d_24/transpose__268 + QuantLinearNode__878_quantize_scale_node + StatefulPartitionedCall/model/conv2d_24/BiasAdd with StatefulPartitionedCall/model/activation_23/Relu [10/12/2021-21:20:01] [V] [TRT] ConvReluFusion: Fusing StatefulPartitionedCall/model/conv2d_26/transpose__290 + QuantLinearNode__898_quantize_scale_node + StatefulPartitionedCall/model/conv2d_26/BiasAdd with StatefulPartitionedCall/model/activation_25/Relu [10/12/2021-21:20:01] [V] [TRT] ConvReluFusion: Fusing StatefulPartitionedCall/model/conv2d_28/transpose__312 + QuantLinearNode__918_quantize_scale_node + StatefulPartitionedCall/model/conv2d_28/BiasAdd with StatefulPartitionedCall/model/activation_27/Relu [10/12/2021-21:20:01] [V] [TRT] ConvReluFusion: Fusing StatefulPartitionedCall/model/conv2d_30/transpose__334 + QuantLinearNode__938_quantize_scale_node + StatefulPartitionedCall/model/conv2d_30/BiasAdd with StatefulPartitionedCall/model/activation_29/Relu [10/12/2021-21:20:01] [V] [TRT] ConvReluFusion: Fusing StatefulPartitionedCall/model/conv2d_32/transpose__356 + QuantLinearNode__958_quantize_scale_node + StatefulPartitionedCall/model/conv2d_32/BiasAdd with StatefulPartitionedCall/model/activation_31/Relu [10/12/2021-21:20:01] [V] [TRT] ConvReluFusion: Fusing StatefulPartitionedCall/model/conv2d_34/transpose__378 + QuantLinearNode__978_quantize_scale_node + StatefulPartitionedCall/model/conv2d_34/BiasAdd with StatefulPartitionedCall/model/activation_33/Relu [10/12/2021-21:20:01] [V] [TRT] ConvReluFusion: Fusing StatefulPartitionedCall/model/conv2d_36/transpose__400 + QuantLinearNode__998_quantize_scale_node + StatefulPartitionedCall/model/conv2d_36/BiasAdd with StatefulPartitionedCall/model/activation_35/Relu [10/12/2021-21:20:01] [V] [TRT] ConvReluFusion: Fusing StatefulPartitionedCall/model/conv2d_38/transpose__428 + QuantLinearNode__1026_quantize_scale_node + StatefulPartitionedCall/model/conv2d_38/BiasAdd with StatefulPartitionedCall/model/activation_37/Relu [10/12/2021-21:20:01] [V] [TRT] ConvReluFusion: Fusing StatefulPartitionedCall/model/conv2d_41/transpose__450 + QuantLinearNode__1046_quantize_scale_node + StatefulPartitionedCall/model/conv2d_41/BiasAdd with StatefulPartitionedCall/model/activation_39/Relu [10/12/2021-21:20:01] [V] [TRT] ConvReluFusion: Fusing StatefulPartitionedCall/model/conv2d_43/transpose__472 + QuantLinearNode__1066_quantize_scale_node + StatefulPartitionedCall/model/conv2d_43/BiasAdd with StatefulPartitionedCall/model/activation_41/Relu [10/12/2021-21:20:01] [V] [TRT] ConvReluFusion: Fusing StatefulPartitionedCall/model/conv2d_45/transpose__494 + QuantLinearNode__1086_quantize_scale_node + StatefulPartitionedCall/model/conv2d_45/BiasAdd with StatefulPartitionedCall/model/activation_43/Relu [10/12/2021-21:20:01] [V] [TRT] ConvReluFusion: Fusing StatefulPartitionedCall/model/conv2d_47/transpose__516 + QuantLinearNode__1106_quantize_scale_node + StatefulPartitionedCall/model/conv2d_47/BiasAdd with StatefulPartitionedCall/model/activation_45/Relu [10/12/2021-21:20:01] [V] [TRT] ConvReluFusion: Fusing StatefulPartitionedCall/model/conv2d_49/transpose__538 + QuantLinearNode__1126_quantize_scale_node + StatefulPartitionedCall/model/conv2d_49/BiasAdd with StatefulPartitionedCall/model/activation_47/Relu [10/12/2021-21:20:01] [V] [TRT] ConvReluFusion: Fusing StatefulPartitionedCall/model/conv2d_51/transpose__560 + QuantLinearNode__1146_quantize_scale_node + StatefulPartitionedCall/model/conv2d_51/BiasAdd with StatefulPartitionedCall/model/activation_49/Relu [10/12/2021-21:20:01] [V] [TRT] ConvReluFusion: Fusing StatefulPartitionedCall/model/conv2d_53/transpose__582 + QuantLinearNode__1166_quantize_scale_node + StatefulPartitionedCall/model/conv2d_53/BiasAdd with StatefulPartitionedCall/model/activation_51/Relu [10/12/2021-21:20:01] [V] [TRT] ConvReluFusion: Fusing StatefulPartitionedCall/model/conv2d_55/transpose__604 + QuantLinearNode__1186_quantize_scale_node + StatefulPartitionedCall/model/conv2d_55/BiasAdd with StatefulPartitionedCall/model/activation_53/Relu [10/12/2021-21:20:01] [V] [TRT] Convert layer type of StatefulPartitionedCall/model/dense/quantize_and_dequantize_1/ReadVariableOp__626 + QuantLinearNode__1206_quantize_scale_node + shuffle_after_StatefulPartitionedCall/model/dense/quantize_and_dequantize_1:0 + node_of_dense + to_FC from FULLY_CONNECTED to CONVOLUTION [10/12/2021-21:20:01] [V] [TRT] Removing shuffle_between_shuffle_before_StatefulPartitionedCall/model/global_average_pooling2d/Mean_Squeeze__2038_QuantizeLinear__2039:0_out_tensor_and_StatefulPartitionedCall/model/dense/quantize_and_dequantize_1/ReadVariableOp__626 + QuantLinearNode__1206_quantize_scale_node + shuffle_after_StatefulPartitionedCall/model/dense/quantize_and_dequantize_1:0 + node_of_dense + to_FC [10/12/2021-21:20:01] [V] [TRT] ShuffleShuffleFusion: Fusing StatefulPartitionedCall/model/global_average_pooling2d/Mean_Squeeze__2038 with shuffle_before_StatefulPartitionedCall/model/global_average_pooling2d/Mean_Squeeze__2038_QuantizeLinear__2039:0 [10/12/2021-21:20:01] [V] [TRT] Removing StatefulPartitionedCall/model/global_average_pooling2d/Mean_Squeeze__2038 + shuffle_before_StatefulPartitionedCall/model/global_average_pooling2d/Mean_Squeeze__2038_QuantizeLinear__2039:0 [10/12/2021-21:20:01] [V] [TRT] After vertical fusions: 61 layers [10/12/2021-21:20:01] [V] [TRT] After dupe layer removal: 61 layers [10/12/2021-21:20:01] [V] [TRT] After final dead-layer removal: 61 layers [10/12/2021-21:20:01] [V] [TRT] After tensor merging: 61 layers [10/12/2021-21:20:01] [V] [TRT] After concat removal: 61 layers [10/12/2021-21:20:01] [V] [TRT] Graph construction and optimization completed in 0.385966 seconds. [10/12/2021-21:20:01] [V] [TRT] Using cublas a tactic source [10/12/2021-21:20:01] [10/12/2021-21:20:01] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +211, GPU +74, now: CPU 9271, GPU 1053 (MiB) [10/12/2021-21:20:01] [V] [TRT] Using cuDNN as a tactic source [10/12/2021-21:20:01] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +168, GPU +78, now: CPU 9439, GPU 1131 (MiB) [10/12/2021-21:20:01] [10/12/2021-21:20:01] [10/12/2021-21:20:01] [V] [TRT] Constructing optimization profile number 0 [1/1]. [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Float(3072,1024,32,1) -> Int8(3072,1024,32,1) *************** [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: QuantLinearNode__634_quantize_scale_node (Scale) [10/12/2021-21:20:02] [V] [TRT] Setting a default quantization params because quantization data is missing for QuantLinearNode__634_quantize_scale_node [10/12/2021-21:20:02] [V] [TRT] Tactic: 0 Time: 0.015576 [10/12/2021-21:20:02] [V] [TRT] Fastest Tactic: 0 Time: 0.015576 [10/12/2021-21:20:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Float(3072,1024,32,1) -> Int8(1024,1024:4,32,1) *************** [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: QuantLinearNode__634_quantize_scale_node (Scale) [10/12/2021-21:20:02] [V] [TRT] Setting a default quantization params because quantization data is missing for QuantLinearNode__634_quantize_scale_node [10/12/2021-21:20:02] [V] [TRT] Tactic: 0 Time: 0.007864 [10/12/2021-21:20:02] [V] [TRT] Fastest Tactic: 0 Time: 0.007864 [10/12/2021-21:20:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Scale Tactic: 0 [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning Reformat:Int8(3072,1024,32,1) -> Int8(1024,1024:4,32,1) *************** [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [10/12/2021-21:20:02] [V] [TRT] Setting a default quantization params because quantization data is missing for [10/12/2021-21:20:02] [V] [TRT] Tactic: 1002 Time: 0.007936 [10/12/2021-21:20:02] [V] [TRT] Setting a default quantization params because quantization data is missing for [10/12/2021-21:20:02] [V] [TRT] Tactic: 0 Time: 0.011688 [10/12/2021-21:20:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.007936 [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(1024,1024:4,32,1) -> Int8(4096,1024:4,32,1) *************** [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/transpose__8 + QuantLinearNode__638_quantize_scale_node + StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/activation/Relu (CudaDepthwiseConvolution) [10/12/2021-21:20:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/transpose__8 + QuantLinearNode__638_quantize_scale_node + StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/activation/Relu (FusedConvActConvolution) [10/12/2021-21:20:02] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d/transpose__8 + QuantLinearNode__638_quantize_scale_node + StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/activation/Relu (CaskConvolution) [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d/transpose__8 + QuantLinearNode__638_quantize_scale_node + StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/activation/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 205464780613168514 [10/12/2021-21:20:02] [V] [TRT] Tactic: 205464780613168514 Time: 0.010196 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d/transpose__8 + QuantLinearNode__638_quantize_scale_node + StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/activation/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 3274338470516433987 [10/12/2021-21:20:02] [V] [TRT] Tactic: 3274338470516433987 Time: 0.011496 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d/transpose__8 + QuantLinearNode__638_quantize_scale_node + StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/activation/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 6593074063275429680 [10/12/2021-21:20:02] [V] [TRT] Tactic: 6593074063275429680 Time: 0.015148 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d/transpose__8 + QuantLinearNode__638_quantize_scale_node + StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/activation/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 9220760393820608173 [10/12/2021-21:20:02] [V] [TRT] Tactic: 9220760393820608173 Time: 0.012996 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d/transpose__8 + QuantLinearNode__638_quantize_scale_node + StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/activation/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] Tactic: -7665878956594041863 Time: 0.0092 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d/transpose__8 + QuantLinearNode__638_quantize_scale_node + StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/activation/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -2773311619323230421 [10/12/2021-21:20:02] [V] [TRT] Tactic: -2773311619323230421 Time: 0.0096 [10/12/2021-21:20:02] [V] [TRT] Fastest Tactic: -7665878956594041863 Time: 0.0092 [10/12/2021-21:20:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(4096,1024:4,32,1) -> Int8(4096,1024:4,32,1) *************** [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_1/transpose__20 + QuantLinearNode__650_quantize_scale_node + StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/activation_1/Relu (CudaDepthwiseConvolution) [10/12/2021-21:20:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_1/transpose__20 + QuantLinearNode__650_quantize_scale_node + StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/activation_1/Relu (FusedConvActConvolution) [10/12/2021-21:20:02] [V] [TRT] Tactic: 524287 Time: 0.016488 [10/12/2021-21:20:02] [V] [TRT] Tactic: 720895 Time: 0.014752 [10/12/2021-21:20:02] [V] [TRT] Tactic: 983039 Time: 0.011432 [10/12/2021-21:20:02] [V] [TRT] Tactic: 1048575 Time: 0.014472 [10/12/2021-21:20:02] [V] [TRT] Tactic: 1703935 Time: 0.01148 [10/12/2021-21:20:02] [V] [TRT] Tactic: 1966079 Time: 0.021908 [10/12/2021-21:20:02] [V] [TRT] Tactic: 2031615 Time: 0.019256 [10/12/2021-21:20:02] [V] [TRT] Tactic: 2228223 Time: 0.016464 [10/12/2021-21:20:02] [V] [TRT] Tactic: 2752511 Time: 0.020584 [10/12/2021-21:20:02] [V] [TRT] Tactic: 2818047 Time: 0.022536 [10/12/2021-21:20:02] [V] [TRT] Tactic: 2883583 Time: 0.020728 [10/12/2021-21:20:02] [V] [TRT] Tactic: 3014655 Time: 0.013332 [10/12/2021-21:20:02] [V] [TRT] Tactic: 3145727 Time: 0.016412 [10/12/2021-21:20:02] [V] [TRT] Tactic: 3473407 Time: 0.023276 [10/12/2021-21:20:02] [V] [TRT] Tactic: 3604479 Time: 0.014356 [10/12/2021-21:20:02] [V] [TRT] Tactic: 3735551 Time: 0.01478 [10/12/2021-21:20:02] [V] [TRT] Tactic: 4390911 Time: 0.027828 [10/12/2021-21:20:02] [V] [TRT] Tactic: 5046271 Time: 0.012836 [10/12/2021-21:20:02] [V] [TRT] Tactic: 5963775 Time: 0.025724 [10/12/2021-21:20:02] [V] [TRT] Tactic: 6160383 Time: 0.026104 [10/12/2021-21:20:02] [V] [TRT] Tactic: 6488063 Time: 0.017516 [10/12/2021-21:20:02] [V] [TRT] Tactic: 6881279 Time: 0.02052 [10/12/2021-21:20:02] [V] [TRT] Tactic: 7995391 Time: 0.016304 [10/12/2021-21:20:02] [V] [TRT] Tactic: 8585215 Time: 0.021032 [10/12/2021-21:20:02] [V] [TRT] Tactic: 8978431 Time: 0.022492 [10/12/2021-21:20:02] [V] [TRT] Tactic: 9043967 Time: 0.019216 [10/12/2021-21:20:02] [V] [TRT] Tactic: 9175039 Time: 0.015736 [10/12/2021-21:20:02] [V] [TRT] Tactic: 9502719 Time: 0.026936 [10/12/2021-21:20:02] [V] [TRT] Tactic: 9830399 Time: 0.013664 [10/12/2021-21:20:02] [V] [TRT] Tactic: 10027007 Time: 0.014864 [10/12/2021-21:20:02] [V] [TRT] Tactic: 10092543 Time: 0.03178 [10/12/2021-21:20:02] [V] [TRT] Tactic: 10289151 Time: 0.024292 [10/12/2021-21:20:02] [V] [TRT] Tactic: 10485759 Time: 0.013384 [10/12/2021-21:20:02] [V] [TRT] Tactic: 10813439 Time: 0.011092 [10/12/2021-21:20:02] [V] [TRT] Fastest Tactic: 10813439 Time: 0.011092 [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_1/transpose__20 + QuantLinearNode__650_quantize_scale_node + StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/activation_1/Relu (CaskConvolution) [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/transpose__20 + QuantLinearNode__650_quantize_scale_node + StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/activation_1/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 205464780613168514 [10/12/2021-21:20:02] [V] [TRT] Tactic: 205464780613168514 Time: 0.012124 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/transpose__20 + QuantLinearNode__650_quantize_scale_node + StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/activation_1/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 3274338470516433987 [10/12/2021-21:20:02] [V] [TRT] Tactic: 3274338470516433987 Time: 0.014848 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/transpose__20 + QuantLinearNode__650_quantize_scale_node + StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/activation_1/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 6593074063275429680 [10/12/2021-21:20:02] [V] [TRT] Tactic: 6593074063275429680 Time: 0.014004 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/transpose__20 + QuantLinearNode__650_quantize_scale_node + StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/activation_1/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 9220760393820608173 [10/12/2021-21:20:02] [V] [TRT] Tactic: 9220760393820608173 Time: 0.013116 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/transpose__20 + QuantLinearNode__650_quantize_scale_node + StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/activation_1/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] Tactic: -7665878956594041863 Time: 0.010752 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/transpose__20 + QuantLinearNode__650_quantize_scale_node + StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/activation_1/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -2773311619323230421 [10/12/2021-21:20:02] [V] [TRT] Tactic: -2773311619323230421 Time: 0.012032 [10/12/2021-21:20:02] [V] [TRT] Fastest Tactic: -7665878956594041863 Time: 0.010752 [10/12/2021-21:20:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(4096,1024:4,32,1), Int8(4096,1024:4,32,1) -> Int8(4096,1024:4,32,1) *************** [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_2/transpose__30 + QuantLinearNode__658_quantize_scale_node + StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/add/add + StatefulPartitionedCall/model/activation_2/Relu (CudaDepthwiseConvolution) [10/12/2021-21:20:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_2/transpose__30 + QuantLinearNode__658_quantize_scale_node + StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/add/add + StatefulPartitionedCall/model/activation_2/Relu (FusedConvActConvolution) [10/12/2021-21:20:02] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_2/transpose__30 + QuantLinearNode__658_quantize_scale_node + StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/add/add + StatefulPartitionedCall/model/activation_2/Relu (CaskConvolution) [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/transpose__30 + QuantLinearNode__658_quantize_scale_node + StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/add/add + StatefulPartitionedCall/model/activation_2/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 205464780613168514 [10/12/2021-21:20:02] [V] [TRT] Tactic: 205464780613168514 Time: 0.013056 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/transpose__30 + QuantLinearNode__658_quantize_scale_node + StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/add/add + StatefulPartitionedCall/model/activation_2/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 3274338470516433987 [10/12/2021-21:20:02] [V] [TRT] Tactic: 3274338470516433987 Time: 0.016128 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/transpose__30 + QuantLinearNode__658_quantize_scale_node + StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/add/add + StatefulPartitionedCall/model/activation_2/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 6593074063275429680 [10/12/2021-21:20:02] [V] [TRT] Tactic: 6593074063275429680 Time: 0.0184 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/transpose__30 + QuantLinearNode__658_quantize_scale_node + StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/add/add + StatefulPartitionedCall/model/activation_2/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 9220760393820608173 [10/12/2021-21:20:02] [V] [TRT] Tactic: 9220760393820608173 Time: 0.014108 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/transpose__30 + QuantLinearNode__658_quantize_scale_node + StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/add/add + StatefulPartitionedCall/model/activation_2/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] Tactic: -7665878956594041863 Time: 0.012876 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/transpose__30 + QuantLinearNode__658_quantize_scale_node + StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/add/add + StatefulPartitionedCall/model/activation_2/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -2773311619323230421 [10/12/2021-21:20:02] [V] [TRT] Tactic: -2773311619323230421 Time: 0.012544 [10/12/2021-21:20:02] [V] [TRT] Fastest Tactic: -2773311619323230421 Time: 0.012544 [10/12/2021-21:20:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2773311619323230421 [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(4096,1024:4,32,1) -> Int8(4096,1024:4,32,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(4096,1024:4,32,1), Int8(4096,1024:4,32,1) -> Int8(4096,1024:4,32,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(4096,1024:4,32,1) -> Int8(4096,1024:4,32,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(4096,1024:4,32,1), Int8(4096,1024:4,32,1) -> Int8(4096,1024:4,32,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(4096,1024:4,32,1) -> Int8(4096,1024:4,32,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(4096,1024:4,32,1), Int8(4096,1024:4,32,1) -> Int8(4096,1024:4,32,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(4096,1024:4,32,1) -> Int8(4096,1024:4,32,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(4096,1024:4,32,1), Int8(4096,1024:4,32,1) -> Int8(4096,1024:4,32,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(4096,1024:4,32,1) -> Int8(4096,1024:4,32,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(4096,1024:4,32,1), Int8(4096,1024:4,32,1) -> Int8(4096,1024:4,32,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(4096,1024:4,32,1) -> Int8(4096,1024:4,32,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(4096,1024:4,32,1), Int8(4096,1024:4,32,1) -> Int8(4096,1024:4,32,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(4096,1024:4,32,1) -> Int8(4096,1024:4,32,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(4096,1024:4,32,1), Int8(4096,1024:4,32,1) -> Int8(4096,1024:4,32,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(4096,1024:4,32,1) -> Int8(4096,1024:4,32,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(4096,1024:4,32,1), Int8(4096,1024:4,32,1) -> Int8(4096,1024:4,32,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(4096,1024:4,32,1) -> Int8(2048,256:4,16,1) *************** [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_19/transpose__224 + QuantLinearNode__838_quantize_scale_node + StatefulPartitionedCall/model/conv2d_19/BiasAdd + StatefulPartitionedCall/model/activation_19/Relu (CudaDepthwiseConvolution) [10/12/2021-21:20:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_19/transpose__224 + QuantLinearNode__838_quantize_scale_node + StatefulPartitionedCall/model/conv2d_19/BiasAdd + StatefulPartitionedCall/model/activation_19/Relu (CaskConvolution) [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_19/transpose__224 + QuantLinearNode__838_quantize_scale_node + StatefulPartitionedCall/model/conv2d_19/BiasAdd + StatefulPartitionedCall/model/activation_19/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 205464780613168514 [10/12/2021-21:20:02] [V] [TRT] Tactic: 205464780613168514 Time: 0.011856 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_19/transpose__224 + QuantLinearNode__838_quantize_scale_node + StatefulPartitionedCall/model/conv2d_19/BiasAdd + StatefulPartitionedCall/model/activation_19/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 3274338470516433987 [10/12/2021-21:20:02] [V] [TRT] Tactic: 3274338470516433987 Time: 0.01464 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_19/transpose__224 + QuantLinearNode__838_quantize_scale_node + StatefulPartitionedCall/model/conv2d_19/BiasAdd + StatefulPartitionedCall/model/activation_19/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 6593074063275429680 [10/12/2021-21:20:02] [V] [TRT] Tactic: 6593074063275429680 Time: 0.013888 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_19/transpose__224 + QuantLinearNode__838_quantize_scale_node + StatefulPartitionedCall/model/conv2d_19/BiasAdd + StatefulPartitionedCall/model/activation_19/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 9220760393820608173 [10/12/2021-21:20:02] [V] [TRT] Tactic: 9220760393820608173 Time: 0.01602 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_19/transpose__224 + QuantLinearNode__838_quantize_scale_node + StatefulPartitionedCall/model/conv2d_19/BiasAdd + StatefulPartitionedCall/model/activation_19/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] Tactic: -7665878956594041863 Time: 0.01226 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_19/transpose__224 + QuantLinearNode__838_quantize_scale_node + StatefulPartitionedCall/model/conv2d_19/BiasAdd + StatefulPartitionedCall/model/activation_19/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -2773311619323230421 [10/12/2021-21:20:02] [V] [TRT] Tactic: -2773311619323230421 Time: 0.012132 [10/12/2021-21:20:02] [V] [TRT] Fastest Tactic: 205464780613168514 Time: 0.011856 [10/12/2021-21:20:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 205464780613168514 [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(4096,1024:4,32,1) -> Int8(2048,256:4,16,1) *************** [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_21/transpose__216 + QuantLinearNode__826_quantize_scale_node + StatefulPartitionedCall/model/conv2d_21/BiasAdd (CudaDepthwiseConvolution) [10/12/2021-21:20:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_21/transpose__216 + QuantLinearNode__826_quantize_scale_node + StatefulPartitionedCall/model/conv2d_21/BiasAdd (FusedConvActConvolution) [10/12/2021-21:20:02] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_21/transpose__216 + QuantLinearNode__826_quantize_scale_node + StatefulPartitionedCall/model/conv2d_21/BiasAdd (CaskConvolution) [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_21/transpose__216 + QuantLinearNode__826_quantize_scale_node + StatefulPartitionedCall/model/conv2d_21/BiasAdd Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 205464780613168514 [10/12/2021-21:20:02] [V] [TRT] Tactic: 205464780613168514 Time: 0.008404 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_21/transpose__216 + QuantLinearNode__826_quantize_scale_node + StatefulPartitionedCall/model/conv2d_21/BiasAdd Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 251000705357475173 [10/12/2021-21:20:02] [V] [TRT] Tactic: 251000705357475173 Time: 0.01024 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_21/transpose__216 + QuantLinearNode__826_quantize_scale_node + StatefulPartitionedCall/model/conv2d_21/BiasAdd Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 3274338470516433987 [10/12/2021-21:20:02] [V] [TRT] Tactic: 3274338470516433987 Time: 0.017676 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_21/transpose__216 + QuantLinearNode__826_quantize_scale_node + StatefulPartitionedCall/model/conv2d_21/BiasAdd Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 6593074063275429680 [10/12/2021-21:20:02] [V] [TRT] Tactic: 6593074063275429680 Time: 0.009344 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_21/transpose__216 + QuantLinearNode__826_quantize_scale_node + StatefulPartitionedCall/model/conv2d_21/BiasAdd Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 9220760393820608173 [10/12/2021-21:20:02] [V] [TRT] Tactic: 9220760393820608173 Time: 0.012416 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_21/transpose__216 + QuantLinearNode__826_quantize_scale_node + StatefulPartitionedCall/model/conv2d_21/BiasAdd Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] Tactic: -7665878956594041863 Time: 0.008704 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_21/transpose__216 + QuantLinearNode__826_quantize_scale_node + StatefulPartitionedCall/model/conv2d_21/BiasAdd Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -7075774695632718014 [10/12/2021-21:20:02] [V] [TRT] Tactic: -7075774695632718014 Time: 0.014976 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_21/transpose__216 + QuantLinearNode__826_quantize_scale_node + StatefulPartitionedCall/model/conv2d_21/BiasAdd Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -4176343923564075021 [10/12/2021-21:20:02] [V] [TRT] Tactic: -4176343923564075021 Time: 0.015168 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_21/transpose__216 + QuantLinearNode__826_quantize_scale_node + StatefulPartitionedCall/model/conv2d_21/BiasAdd Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -2773311619323230421 [10/12/2021-21:20:02] [V] [TRT] Tactic: -2773311619323230421 Time: 0.007924 [10/12/2021-21:20:02] [V] [TRT] Fastest Tactic: -2773311619323230421 Time: 0.007924 [10/12/2021-21:20:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2773311619323230421 [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(2048,256:4,16,1), Int8(2048,256:4,16,1) -> Int8(2048,256:4,16,1) *************** [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_20/transpose__234 + QuantLinearNode__846_quantize_scale_node + StatefulPartitionedCall/model/conv2d_20/BiasAdd + StatefulPartitionedCall/model/add_9/add + StatefulPartitionedCall/model/activation_20/Relu (CudaDepthwiseConvolution) [10/12/2021-21:20:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_20/transpose__234 + QuantLinearNode__846_quantize_scale_node + StatefulPartitionedCall/model/conv2d_20/BiasAdd + StatefulPartitionedCall/model/add_9/add + StatefulPartitionedCall/model/activation_20/Relu (FusedConvActConvolution) [10/12/2021-21:20:02] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_20/transpose__234 + QuantLinearNode__846_quantize_scale_node + StatefulPartitionedCall/model/conv2d_20/BiasAdd + StatefulPartitionedCall/model/add_9/add + StatefulPartitionedCall/model/activation_20/Relu (CaskConvolution) [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_20/transpose__234 + QuantLinearNode__846_quantize_scale_node + StatefulPartitionedCall/model/conv2d_20/BiasAdd + StatefulPartitionedCall/model/add_9/add + StatefulPartitionedCall/model/activation_20/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 205464780613168514 [10/12/2021-21:20:02] [V] [TRT] Tactic: 205464780613168514 Time: 0.022016 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_20/transpose__234 + QuantLinearNode__846_quantize_scale_node + StatefulPartitionedCall/model/conv2d_20/BiasAdd + StatefulPartitionedCall/model/add_9/add + StatefulPartitionedCall/model/activation_20/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 3274338470516433987 [10/12/2021-21:20:02] [V] [TRT] Tactic: 3274338470516433987 Time: 0.026684 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_20/transpose__234 + QuantLinearNode__846_quantize_scale_node + StatefulPartitionedCall/model/conv2d_20/BiasAdd + StatefulPartitionedCall/model/add_9/add + StatefulPartitionedCall/model/activation_20/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 6593074063275429680 [10/12/2021-21:20:02] [V] [TRT] Tactic: 6593074063275429680 Time: 0.023548 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_20/transpose__234 + QuantLinearNode__846_quantize_scale_node + StatefulPartitionedCall/model/conv2d_20/BiasAdd + StatefulPartitionedCall/model/add_9/add + StatefulPartitionedCall/model/activation_20/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 9220760393820608173 [10/12/2021-21:20:02] [V] [TRT] Tactic: 9220760393820608173 Time: 0.020316 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_20/transpose__234 + QuantLinearNode__846_quantize_scale_node + StatefulPartitionedCall/model/conv2d_20/BiasAdd + StatefulPartitionedCall/model/add_9/add + StatefulPartitionedCall/model/activation_20/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] Tactic: -7665878956594041863 Time: 0.013824 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_20/transpose__234 + QuantLinearNode__846_quantize_scale_node + StatefulPartitionedCall/model/conv2d_20/BiasAdd + StatefulPartitionedCall/model/add_9/add + StatefulPartitionedCall/model/activation_20/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -2773311619323230421 [10/12/2021-21:20:02] [V] [TRT] Tactic: -2773311619323230421 Time: 0.01664 [10/12/2021-21:20:02] [V] [TRT] Fastest Tactic: -7665878956594041863 Time: 0.013824 [10/12/2021-21:20:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(2048,256:4,16,1) -> Int8(2048,256:4,16,1) *************** [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_22/transpose__246 + QuantLinearNode__858_quantize_scale_node + StatefulPartitionedCall/model/conv2d_22/BiasAdd + StatefulPartitionedCall/model/activation_21/Relu (CudaDepthwiseConvolution) [10/12/2021-21:20:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_22/transpose__246 + QuantLinearNode__858_quantize_scale_node + StatefulPartitionedCall/model/conv2d_22/BiasAdd + StatefulPartitionedCall/model/activation_21/Relu (FusedConvActConvolution) [10/12/2021-21:20:02] [V] [TRT] Tactic: 524287 Time: 0.030012 [10/12/2021-21:20:02] [V] [TRT] Tactic: 720895 Time: 0.020352 [10/12/2021-21:20:02] [V] [TRT] Tactic: 983039 Time: 0.011092 [10/12/2021-21:20:02] [V] [TRT] Tactic: 1048575 Time: 0.020084 [10/12/2021-21:20:02] [V] [TRT] Tactic: 1703935 Time: 0.01252 [10/12/2021-21:20:02] [V] [TRT] Tactic: 1769471 Time: 0.011476 [10/12/2021-21:20:02] [V] [TRT] Tactic: 1966079 Time: 0.023584 [10/12/2021-21:20:02] [V] [TRT] Tactic: 2031615 Time: 0.019988 [10/12/2021-21:20:02] [V] [TRT] Tactic: 2228223 Time: 0.021132 [10/12/2021-21:20:02] [V] [TRT] Tactic: 2621439 Time: 0.018704 [10/12/2021-21:20:02] [V] [TRT] Tactic: 2752511 Time: 0.022276 [10/12/2021-21:20:02] [V] [TRT] Tactic: 2818047 Time: 0.020164 [10/12/2021-21:20:02] [V] [TRT] Tactic: 2883583 Time: 0.024852 [10/12/2021-21:20:02] [V] [TRT] Tactic: 3014655 Time: 0.014504 [10/12/2021-21:20:02] [V] [TRT] Tactic: 3145727 Time: 0.012868 [10/12/2021-21:20:02] [V] [TRT] Tactic: 3473407 Time: 0.016124 [10/12/2021-21:20:02] [V] [TRT] Tactic: 3604479 Time: 0.017048 [10/12/2021-21:20:02] [V] [TRT] Tactic: 3735551 Time: 0.01664 [10/12/2021-21:20:02] [V] [TRT] Tactic: 4390911 Time: 0.030308 [10/12/2021-21:20:02] [V] [TRT] Tactic: 5046271 Time: 0.012792 [10/12/2021-21:20:02] [V] [TRT] Tactic: 5963775 Time: 0.026712 [10/12/2021-21:20:02] [V] [TRT] Tactic: 6160383 Time: 0.022024 [10/12/2021-21:20:02] [V] [TRT] Tactic: 6488063 Time: 0.018284 [10/12/2021-21:20:02] [V] [TRT] Tactic: 6881279 Time: 0.01914 [10/12/2021-21:20:02] [V] [TRT] Tactic: 7274495 Time: 0.009868 [10/12/2021-21:20:02] [V] [TRT] Tactic: 7864319 Time: 0.010416 [10/12/2021-21:20:02] [V] [TRT] Tactic: 7995391 Time: 0.021376 [10/12/2021-21:20:02] [V] [TRT] Tactic: 8585215 Time: 0.022308 [10/12/2021-21:20:02] [V] [TRT] Tactic: 8847359 Time: 0.009184 [10/12/2021-21:20:02] [V] [TRT] Tactic: 8978431 Time: 0.020816 [10/12/2021-21:20:02] [V] [TRT] Tactic: 9043967 Time: 0.012848 [10/12/2021-21:20:02] [V] [TRT] Tactic: 9175039 Time: 0.01486 [10/12/2021-21:20:02] [V] [TRT] Tactic: 9502719 Time: 0.032072 [10/12/2021-21:20:02] [V] [TRT] Tactic: 9830399 Time: 0.012468 [10/12/2021-21:20:02] [V] [TRT] Tactic: 10027007 Time: 0.014676 [10/12/2021-21:20:02] [V] [TRT] Tactic: 10092543 Time: 0.026876 [10/12/2021-21:20:02] [V] [TRT] Tactic: 10289151 Time: 0.02192 [10/12/2021-21:20:02] [V] [TRT] Tactic: 10485759 Time: 0.01014 [10/12/2021-21:20:02] [V] [TRT] Tactic: 10682367 Time: 0.008088 [10/12/2021-21:20:02] [V] [TRT] Tactic: 10813439 Time: 0.014728 [10/12/2021-21:20:02] [V] [TRT] Fastest Tactic: 10682367 Time: 0.008088 [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_22/transpose__246 + QuantLinearNode__858_quantize_scale_node + StatefulPartitionedCall/model/conv2d_22/BiasAdd + StatefulPartitionedCall/model/activation_21/Relu (CaskConvolution) [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_22/transpose__246 + QuantLinearNode__858_quantize_scale_node + StatefulPartitionedCall/model/conv2d_22/BiasAdd + StatefulPartitionedCall/model/activation_21/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 205464780613168514 [10/12/2021-21:20:02] [V] [TRT] Tactic: 205464780613168514 Time: 0.014328 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_22/transpose__246 + QuantLinearNode__858_quantize_scale_node + StatefulPartitionedCall/model/conv2d_22/BiasAdd + StatefulPartitionedCall/model/activation_21/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 3274338470516433987 [10/12/2021-21:20:02] [V] [TRT] Tactic: 3274338470516433987 Time: 0.01874 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_22/transpose__246 + QuantLinearNode__858_quantize_scale_node + StatefulPartitionedCall/model/conv2d_22/BiasAdd + StatefulPartitionedCall/model/activation_21/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 6593074063275429680 [10/12/2021-21:20:02] [V] [TRT] Tactic: 6593074063275429680 Time: 0.016 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_22/transpose__246 + QuantLinearNode__858_quantize_scale_node + StatefulPartitionedCall/model/conv2d_22/BiasAdd + StatefulPartitionedCall/model/activation_21/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 9220760393820608173 [10/12/2021-21:20:02] [V] [TRT] Tactic: 9220760393820608173 Time: 0.014376 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_22/transpose__246 + QuantLinearNode__858_quantize_scale_node + StatefulPartitionedCall/model/conv2d_22/BiasAdd + StatefulPartitionedCall/model/activation_21/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] Tactic: -7665878956594041863 Time: 0.012288 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_22/transpose__246 + QuantLinearNode__858_quantize_scale_node + StatefulPartitionedCall/model/conv2d_22/BiasAdd + StatefulPartitionedCall/model/activation_21/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -2773311619323230421 [10/12/2021-21:20:02] [V] [TRT] Tactic: -2773311619323230421 Time: 0.014464 [10/12/2021-21:20:02] [V] [TRT] Fastest Tactic: -7665878956594041863 Time: 0.012288 [10/12/2021-21:20:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 10682367 [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(2048,256:4,16,1), Int8(2048,256:4,16,1) -> Int8(2048,256:4,16,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(2048,256:4,16,1) -> Int8(2048,256:4,16,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(2048,256:4,16,1), Int8(2048,256:4,16,1) -> Int8(2048,256:4,16,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(2048,256:4,16,1) -> Int8(2048,256:4,16,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(2048,256:4,16,1), Int8(2048,256:4,16,1) -> Int8(2048,256:4,16,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(2048,256:4,16,1) -> Int8(2048,256:4,16,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(2048,256:4,16,1), Int8(2048,256:4,16,1) -> Int8(2048,256:4,16,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(2048,256:4,16,1) -> Int8(2048,256:4,16,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(2048,256:4,16,1), Int8(2048,256:4,16,1) -> Int8(2048,256:4,16,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(2048,256:4,16,1) -> Int8(2048,256:4,16,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(2048,256:4,16,1), Int8(2048,256:4,16,1) -> Int8(2048,256:4,16,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(2048,256:4,16,1) -> Int8(2048,256:4,16,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(2048,256:4,16,1), Int8(2048,256:4,16,1) -> Int8(2048,256:4,16,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(2048,256:4,16,1) -> Int8(2048,256:4,16,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(2048,256:4,16,1), Int8(2048,256:4,16,1) -> Int8(2048,256:4,16,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(2048,256:4,16,1) -> Int8(1024,64:4,8,1) *************** [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_38/transpose__428 + QuantLinearNode__1026_quantize_scale_node + StatefulPartitionedCall/model/conv2d_38/BiasAdd + StatefulPartitionedCall/model/activation_37/Relu (CudaDepthwiseConvolution) [10/12/2021-21:20:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_38/transpose__428 + QuantLinearNode__1026_quantize_scale_node + StatefulPartitionedCall/model/conv2d_38/BiasAdd + StatefulPartitionedCall/model/activation_37/Relu (CaskConvolution) [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_38/transpose__428 + QuantLinearNode__1026_quantize_scale_node + StatefulPartitionedCall/model/conv2d_38/BiasAdd + StatefulPartitionedCall/model/activation_37/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 205464780613168514 [10/12/2021-21:20:02] [V] [TRT] Tactic: 205464780613168514 Time: 0.013696 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_38/transpose__428 + QuantLinearNode__1026_quantize_scale_node + StatefulPartitionedCall/model/conv2d_38/BiasAdd + StatefulPartitionedCall/model/activation_37/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 3274338470516433987 [10/12/2021-21:20:02] [V] [TRT] Tactic: 3274338470516433987 Time: 0.020544 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_38/transpose__428 + QuantLinearNode__1026_quantize_scale_node + StatefulPartitionedCall/model/conv2d_38/BiasAdd + StatefulPartitionedCall/model/activation_37/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 6593074063275429680 [10/12/2021-21:20:02] [V] [TRT] Tactic: 6593074063275429680 Time: 0.016512 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_38/transpose__428 + QuantLinearNode__1026_quantize_scale_node + StatefulPartitionedCall/model/conv2d_38/BiasAdd + StatefulPartitionedCall/model/activation_37/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 9220760393820608173 [10/12/2021-21:20:02] [V] [TRT] Tactic: 9220760393820608173 Time: 0.01344 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_38/transpose__428 + QuantLinearNode__1026_quantize_scale_node + StatefulPartitionedCall/model/conv2d_38/BiasAdd + StatefulPartitionedCall/model/activation_37/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] Tactic: -7665878956594041863 Time: 0.01202 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_38/transpose__428 + QuantLinearNode__1026_quantize_scale_node + StatefulPartitionedCall/model/conv2d_38/BiasAdd + StatefulPartitionedCall/model/activation_37/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -2773311619323230421 [10/12/2021-21:20:02] [V] [TRT] Tactic: -2773311619323230421 Time: 0.014208 [10/12/2021-21:20:02] [V] [TRT] Fastest Tactic: -7665878956594041863 Time: 0.01202 [10/12/2021-21:20:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(2048,256:4,16,1) -> Int8(1024,64:4,8,1) *************** [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_40/transpose__420 + QuantLinearNode__1014_quantize_scale_node + StatefulPartitionedCall/model/conv2d_40/BiasAdd (CudaDepthwiseConvolution) [10/12/2021-21:20:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_40/transpose__420 + QuantLinearNode__1014_quantize_scale_node + StatefulPartitionedCall/model/conv2d_40/BiasAdd (FusedConvActConvolution) [10/12/2021-21:20:02] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_40/transpose__420 + QuantLinearNode__1014_quantize_scale_node + StatefulPartitionedCall/model/conv2d_40/BiasAdd (CaskConvolution) [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_40/transpose__420 + QuantLinearNode__1014_quantize_scale_node + StatefulPartitionedCall/model/conv2d_40/BiasAdd Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 205464780613168514 [10/12/2021-21:20:02] [V] [TRT] Tactic: 205464780613168514 Time: 0.008448 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_40/transpose__420 + QuantLinearNode__1014_quantize_scale_node + StatefulPartitionedCall/model/conv2d_40/BiasAdd Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: 251000705357475173 [10/12/2021-21:20:02] [V] [TRT] Tactic: 251000705357475173 Time: 0.016 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_40/transpose__420 + QuantLinearNode__1014_quantize_scale_node + StatefulPartitionedCall/model/conv2d_40/BiasAdd Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 3274338470516433987 [10/12/2021-21:20:02] [V] [TRT] Tactic: 3274338470516433987 Time: 0.009348 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_40/transpose__420 + QuantLinearNode__1014_quantize_scale_node + StatefulPartitionedCall/model/conv2d_40/BiasAdd Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 6593074063275429680 [10/12/2021-21:20:02] [V] [TRT] Tactic: 6593074063275429680 Time: 0.012416 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_40/transpose__420 + QuantLinearNode__1014_quantize_scale_node + StatefulPartitionedCall/model/conv2d_40/BiasAdd Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 9220760393820608173 [10/12/2021-21:20:02] [V] [TRT] Tactic: 9220760393820608173 Time: 0.010624 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_40/transpose__420 + QuantLinearNode__1014_quantize_scale_node + StatefulPartitionedCall/model/conv2d_40/BiasAdd Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] Tactic: -7665878956594041863 Time: 0.00778 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_40/transpose__420 + QuantLinearNode__1014_quantize_scale_node + StatefulPartitionedCall/model/conv2d_40/BiasAdd Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -7075774695632718014 [10/12/2021-21:20:02] [V] [TRT] Tactic: -7075774695632718014 Time: 0.01088 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_40/transpose__420 + QuantLinearNode__1014_quantize_scale_node + StatefulPartitionedCall/model/conv2d_40/BiasAdd Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -4176343923564075021 [10/12/2021-21:20:02] [V] [TRT] Tactic: -4176343923564075021 Time: 0.015488 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_40/transpose__420 + QuantLinearNode__1014_quantize_scale_node + StatefulPartitionedCall/model/conv2d_40/BiasAdd Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -2773311619323230421 [10/12/2021-21:20:02] [V] [TRT] Tactic: -2773311619323230421 Time: 0.0079 [10/12/2021-21:20:02] [V] [TRT] Fastest Tactic: -7665878956594041863 Time: 0.00778 [10/12/2021-21:20:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(1024,64:4,8,1), Int8(1024,64:4,8,1) -> Int8(1024,64:4,8,1) *************** [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_39/transpose__438 + QuantLinearNode__1034_quantize_scale_node + StatefulPartitionedCall/model/conv2d_39/BiasAdd + StatefulPartitionedCall/model/add_18/add + StatefulPartitionedCall/model/activation_38/Relu (CudaDepthwiseConvolution) [10/12/2021-21:20:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_39/transpose__438 + QuantLinearNode__1034_quantize_scale_node + StatefulPartitionedCall/model/conv2d_39/BiasAdd + StatefulPartitionedCall/model/add_18/add + StatefulPartitionedCall/model/activation_38/Relu (FusedConvActConvolution) [10/12/2021-21:20:02] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_39/transpose__438 + QuantLinearNode__1034_quantize_scale_node + StatefulPartitionedCall/model/conv2d_39/BiasAdd + StatefulPartitionedCall/model/add_18/add + StatefulPartitionedCall/model/activation_38/Relu (CaskConvolution) [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_39/transpose__438 + QuantLinearNode__1034_quantize_scale_node + StatefulPartitionedCall/model/conv2d_39/BiasAdd + StatefulPartitionedCall/model/add_18/add + StatefulPartitionedCall/model/activation_38/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 205464780613168514 [10/12/2021-21:20:02] [V] [TRT] Tactic: 205464780613168514 Time: 0.020352 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_39/transpose__438 + QuantLinearNode__1034_quantize_scale_node + StatefulPartitionedCall/model/conv2d_39/BiasAdd + StatefulPartitionedCall/model/add_18/add + StatefulPartitionedCall/model/activation_38/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 3274338470516433987 [10/12/2021-21:20:02] [V] [TRT] Tactic: 3274338470516433987 Time: 0.025984 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_39/transpose__438 + QuantLinearNode__1034_quantize_scale_node + StatefulPartitionedCall/model/conv2d_39/BiasAdd + StatefulPartitionedCall/model/add_18/add + StatefulPartitionedCall/model/activation_38/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 6593074063275429680 [10/12/2021-21:20:02] [V] [TRT] Tactic: 6593074063275429680 Time: 0.025504 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_39/transpose__438 + QuantLinearNode__1034_quantize_scale_node + StatefulPartitionedCall/model/conv2d_39/BiasAdd + StatefulPartitionedCall/model/add_18/add + StatefulPartitionedCall/model/activation_38/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 9220760393820608173 [10/12/2021-21:20:02] [V] [TRT] Tactic: 9220760393820608173 Time: 0.021336 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_39/transpose__438 + QuantLinearNode__1034_quantize_scale_node + StatefulPartitionedCall/model/conv2d_39/BiasAdd + StatefulPartitionedCall/model/add_18/add + StatefulPartitionedCall/model/activation_38/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] Tactic: -7665878956594041863 Time: 0.018236 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_39/transpose__438 + QuantLinearNode__1034_quantize_scale_node + StatefulPartitionedCall/model/conv2d_39/BiasAdd + StatefulPartitionedCall/model/add_18/add + StatefulPartitionedCall/model/activation_38/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -2773311619323230421 [10/12/2021-21:20:02] [V] [TRT] Tactic: -2773311619323230421 Time: 0.033348 [10/12/2021-21:20:02] [V] [TRT] Fastest Tactic: -7665878956594041863 Time: 0.018236 [10/12/2021-21:20:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(1024,64:4,8,1) -> Int8(1024,64:4,8,1) *************** [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_41/transpose__450 + QuantLinearNode__1046_quantize_scale_node + StatefulPartitionedCall/model/conv2d_41/BiasAdd + StatefulPartitionedCall/model/activation_39/Relu (CudaDepthwiseConvolution) [10/12/2021-21:20:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_41/transpose__450 + QuantLinearNode__1046_quantize_scale_node + StatefulPartitionedCall/model/conv2d_41/BiasAdd + StatefulPartitionedCall/model/activation_39/Relu (FusedConvActConvolution) [10/12/2021-21:20:02] [V] [TRT] Tactic: 524287 Time: 0.023768 [10/12/2021-21:20:02] [V] [TRT] Tactic: 720895 Time: 0.035204 [10/12/2021-21:20:02] [V] [TRT] Tactic: 983039 Time: 0.015408 [10/12/2021-21:20:02] [V] [TRT] Tactic: 1048575 Time: 0.018912 [10/12/2021-21:20:02] [V] [TRT] Tactic: 1703935 Time: 0.018224 [10/12/2021-21:20:02] [V] [TRT] Tactic: 1769471 Time: 0.017452 [10/12/2021-21:20:02] [V] [TRT] Tactic: 1966079 Time: 0.027728 [10/12/2021-21:20:02] [V] [TRT] Tactic: 2031615 Time: 0.025756 [10/12/2021-21:20:02] [V] [TRT] Tactic: 2228223 Time: 0.02632 [10/12/2021-21:20:02] [V] [TRT] Tactic: 2424831 Time: 0.012772 [10/12/2021-21:20:02] [V] [TRT] Tactic: 2621439 Time: 0.017896 [10/12/2021-21:20:02] [V] [TRT] Tactic: 2752511 Time: 0.020948 [10/12/2021-21:20:02] [V] [TRT] Tactic: 2818047 Time: 0.026176 [10/12/2021-21:20:02] [V] [TRT] Tactic: 2883583 Time: 0.036636 [10/12/2021-21:20:02] [V] [TRT] Tactic: 3014655 Time: 0.01514 [10/12/2021-21:20:02] [V] [TRT] Tactic: 3145727 Time: 0.025876 [10/12/2021-21:20:02] [V] [TRT] Tactic: 3473407 Time: 0.028744 [10/12/2021-21:20:02] [V] [TRT] Tactic: 3604479 Time: 0.014684 [10/12/2021-21:20:02] [V] [TRT] Tactic: 3735551 Time: 0.0142 [10/12/2021-21:20:02] [V] [TRT] Tactic: 4390911 Time: 0.03672 [10/12/2021-21:20:02] [V] [TRT] Tactic: 5046271 Time: 0.016072 [10/12/2021-21:20:02] [V] [TRT] Tactic: 5963775 Time: 0.027436 [10/12/2021-21:20:02] [V] [TRT] Tactic: 6160383 Time: 0.024788 [10/12/2021-21:20:02] [V] [TRT] Tactic: 6488063 Time: 0.02758 [10/12/2021-21:20:02] [V] [TRT] Tactic: 6881279 Time: 0.028768 [10/12/2021-21:20:02] [V] [TRT] Tactic: 7274495 Time: 0.01012 [10/12/2021-21:20:02] [V] [TRT] Tactic: 7864319 Time: 0.024508 [10/12/2021-21:20:02] [V] [TRT] Tactic: 7995391 Time: 0.037316 [10/12/2021-21:20:02] [V] [TRT] Tactic: 8585215 Time: 0.02888 [10/12/2021-21:20:02] [V] [TRT] Tactic: 8847359 Time: 0.011844 [10/12/2021-21:20:02] [V] [TRT] Tactic: 8978431 Time: 0.038724 [10/12/2021-21:20:02] [V] [TRT] Tactic: 9043967 Time: 0.021116 [10/12/2021-21:20:02] [V] [TRT] Tactic: 9175039 Time: 0.021328 [10/12/2021-21:20:02] [V] [TRT] Tactic: 9502719 Time: 0.037632 [10/12/2021-21:20:02] [V] [TRT] Tactic: 9830399 Time: 0.015304 [10/12/2021-21:20:02] [V] [TRT] Tactic: 9961471 Time: 0.011668 [10/12/2021-21:20:02] [V] [TRT] Tactic: 10027007 Time: 0.018388 [10/12/2021-21:20:02] [V] [TRT] Tactic: 10092543 Time: 0.037564 [10/12/2021-21:20:02] [V] [TRT] Tactic: 10289151 Time: 0.030624 [10/12/2021-21:20:02] [V] [TRT] Tactic: 10485759 Time: 0.01262 [10/12/2021-21:20:02] [V] [TRT] Tactic: 10682367 Time: 0.011 [10/12/2021-21:20:02] [V] [TRT] Tactic: 10813439 Time: 0.013836 [10/12/2021-21:20:02] [V] [TRT] Fastest Tactic: 7274495 Time: 0.01012 [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/conv2d_41/transpose__450 + QuantLinearNode__1046_quantize_scale_node + StatefulPartitionedCall/model/conv2d_41/BiasAdd + StatefulPartitionedCall/model/activation_39/Relu (CaskConvolution) [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_41/transpose__450 + QuantLinearNode__1046_quantize_scale_node + StatefulPartitionedCall/model/conv2d_41/BiasAdd + StatefulPartitionedCall/model/activation_39/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 205464780613168514 [10/12/2021-21:20:02] [V] [TRT] Tactic: 205464780613168514 Time: 0.021372 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_41/transpose__450 + QuantLinearNode__1046_quantize_scale_node + StatefulPartitionedCall/model/conv2d_41/BiasAdd + StatefulPartitionedCall/model/activation_39/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 3274338470516433987 [10/12/2021-21:20:02] [V] [TRT] Tactic: 3274338470516433987 Time: 0.026468 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_41/transpose__450 + QuantLinearNode__1046_quantize_scale_node + StatefulPartitionedCall/model/conv2d_41/BiasAdd + StatefulPartitionedCall/model/activation_39/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: 6593074063275429680 [10/12/2021-21:20:02] [V] [TRT] Tactic: 6593074063275429680 Time: 0.024428 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_41/transpose__450 + QuantLinearNode__1046_quantize_scale_node + StatefulPartitionedCall/model/conv2d_41/BiasAdd + StatefulPartitionedCall/model/activation_39/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 9220760393820608173 [10/12/2021-21:20:02] [V] [TRT] Tactic: 9220760393820608173 Time: 0.022328 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_41/transpose__450 + QuantLinearNode__1046_quantize_scale_node + StatefulPartitionedCall/model/conv2d_41/BiasAdd + StatefulPartitionedCall/model/activation_39/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] Tactic: -7665878956594041863 Time: 0.017792 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_41/transpose__450 + QuantLinearNode__1046_quantize_scale_node + StatefulPartitionedCall/model/conv2d_41/BiasAdd + StatefulPartitionedCall/model/activation_39/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -2773311619323230421 [10/12/2021-21:20:02] [V] [TRT] Tactic: -2773311619323230421 Time: 0.0224 [10/12/2021-21:20:02] [V] [TRT] Fastest Tactic: -7665878956594041863 Time: 0.017792 [10/12/2021-21:20:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 7274495 [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(1024,64:4,8,1), Int8(1024,64:4,8,1) -> Int8(1024,64:4,8,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(1024,64:4,8,1) -> Int8(1024,64:4,8,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(1024,64:4,8,1), Int8(1024,64:4,8,1) -> Int8(1024,64:4,8,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(1024,64:4,8,1) -> Int8(1024,64:4,8,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(1024,64:4,8,1), Int8(1024,64:4,8,1) -> Int8(1024,64:4,8,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(1024,64:4,8,1) -> Int8(1024,64:4,8,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(1024,64:4,8,1), Int8(1024,64:4,8,1) -> Int8(1024,64:4,8,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(1024,64:4,8,1) -> Int8(1024,64:4,8,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(1024,64:4,8,1), Int8(1024,64:4,8,1) -> Int8(1024,64:4,8,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(1024,64:4,8,1) -> Int8(1024,64:4,8,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(1024,64:4,8,1), Int8(1024,64:4,8,1) -> Int8(1024,64:4,8,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(1024,64:4,8,1) -> Int8(1024,64:4,8,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(1024,64:4,8,1), Int8(1024,64:4,8,1) -> Int8(1024,64:4,8,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(1024,64:4,8,1) -> Int8(1024,64:4,8,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(1024,64:4,8,1), Int8(1024,64:4,8,1) -> Int8(1024,64:4,8,1) *************** [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(1024,64:4,8,1) -> Int8(16,1:4,1,1) *************** [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/global_average_pooling2d/Mean (CudaPooling) [10/12/2021-21:20:02] [V] [TRT] Tactic: -3 Time: 0.011792 [10/12/2021-21:20:02] [V] [TRT] Fastest Tactic: -3 Time: 0.011792 [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/global_average_pooling2d/Mean (TiledPooling) [10/12/2021-21:20:02] [V] [TRT] TiledPooling has no valid tactics for this config, skipping [10/12/2021-21:20:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaPooling Tactic: -3 [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Int8(16,1:4,1,1) -> Float(10,1,1,1) *************** [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/dense/quantize_and_dequantize_1/ReadVariableOp__626 + QuantLinearNode__1206_quantize_scale_node + shuffle_after_StatefulPartitionedCall/model/dense/quantize_and_dequantize_1:0 + node_of_dense + to_FC (CudaDepthwiseConvolution) [10/12/2021-21:20:02] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: StatefulPartitionedCall/model/dense/quantize_and_dequantize_1/ReadVariableOp__626 + QuantLinearNode__1206_quantize_scale_node + shuffle_after_StatefulPartitionedCall/model/dense/quantize_and_dequantize_1:0 + node_of_dense + to_FC (CaskConvolution) [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/dense/quantize_and_dequantize_1/ReadVariableOp__626 + QuantLinearNode__1206_quantize_scale_node + shuffle_after_StatefulPartitionedCall/model/dense/quantize_and_dequantize_1:0 + node_of_dense + to_FC Set Tactic Name: maxwell_fp32_icudnn_int8x4_128x64_relu_medium_nn_v1 Tactic: 1696797196193926297 [10/12/2021-21:20:02] [V] [TRT] Tactic: 1696797196193926297 Time: 0.012672 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/dense/quantize_and_dequantize_1/ReadVariableOp__626 + QuantLinearNode__1206_quantize_scale_node + shuffle_after_StatefulPartitionedCall/model/dense/quantize_and_dequantize_1:0 + node_of_dense + to_FC Set Tactic Name: maxwell_fp32_icudnn_int8x4_128x32_relu_medium_nn_v1 Tactic: 4974874275042868855 [10/12/2021-21:20:02] [V] [TRT] Tactic: 4974874275042868855 Time: 0.013368 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/dense/quantize_and_dequantize_1/ReadVariableOp__626 + QuantLinearNode__1206_quantize_scale_node + shuffle_after_StatefulPartitionedCall/model/dense/quantize_and_dequantize_1:0 + node_of_dense + to_FC Set Tactic Name: maxwell_fp32_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 6391716969403403498 [10/12/2021-21:20:02] [V] [TRT] Tactic: 6391716969403403498 Time: 0.01176 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/dense/quantize_and_dequantize_1/ReadVariableOp__626 + QuantLinearNode__1206_quantize_scale_node + shuffle_after_StatefulPartitionedCall/model/dense/quantize_and_dequantize_1:0 + node_of_dense + to_FC Set Tactic Name: maxwell_fp32_icudnn_int8x4_128x32_relu_interior_nn_v1 Tactic: -8381719075454103752 [10/12/2021-21:20:02] [V] [TRT] Tactic: -8381719075454103752 Time: 0.017408 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/dense/quantize_and_dequantize_1/ReadVariableOp__626 + QuantLinearNode__1206_quantize_scale_node + shuffle_after_StatefulPartitionedCall/model/dense/quantize_and_dequantize_1:0 + node_of_dense + to_FC Set Tactic Name: maxwell_fp32_icudnn_int8x4_128x128_relu_medium_nn_v1 Tactic: -6455039641494301630 [10/12/2021-21:20:02] [V] [TRT] Tactic: -6455039641494301630 Time: 0.019188 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/dense/quantize_and_dequantize_1/ReadVariableOp__626 + QuantLinearNode__1206_quantize_scale_node + shuffle_after_StatefulPartitionedCall/model/dense/quantize_and_dequantize_1:0 + node_of_dense + to_FC Set Tactic Name: maxwell_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -5622265363201188577 [10/12/2021-21:20:02] [V] [TRT] Tactic: -5622265363201188577 Time: 0.011648 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/dense/quantize_and_dequantize_1/ReadVariableOp__626 + QuantLinearNode__1206_quantize_scale_node + shuffle_after_StatefulPartitionedCall/model/dense/quantize_and_dequantize_1:0 + node_of_dense + to_FC Set Tactic Name: maxwell_fp32_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -3461203036104521071 [10/12/2021-21:20:02] [V] [TRT] Tactic: -3461203036104521071 Time: 0.012108 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/dense/quantize_and_dequantize_1/ReadVariableOp__626 + QuantLinearNode__1206_quantize_scale_node + shuffle_after_StatefulPartitionedCall/model/dense/quantize_and_dequantize_1:0 + node_of_dense + to_FC Set Tactic Name: maxwell_fp32_icudnn_int8x4_128x64_relu_interior_nn_v1 Tactic: -3429121835752071287 [10/12/2021-21:20:02] [V] [TRT] Tactic: -3429121835752071287 Time: 0.015104 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/dense/quantize_and_dequantize_1/ReadVariableOp__626 + QuantLinearNode__1206_quantize_scale_node + shuffle_after_StatefulPartitionedCall/model/dense/quantize_and_dequantize_1:0 + node_of_dense + to_FC Set Tactic Name: maxwell_fp32_icudnn_int8x4_128x128_relu_interior_nn_v1 Tactic: -2138468782077366182 [10/12/2021-21:20:02] [V] [TRT] Tactic: -2138468782077366182 Time: 0.013824 [10/12/2021-21:20:02] [V] [TRT] Fastest Tactic: -5622265363201188577 Time: 0.011648 [10/12/2021-21:20:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -5622265363201188577 [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning Reformat:Float(10,1,1,1) -> Half(10,1,1,1) *************** [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [10/12/2021-21:20:02] [V] [TRT] Setting a default quantization params because quantization data is missing for [10/12/2021-21:20:02] [V] [TRT] Tactic: 1002 Time: 0.012144 [10/12/2021-21:20:02] [V] [TRT] Setting a default quantization params because quantization data is missing for [10/12/2021-21:20:02] [V] [TRT] Tactic: 0 Time: 0.011948 [10/12/2021-21:20:02] [V] [TRT] Fastest Tactic: 0 Time: 0.011948 [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning Reformat:Float(10,1,1,1) -> Half(10,1,1,1) *************** [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [10/12/2021-21:20:02] [V] [TRT] Setting a default quantization params because quantization data is missing for [10/12/2021-21:20:02] [V] [TRT] Tactic: 1002 Time: 0.005084 [10/12/2021-21:20:02] [V] [TRT] Setting a default quantization params because quantization data is missing for [10/12/2021-21:20:02] [V] [TRT] Tactic: 0 Time: 0.008596 [10/12/2021-21:20:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.005084 [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning Reformat:Half(10,1,1,1) -> Float(10,1,1,1) *************** [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [10/12/2021-21:20:02] [V] [TRT] Setting a default quantization params because quantization data is missing for [10/12/2021-21:20:02] [V] [TRT] Tactic: 1002 Time: 0.016452 [10/12/2021-21:20:02] [V] [TRT] Setting a default quantization params because quantization data is missing for [10/12/2021-21:20:02] [V] [TRT] Tactic: 0 Time: 0.004056 [10/12/2021-21:20:02] [V] [TRT] Fastest Tactic: 0 Time: 0.004056 [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Float(10,1,1,1) -> Float(10,1) *************** [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: reshape_after_dense (Shuffle) [10/12/2021-21:20:02] [V] [TRT] Setting a default quantization params because quantization data is missing for reshape_after_dense [10/12/2021-21:20:02] [V] [TRT] Tactic: 0 Time: 0.00916 [10/12/2021-21:20:02] [V] [TRT] Fastest Tactic: 0 Time: 0.00916 [10/12/2021-21:20:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning format combination: Half(10,1,1,1) -> Half(10,1) *************** [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: reshape_after_dense (Shuffle) [10/12/2021-21:20:02] [V] [TRT] Setting a default quantization params because quantization data is missing for reshape_after_dense [10/12/2021-21:20:02] [V] [TRT] Tactic: 0 Time: 0.008212 [10/12/2021-21:20:02] [V] [TRT] Fastest Tactic: 0 Time: 0.008212 [10/12/2021-21:20:02] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [10/12/2021-21:20:02] [V] [TRT] *************** Autotuning Reformat:Half(10,1) -> Float(10,1) *************** [10/12/2021-21:20:02] [V] [TRT] --------------- Timing Runner: Optimizer Reformat (Reformat) [10/12/2021-21:20:02] [V] [TRT] Setting a default quantization params because quantization data is missing for [10/12/2021-21:20:02] [V] [TRT] Tactic: 1002 Time: 0.0095 [10/12/2021-21:20:02] [V] [TRT] Setting a default quantization params because quantization data is missing for [10/12/2021-21:20:02] [V] [TRT] Tactic: 0 Time: 0.010396 [10/12/2021-21:20:02] [V] [TRT] Fastest Tactic: 1002 Time: 0.0095 [10/12/2021-21:20:02] [V] [TRT] Formats and tactics selection completed in 0.799059 seconds. [10/12/2021-21:20:02] [V] [TRT] After reformat layers: 61 layers [10/12/2021-21:20:02] [V] [TRT] Block size 16777216 [10/12/2021-21:20:02] [V] [TRT] Block size 16384 [10/12/2021-21:20:02] [V] [TRT] Block size 16384 [10/12/2021-21:20:02] [V] [TRT] Block size 16384 [10/12/2021-21:20:02] [V] [TRT] Total Activation Memory: 16826368 [10/12/2021-21:20:02] [I] [TRT] Detected 1 inputs and 1 output network tensors. [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d/transpose__8 + QuantLinearNode__638_quantize_scale_node + StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/activation/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_1/transpose__20 + QuantLinearNode__650_quantize_scale_node + StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/activation_1/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_2/transpose__30 + QuantLinearNode__658_quantize_scale_node + StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/add/add + StatefulPartitionedCall/model/activation_2/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -2773311619323230421 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_3/transpose__42 + QuantLinearNode__670_quantize_scale_node + StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/activation_3/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_4/transpose__52 + QuantLinearNode__678_quantize_scale_node + StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/add_1/add + StatefulPartitionedCall/model/activation_4/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -2773311619323230421 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_5/transpose__64 + QuantLinearNode__690_quantize_scale_node + StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/activation_5/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_6/transpose__74 + QuantLinearNode__698_quantize_scale_node + StatefulPartitionedCall/model/conv2d_6/BiasAdd + StatefulPartitionedCall/model/add_2/add + StatefulPartitionedCall/model/activation_6/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -2773311619323230421 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_7/transpose__86 + QuantLinearNode__710_quantize_scale_node + StatefulPartitionedCall/model/conv2d_7/BiasAdd + StatefulPartitionedCall/model/activation_7/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_8/transpose__96 + QuantLinearNode__718_quantize_scale_node + StatefulPartitionedCall/model/conv2d_8/BiasAdd + StatefulPartitionedCall/model/add_3/add + StatefulPartitionedCall/model/activation_8/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -2773311619323230421 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_9/transpose__108 + QuantLinearNode__730_quantize_scale_node + StatefulPartitionedCall/model/conv2d_9/BiasAdd + StatefulPartitionedCall/model/activation_9/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_10/transpose__118 + QuantLinearNode__738_quantize_scale_node + StatefulPartitionedCall/model/conv2d_10/BiasAdd + StatefulPartitionedCall/model/add_4/add + StatefulPartitionedCall/model/activation_10/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -2773311619323230421 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_11/transpose__130 + QuantLinearNode__750_quantize_scale_node + StatefulPartitionedCall/model/conv2d_11/BiasAdd + StatefulPartitionedCall/model/activation_11/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_12/transpose__140 + QuantLinearNode__758_quantize_scale_node + StatefulPartitionedCall/model/conv2d_12/BiasAdd + StatefulPartitionedCall/model/add_5/add + StatefulPartitionedCall/model/activation_12/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -2773311619323230421 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_13/transpose__152 + QuantLinearNode__770_quantize_scale_node + StatefulPartitionedCall/model/conv2d_13/BiasAdd + StatefulPartitionedCall/model/activation_13/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_14/transpose__162 + QuantLinearNode__778_quantize_scale_node + StatefulPartitionedCall/model/conv2d_14/BiasAdd + StatefulPartitionedCall/model/add_6/add + StatefulPartitionedCall/model/activation_14/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -2773311619323230421 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_15/transpose__174 + QuantLinearNode__790_quantize_scale_node + StatefulPartitionedCall/model/conv2d_15/BiasAdd + StatefulPartitionedCall/model/activation_15/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_16/transpose__184 + QuantLinearNode__798_quantize_scale_node + StatefulPartitionedCall/model/conv2d_16/BiasAdd + StatefulPartitionedCall/model/add_7/add + StatefulPartitionedCall/model/activation_16/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -2773311619323230421 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_17/transpose__196 + QuantLinearNode__810_quantize_scale_node + StatefulPartitionedCall/model/conv2d_17/BiasAdd + StatefulPartitionedCall/model/activation_17/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_18/transpose__206 + QuantLinearNode__818_quantize_scale_node + StatefulPartitionedCall/model/conv2d_18/BiasAdd + StatefulPartitionedCall/model/add_8/add + StatefulPartitionedCall/model/activation_18/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -2773311619323230421 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_19/transpose__224 + QuantLinearNode__838_quantize_scale_node + StatefulPartitionedCall/model/conv2d_19/BiasAdd + StatefulPartitionedCall/model/activation_19/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x32_relu_small_nn_v1 Tactic: 205464780613168514 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_21/transpose__216 + QuantLinearNode__826_quantize_scale_node + StatefulPartitionedCall/model/conv2d_21/BiasAdd Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -2773311619323230421 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_20/transpose__234 + QuantLinearNode__846_quantize_scale_node + StatefulPartitionedCall/model/conv2d_20/BiasAdd + StatefulPartitionedCall/model/add_9/add + StatefulPartitionedCall/model/activation_20/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_23/transpose__256 + QuantLinearNode__866_quantize_scale_node + StatefulPartitionedCall/model/conv2d_23/BiasAdd + StatefulPartitionedCall/model/add_10/add + StatefulPartitionedCall/model/activation_22/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_25/transpose__278 + QuantLinearNode__886_quantize_scale_node + StatefulPartitionedCall/model/conv2d_25/BiasAdd + StatefulPartitionedCall/model/add_11/add + StatefulPartitionedCall/model/activation_24/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_27/transpose__300 + QuantLinearNode__906_quantize_scale_node + StatefulPartitionedCall/model/conv2d_27/BiasAdd + StatefulPartitionedCall/model/add_12/add + StatefulPartitionedCall/model/activation_26/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_29/transpose__322 + QuantLinearNode__926_quantize_scale_node + StatefulPartitionedCall/model/conv2d_29/BiasAdd + StatefulPartitionedCall/model/add_13/add + StatefulPartitionedCall/model/activation_28/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_31/transpose__344 + QuantLinearNode__946_quantize_scale_node + StatefulPartitionedCall/model/conv2d_31/BiasAdd + StatefulPartitionedCall/model/add_14/add + StatefulPartitionedCall/model/activation_30/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_33/transpose__366 + QuantLinearNode__966_quantize_scale_node + StatefulPartitionedCall/model/conv2d_33/BiasAdd + StatefulPartitionedCall/model/add_15/add + StatefulPartitionedCall/model/activation_32/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_35/transpose__388 + QuantLinearNode__986_quantize_scale_node + StatefulPartitionedCall/model/conv2d_35/BiasAdd + StatefulPartitionedCall/model/add_16/add + StatefulPartitionedCall/model/activation_34/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_37/transpose__410 + QuantLinearNode__1006_quantize_scale_node + StatefulPartitionedCall/model/conv2d_37/BiasAdd + StatefulPartitionedCall/model/add_17/add + StatefulPartitionedCall/model/activation_36/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_38/transpose__428 + QuantLinearNode__1026_quantize_scale_node + StatefulPartitionedCall/model/conv2d_38/BiasAdd + StatefulPartitionedCall/model/activation_37/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_40/transpose__420 + QuantLinearNode__1014_quantize_scale_node + StatefulPartitionedCall/model/conv2d_40/BiasAdd Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_39/transpose__438 + QuantLinearNode__1034_quantize_scale_node + StatefulPartitionedCall/model/conv2d_39/BiasAdd + StatefulPartitionedCall/model/add_18/add + StatefulPartitionedCall/model/activation_38/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_42/transpose__460 + QuantLinearNode__1054_quantize_scale_node + StatefulPartitionedCall/model/conv2d_42/BiasAdd + StatefulPartitionedCall/model/add_19/add + StatefulPartitionedCall/model/activation_40/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_44/transpose__482 + QuantLinearNode__1074_quantize_scale_node + StatefulPartitionedCall/model/conv2d_44/BiasAdd + StatefulPartitionedCall/model/add_20/add + StatefulPartitionedCall/model/activation_42/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_46/transpose__504 + QuantLinearNode__1094_quantize_scale_node + StatefulPartitionedCall/model/conv2d_46/BiasAdd + StatefulPartitionedCall/model/add_21/add + StatefulPartitionedCall/model/activation_44/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_48/transpose__526 + QuantLinearNode__1114_quantize_scale_node + StatefulPartitionedCall/model/conv2d_48/BiasAdd + StatefulPartitionedCall/model/add_22/add + StatefulPartitionedCall/model/activation_46/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_50/transpose__548 + QuantLinearNode__1134_quantize_scale_node + StatefulPartitionedCall/model/conv2d_50/BiasAdd + StatefulPartitionedCall/model/add_23/add + StatefulPartitionedCall/model/activation_48/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_52/transpose__570 + QuantLinearNode__1154_quantize_scale_node + StatefulPartitionedCall/model/conv2d_52/BiasAdd + StatefulPartitionedCall/model/add_24/add + StatefulPartitionedCall/model/activation_50/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_54/transpose__592 + QuantLinearNode__1174_quantize_scale_node + StatefulPartitionedCall/model/conv2d_54/BiasAdd + StatefulPartitionedCall/model/add_25/add + StatefulPartitionedCall/model/activation_52/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/conv2d_56/transpose__614 + QuantLinearNode__1194_quantize_scale_node + StatefulPartitionedCall/model/conv2d_56/BiasAdd + StatefulPartitionedCall/model/add_26/add + StatefulPartitionedCall/model/activation_54/Relu Set Tactic Name: maxwell_int8x4_icudnn_int8x4_128x64_relu_small_nn_v1 Tactic: -7665878956594041863 [10/12/2021-21:20:02] [V] [TRT] StatefulPartitionedCall/model/dense/quantize_and_dequantize_1/ReadVariableOp__626 + QuantLinearNode__1206_quantize_scale_node + shuffle_after_StatefulPartitionedCall/model/dense/quantize_and_dequantize_1:0 + node_of_dense + to_FC Set Tactic Name: maxwell_fp32_icudnn_int8x4_128x128_relu_small_nn_v1 Tactic: -5622265363201188577 [10/12/2021-21:20:02] [V] [TRT] Setting a default quantization params because quantization data is missing for QuantLinearNode__634_quantize_scale_node [10/12/2021-21:20:02] [V] [TRT] Layer: QuantLinearNode__634_quantize_scale_node HostPersistent: 0 DevicePersistent: 0 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d/transpose__8 + QuantLinearNode__638_quantize_scale_node + StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/activation/Relu HostPersistent: 1664 DevicePersistent: 8192 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_1/transpose__20 + QuantLinearNode__650_quantize_scale_node + StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/activation_1/Relu HostPersistent: 1664 DevicePersistent: 10240 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_2/transpose__30 + QuantLinearNode__658_quantize_scale_node + StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/add/add + StatefulPartitionedCall/model/activation_2/Relu HostPersistent: 1664 DevicePersistent: 11264 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_3/transpose__42 + QuantLinearNode__670_quantize_scale_node + StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/activation_3/Relu HostPersistent: 1664 DevicePersistent: 10240 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_4/transpose__52 + QuantLinearNode__678_quantize_scale_node + StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/add_1/add + StatefulPartitionedCall/model/activation_4/Relu HostPersistent: 1664 DevicePersistent: 11264 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_5/transpose__64 + QuantLinearNode__690_quantize_scale_node + StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/activation_5/Relu HostPersistent: 1664 DevicePersistent: 10240 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_6/transpose__74 + QuantLinearNode__698_quantize_scale_node + StatefulPartitionedCall/model/conv2d_6/BiasAdd + StatefulPartitionedCall/model/add_2/add + StatefulPartitionedCall/model/activation_6/Relu HostPersistent: 1664 DevicePersistent: 11264 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_7/transpose__86 + QuantLinearNode__710_quantize_scale_node + StatefulPartitionedCall/model/conv2d_7/BiasAdd + StatefulPartitionedCall/model/activation_7/Relu HostPersistent: 1664 DevicePersistent: 10240 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_8/transpose__96 + QuantLinearNode__718_quantize_scale_node + StatefulPartitionedCall/model/conv2d_8/BiasAdd + StatefulPartitionedCall/model/add_3/add + StatefulPartitionedCall/model/activation_8/Relu HostPersistent: 1664 DevicePersistent: 11264 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_9/transpose__108 + QuantLinearNode__730_quantize_scale_node + StatefulPartitionedCall/model/conv2d_9/BiasAdd + StatefulPartitionedCall/model/activation_9/Relu HostPersistent: 1664 DevicePersistent: 10240 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_10/transpose__118 + QuantLinearNode__738_quantize_scale_node + StatefulPartitionedCall/model/conv2d_10/BiasAdd + StatefulPartitionedCall/model/add_4/add + StatefulPartitionedCall/model/activation_10/Relu HostPersistent: 1664 DevicePersistent: 11264 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_11/transpose__130 + QuantLinearNode__750_quantize_scale_node + StatefulPartitionedCall/model/conv2d_11/BiasAdd + StatefulPartitionedCall/model/activation_11/Relu HostPersistent: 1664 DevicePersistent: 10240 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_12/transpose__140 + QuantLinearNode__758_quantize_scale_node + StatefulPartitionedCall/model/conv2d_12/BiasAdd + StatefulPartitionedCall/model/add_5/add + StatefulPartitionedCall/model/activation_12/Relu HostPersistent: 1664 DevicePersistent: 11264 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_13/transpose__152 + QuantLinearNode__770_quantize_scale_node + StatefulPartitionedCall/model/conv2d_13/BiasAdd + StatefulPartitionedCall/model/activation_13/Relu HostPersistent: 1664 DevicePersistent: 10240 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_14/transpose__162 + QuantLinearNode__778_quantize_scale_node + StatefulPartitionedCall/model/conv2d_14/BiasAdd + StatefulPartitionedCall/model/add_6/add + StatefulPartitionedCall/model/activation_14/Relu HostPersistent: 1664 DevicePersistent: 11264 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_15/transpose__174 + QuantLinearNode__790_quantize_scale_node + StatefulPartitionedCall/model/conv2d_15/BiasAdd + StatefulPartitionedCall/model/activation_15/Relu HostPersistent: 1664 DevicePersistent: 10240 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_16/transpose__184 + QuantLinearNode__798_quantize_scale_node + StatefulPartitionedCall/model/conv2d_16/BiasAdd + StatefulPartitionedCall/model/add_7/add + StatefulPartitionedCall/model/activation_16/Relu HostPersistent: 1664 DevicePersistent: 11264 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_17/transpose__196 + QuantLinearNode__810_quantize_scale_node + StatefulPartitionedCall/model/conv2d_17/BiasAdd + StatefulPartitionedCall/model/activation_17/Relu HostPersistent: 1664 DevicePersistent: 10240 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_18/transpose__206 + QuantLinearNode__818_quantize_scale_node + StatefulPartitionedCall/model/conv2d_18/BiasAdd + StatefulPartitionedCall/model/add_8/add + StatefulPartitionedCall/model/activation_18/Relu HostPersistent: 1664 DevicePersistent: 11264 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_19/transpose__224 + QuantLinearNode__838_quantize_scale_node + StatefulPartitionedCall/model/conv2d_19/BiasAdd + StatefulPartitionedCall/model/activation_19/Relu HostPersistent: 1664 DevicePersistent: 7168 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_21/transpose__216 + QuantLinearNode__826_quantize_scale_node + StatefulPartitionedCall/model/conv2d_21/BiasAdd HostPersistent: 1664 DevicePersistent: 5120 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_20/transpose__234 + QuantLinearNode__846_quantize_scale_node + StatefulPartitionedCall/model/conv2d_20/BiasAdd + StatefulPartitionedCall/model/add_9/add + StatefulPartitionedCall/model/activation_20/Relu HostPersistent: 1664 DevicePersistent: 12288 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_22/transpose__246 + QuantLinearNode__858_quantize_scale_node + StatefulPartitionedCall/model/conv2d_22/BiasAdd + StatefulPartitionedCall/model/activation_21/Relu HostPersistent: 2192 DevicePersistent: 0 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_23/transpose__256 + QuantLinearNode__866_quantize_scale_node + StatefulPartitionedCall/model/conv2d_23/BiasAdd + StatefulPartitionedCall/model/add_10/add + StatefulPartitionedCall/model/activation_22/Relu HostPersistent: 1664 DevicePersistent: 12288 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_24/transpose__268 + QuantLinearNode__878_quantize_scale_node + StatefulPartitionedCall/model/conv2d_24/BiasAdd + StatefulPartitionedCall/model/activation_23/Relu HostPersistent: 2192 DevicePersistent: 0 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_25/transpose__278 + QuantLinearNode__886_quantize_scale_node + StatefulPartitionedCall/model/conv2d_25/BiasAdd + StatefulPartitionedCall/model/add_11/add + StatefulPartitionedCall/model/activation_24/Relu HostPersistent: 1664 DevicePersistent: 12288 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_26/transpose__290 + QuantLinearNode__898_quantize_scale_node + StatefulPartitionedCall/model/conv2d_26/BiasAdd + StatefulPartitionedCall/model/activation_25/Relu HostPersistent: 2192 DevicePersistent: 0 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_27/transpose__300 + QuantLinearNode__906_quantize_scale_node + StatefulPartitionedCall/model/conv2d_27/BiasAdd + StatefulPartitionedCall/model/add_12/add + StatefulPartitionedCall/model/activation_26/Relu HostPersistent: 1664 DevicePersistent: 12288 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_28/transpose__312 + QuantLinearNode__918_quantize_scale_node + StatefulPartitionedCall/model/conv2d_28/BiasAdd + StatefulPartitionedCall/model/activation_27/Relu HostPersistent: 2192 DevicePersistent: 0 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_29/transpose__322 + QuantLinearNode__926_quantize_scale_node + StatefulPartitionedCall/model/conv2d_29/BiasAdd + StatefulPartitionedCall/model/add_13/add + StatefulPartitionedCall/model/activation_28/Relu HostPersistent: 1664 DevicePersistent: 12288 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_30/transpose__334 + QuantLinearNode__938_quantize_scale_node + StatefulPartitionedCall/model/conv2d_30/BiasAdd + StatefulPartitionedCall/model/activation_29/Relu HostPersistent: 2192 DevicePersistent: 0 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_31/transpose__344 + QuantLinearNode__946_quantize_scale_node + StatefulPartitionedCall/model/conv2d_31/BiasAdd + StatefulPartitionedCall/model/add_14/add + StatefulPartitionedCall/model/activation_30/Relu HostPersistent: 1664 DevicePersistent: 12288 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_32/transpose__356 + QuantLinearNode__958_quantize_scale_node + StatefulPartitionedCall/model/conv2d_32/BiasAdd + StatefulPartitionedCall/model/activation_31/Relu HostPersistent: 2192 DevicePersistent: 0 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_33/transpose__366 + QuantLinearNode__966_quantize_scale_node + StatefulPartitionedCall/model/conv2d_33/BiasAdd + StatefulPartitionedCall/model/add_15/add + StatefulPartitionedCall/model/activation_32/Relu HostPersistent: 1664 DevicePersistent: 12288 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_34/transpose__378 + QuantLinearNode__978_quantize_scale_node + StatefulPartitionedCall/model/conv2d_34/BiasAdd + StatefulPartitionedCall/model/activation_33/Relu HostPersistent: 2192 DevicePersistent: 0 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_35/transpose__388 + QuantLinearNode__986_quantize_scale_node + StatefulPartitionedCall/model/conv2d_35/BiasAdd + StatefulPartitionedCall/model/add_16/add + StatefulPartitionedCall/model/activation_34/Relu HostPersistent: 1664 DevicePersistent: 12288 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_36/transpose__400 + QuantLinearNode__998_quantize_scale_node + StatefulPartitionedCall/model/conv2d_36/BiasAdd + StatefulPartitionedCall/model/activation_35/Relu HostPersistent: 2192 DevicePersistent: 0 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_37/transpose__410 + QuantLinearNode__1006_quantize_scale_node + StatefulPartitionedCall/model/conv2d_37/BiasAdd + StatefulPartitionedCall/model/add_17/add + StatefulPartitionedCall/model/activation_36/Relu HostPersistent: 1664 DevicePersistent: 12288 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_38/transpose__428 + QuantLinearNode__1026_quantize_scale_node + StatefulPartitionedCall/model/conv2d_38/BiasAdd + StatefulPartitionedCall/model/activation_37/Relu HostPersistent: 1664 DevicePersistent: 20480 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_40/transpose__420 + QuantLinearNode__1014_quantize_scale_node + StatefulPartitionedCall/model/conv2d_40/BiasAdd HostPersistent: 1664 DevicePersistent: 4096 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_39/transpose__438 + QuantLinearNode__1034_quantize_scale_node + StatefulPartitionedCall/model/conv2d_39/BiasAdd + StatefulPartitionedCall/model/add_18/add + StatefulPartitionedCall/model/activation_38/Relu HostPersistent: 1664 DevicePersistent: 38912 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_41/transpose__450 + QuantLinearNode__1046_quantize_scale_node + StatefulPartitionedCall/model/conv2d_41/BiasAdd + StatefulPartitionedCall/model/activation_39/Relu HostPersistent: 2192 DevicePersistent: 0 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_42/transpose__460 + QuantLinearNode__1054_quantize_scale_node + StatefulPartitionedCall/model/conv2d_42/BiasAdd + StatefulPartitionedCall/model/add_19/add + StatefulPartitionedCall/model/activation_40/Relu HostPersistent: 1664 DevicePersistent: 38912 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_43/transpose__472 + QuantLinearNode__1066_quantize_scale_node + StatefulPartitionedCall/model/conv2d_43/BiasAdd + StatefulPartitionedCall/model/activation_41/Relu HostPersistent: 2192 DevicePersistent: 0 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_44/transpose__482 + QuantLinearNode__1074_quantize_scale_node + StatefulPartitionedCall/model/conv2d_44/BiasAdd + StatefulPartitionedCall/model/add_20/add + StatefulPartitionedCall/model/activation_42/Relu HostPersistent: 1664 DevicePersistent: 38912 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_45/transpose__494 + QuantLinearNode__1086_quantize_scale_node + StatefulPartitionedCall/model/conv2d_45/BiasAdd + StatefulPartitionedCall/model/activation_43/Relu HostPersistent: 2192 DevicePersistent: 0 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_46/transpose__504 + QuantLinearNode__1094_quantize_scale_node + StatefulPartitionedCall/model/conv2d_46/BiasAdd + StatefulPartitionedCall/model/add_21/add + StatefulPartitionedCall/model/activation_44/Relu HostPersistent: 1664 DevicePersistent: 38912 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_47/transpose__516 + QuantLinearNode__1106_quantize_scale_node + StatefulPartitionedCall/model/conv2d_47/BiasAdd + StatefulPartitionedCall/model/activation_45/Relu HostPersistent: 2192 DevicePersistent: 0 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_48/transpose__526 + QuantLinearNode__1114_quantize_scale_node + StatefulPartitionedCall/model/conv2d_48/BiasAdd + StatefulPartitionedCall/model/add_22/add + StatefulPartitionedCall/model/activation_46/Relu HostPersistent: 1664 DevicePersistent: 38912 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_49/transpose__538 + QuantLinearNode__1126_quantize_scale_node + StatefulPartitionedCall/model/conv2d_49/BiasAdd + StatefulPartitionedCall/model/activation_47/Relu HostPersistent: 2192 DevicePersistent: 0 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_50/transpose__548 + QuantLinearNode__1134_quantize_scale_node + StatefulPartitionedCall/model/conv2d_50/BiasAdd + StatefulPartitionedCall/model/add_23/add + StatefulPartitionedCall/model/activation_48/Relu HostPersistent: 1664 DevicePersistent: 38912 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_51/transpose__560 + QuantLinearNode__1146_quantize_scale_node + StatefulPartitionedCall/model/conv2d_51/BiasAdd + StatefulPartitionedCall/model/activation_49/Relu HostPersistent: 2192 DevicePersistent: 0 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_52/transpose__570 + QuantLinearNode__1154_quantize_scale_node + StatefulPartitionedCall/model/conv2d_52/BiasAdd + StatefulPartitionedCall/model/add_24/add + StatefulPartitionedCall/model/activation_50/Relu HostPersistent: 1664 DevicePersistent: 38912 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_53/transpose__582 + QuantLinearNode__1166_quantize_scale_node + StatefulPartitionedCall/model/conv2d_53/BiasAdd + StatefulPartitionedCall/model/activation_51/Relu HostPersistent: 2192 DevicePersistent: 0 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_54/transpose__592 + QuantLinearNode__1174_quantize_scale_node + StatefulPartitionedCall/model/conv2d_54/BiasAdd + StatefulPartitionedCall/model/add_25/add + StatefulPartitionedCall/model/activation_52/Relu HostPersistent: 1664 DevicePersistent: 38912 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_55/transpose__604 + QuantLinearNode__1186_quantize_scale_node + StatefulPartitionedCall/model/conv2d_55/BiasAdd + StatefulPartitionedCall/model/activation_53/Relu HostPersistent: 2192 DevicePersistent: 0 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/conv2d_56/transpose__614 + QuantLinearNode__1194_quantize_scale_node + StatefulPartitionedCall/model/conv2d_56/BiasAdd + StatefulPartitionedCall/model/add_26/add + StatefulPartitionedCall/model/activation_54/Relu HostPersistent: 1664 DevicePersistent: 38912 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/global_average_pooling2d/Mean HostPersistent: 0 DevicePersistent: 0 [10/12/2021-21:20:02] [V] [TRT] Layer: StatefulPartitionedCall/model/dense/quantize_and_dequantize_1/ReadVariableOp__626 + QuantLinearNode__1206_quantize_scale_node + shuffle_after_StatefulPartitionedCall/model/dense/quantize_and_dequantize_1:0 + node_of_dense + to_FC HostPersistent: 1664 DevicePersistent: 3584 [10/12/2021-21:20:02] [I] [TRT] Total Host Persistent Memory: 104960 [10/12/2021-21:20:02] [I] [TRT] Total Device Persistent Memory: 702976 [10/12/2021-21:20:02] [I] [TRT] Total Scratch Memory: 0 [10/12/2021-21:20:02] [I] [TRT] [MemUsageStats] Peak memory usage of TRT CPU/GPU memory allocators: CPU 4 MiB, GPU 4 MiB [10/12/2021-21:20:02] [V] [TRT] Using cublas a tactic source [10/12/2021-21:20:02] [10/12/2021-21:20:02] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +8, now: CPU 9446, GPU 1143 (MiB) [10/12/2021-21:20:02] [V] [TRT] Using cuDNN as a tactic source [10/12/2021-21:20:02] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +8, now: CPU 9446, GPU 1151 (MiB) [10/12/2021-21:20:02] [10/12/2021-21:20:02] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +0, now: CPU 9446, GPU 1135 (MiB) [10/12/2021-21:20:02] [V] [TRT] Engine generation completed in 1.79382 seconds. [10/12/2021-21:20:02] [V] [TRT] Deleting timing cache: 18 entries, 46 hits [10/12/2021-21:20:02] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +0, now: CPU 9445, GPU 1119 (MiB) [10/12/2021-21:20:02] [V] [TRT] Engine Layer Information: Layer(Scale): QuantLinearNode__634_quantize_scale_node, Tactic: 0, input_1[Float(1,3,32,32)] -> QuantLinearNode__634:0[Int8(1,3,32,32)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d/transpose__8 + QuantLinearNode__638_quantize_scale_node + StatefulPartitionedCall/model/conv2d/BiasAdd + StatefulPartitionedCall/model/activation/Relu, Tactic: -7665878956594041863, QuantLinearNode__634:0[Int8(1,3,32,32)] -> QuantLinearNode__646:0[Int8(1,16,32,32)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_1/transpose__20 + QuantLinearNode__650_quantize_scale_node + StatefulPartitionedCall/model/conv2d_1/BiasAdd + StatefulPartitionedCall/model/activation_1/Relu, Tactic: -7665878956594041863, QuantLinearNode__646:0[Int8(1,16,32,32)] -> QuantLinearNode__654:0[Int8(1,16,32,32)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_2/transpose__30 + QuantLinearNode__658_quantize_scale_node + StatefulPartitionedCall/model/conv2d_2/BiasAdd + StatefulPartitionedCall/model/add/add + StatefulPartitionedCall/model/activation_2/Relu, Tactic: -2773311619323230421, QuantLinearNode__654:0[Int8(1,16,32,32)], QuantLinearNode__646:0[Int8(1,16,32,32)] -> QuantLinearNode__666:0[Int8(1,16,32,32)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_3/transpose__42 + QuantLinearNode__670_quantize_scale_node + StatefulPartitionedCall/model/conv2d_3/BiasAdd + StatefulPartitionedCall/model/activation_3/Relu, Tactic: -7665878956594041863, QuantLinearNode__666:0[Int8(1,16,32,32)] -> QuantLinearNode__674:0[Int8(1,16,32,32)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_4/transpose__52 + QuantLinearNode__678_quantize_scale_node + StatefulPartitionedCall/model/conv2d_4/BiasAdd + StatefulPartitionedCall/model/add_1/add + StatefulPartitionedCall/model/activation_4/Relu, Tactic: -2773311619323230421, QuantLinearNode__674:0[Int8(1,16,32,32)], QuantLinearNode__666:0[Int8(1,16,32,32)] -> QuantLinearNode__686:0[Int8(1,16,32,32)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_5/transpose__64 + QuantLinearNode__690_quantize_scale_node + StatefulPartitionedCall/model/conv2d_5/BiasAdd + StatefulPartitionedCall/model/activation_5/Relu, Tactic: -7665878956594041863, QuantLinearNode__686:0[Int8(1,16,32,32)] -> QuantLinearNode__694:0[Int8(1,16,32,32)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_6/transpose__74 + QuantLinearNode__698_quantize_scale_node + StatefulPartitionedCall/model/conv2d_6/BiasAdd + StatefulPartitionedCall/model/add_2/add + StatefulPartitionedCall/model/activation_6/Relu, Tactic: -2773311619323230421, QuantLinearNode__694:0[Int8(1,16,32,32)], QuantLinearNode__686:0[Int8(1,16,32,32)] -> QuantLinearNode__706:0[Int8(1,16,32,32)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_7/transpose__86 + QuantLinearNode__710_quantize_scale_node + StatefulPartitionedCall/model/conv2d_7/BiasAdd + StatefulPartitionedCall/model/activation_7/Relu, Tactic: -7665878956594041863, QuantLinearNode__706:0[Int8(1,16,32,32)] -> QuantLinearNode__714:0[Int8(1,16,32,32)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_8/transpose__96 + QuantLinearNode__718_quantize_scale_node + StatefulPartitionedCall/model/conv2d_8/BiasAdd + StatefulPartitionedCall/model/add_3/add + StatefulPartitionedCall/model/activation_8/Relu, Tactic: -2773311619323230421, QuantLinearNode__714:0[Int8(1,16,32,32)], QuantLinearNode__706:0[Int8(1,16,32,32)] -> QuantLinearNode__726:0[Int8(1,16,32,32)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_9/transpose__108 + QuantLinearNode__730_quantize_scale_node + StatefulPartitionedCall/model/conv2d_9/BiasAdd + StatefulPartitionedCall/model/activation_9/Relu, Tactic: -7665878956594041863, QuantLinearNode__726:0[Int8(1,16,32,32)] -> QuantLinearNode__734:0[Int8(1,16,32,32)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_10/transpose__118 + QuantLinearNode__738_quantize_scale_node + StatefulPartitionedCall/model/conv2d_10/BiasAdd + StatefulPartitionedCall/model/add_4/add + StatefulPartitionedCall/model/activation_10/Relu, Tactic: -2773311619323230421, QuantLinearNode__734:0[Int8(1,16,32,32)], QuantLinearNode__726:0[Int8(1,16,32,32)] -> QuantLinearNode__746:0[Int8(1,16,32,32)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_11/transpose__130 + QuantLinearNode__750_quantize_scale_node + StatefulPartitionedCall/model/conv2d_11/BiasAdd + StatefulPartitionedCall/model/activation_11/Relu, Tactic: -7665878956594041863, QuantLinearNode__746:0[Int8(1,16,32,32)] -> QuantLinearNode__754:0[Int8(1,16,32,32)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_12/transpose__140 + QuantLinearNode__758_quantize_scale_node + StatefulPartitionedCall/model/conv2d_12/BiasAdd + StatefulPartitionedCall/model/add_5/add + StatefulPartitionedCall/model/activation_12/Relu, Tactic: -2773311619323230421, QuantLinearNode__754:0[Int8(1,16,32,32)], QuantLinearNode__746:0[Int8(1,16,32,32)] -> QuantLinearNode__766:0[Int8(1,16,32,32)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_13/transpose__152 + QuantLinearNode__770_quantize_scale_node + StatefulPartitionedCall/model/conv2d_13/BiasAdd + StatefulPartitionedCall/model/activation_13/Relu, Tactic: -7665878956594041863, QuantLinearNode__766:0[Int8(1,16,32,32)] -> QuantLinearNode__774:0[Int8(1,16,32,32)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_14/transpose__162 + QuantLinearNode__778_quantize_scale_node + StatefulPartitionedCall/model/conv2d_14/BiasAdd + StatefulPartitionedCall/model/add_6/add + StatefulPartitionedCall/model/activation_14/Relu, Tactic: -2773311619323230421, QuantLinearNode__774:0[Int8(1,16,32,32)], QuantLinearNode__766:0[Int8(1,16,32,32)] -> QuantLinearNode__786:0[Int8(1,16,32,32)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_15/transpose__174 + QuantLinearNode__790_quantize_scale_node + StatefulPartitionedCall/model/conv2d_15/BiasAdd + StatefulPartitionedCall/model/activation_15/Relu, Tactic: -7665878956594041863, QuantLinearNode__786:0[Int8(1,16,32,32)] -> QuantLinearNode__794:0[Int8(1,16,32,32)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_16/transpose__184 + QuantLinearNode__798_quantize_scale_node + StatefulPartitionedCall/model/conv2d_16/BiasAdd + StatefulPartitionedCall/model/add_7/add + StatefulPartitionedCall/model/activation_16/Relu, Tactic: -2773311619323230421, QuantLinearNode__794:0[Int8(1,16,32,32)], QuantLinearNode__786:0[Int8(1,16,32,32)] -> QuantLinearNode__806:0[Int8(1,16,32,32)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_17/transpose__196 + QuantLinearNode__810_quantize_scale_node + StatefulPartitionedCall/model/conv2d_17/BiasAdd + StatefulPartitionedCall/model/activation_17/Relu, Tactic: -7665878956594041863, QuantLinearNode__806:0[Int8(1,16,32,32)] -> QuantLinearNode__814:0[Int8(1,16,32,32)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_18/transpose__206 + QuantLinearNode__818_quantize_scale_node + StatefulPartitionedCall/model/conv2d_18/BiasAdd + StatefulPartitionedCall/model/add_8/add + StatefulPartitionedCall/model/activation_18/Relu, Tactic: -2773311619323230421, QuantLinearNode__814:0[Int8(1,16,32,32)], QuantLinearNode__806:0[Int8(1,16,32,32)] -> QuantLinearNode__834:0[Int8(1,16,32,32)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_19/transpose__224 + QuantLinearNode__838_quantize_scale_node + StatefulPartitionedCall/model/conv2d_19/BiasAdd + StatefulPartitionedCall/model/activation_19/Relu, Tactic: 205464780613168514, QuantLinearNode__834:0[Int8(1,16,32,32)] -> QuantLinearNode__842:0[Int8(1,32,16,16)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_21/transpose__216 + QuantLinearNode__826_quantize_scale_node + StatefulPartitionedCall/model/conv2d_21/BiasAdd, Tactic: -2773311619323230421, QuantLinearNode__834:0[Int8(1,16,32,32)] -> QuantLinearNode__830:0[Int8(1,32,16,16)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_20/transpose__234 + QuantLinearNode__846_quantize_scale_node + StatefulPartitionedCall/model/conv2d_20/BiasAdd + StatefulPartitionedCall/model/add_9/add + StatefulPartitionedCall/model/activation_20/Relu, Tactic: -7665878956594041863, QuantLinearNode__842:0[Int8(1,32,16,16)], QuantLinearNode__830:0[Int8(1,32,16,16)] -> QuantLinearNode__854:0[Int8(1,32,16,16)] Layer(FusedConvActConvolution): StatefulPartitionedCall/model/conv2d_22/transpose__246 + QuantLinearNode__858_quantize_scale_node + StatefulPartitionedCall/model/conv2d_22/BiasAdd + StatefulPartitionedCall/model/activation_21/Relu, Tactic: 10682367, QuantLinearNode__854:0[Int8(1,32,16,16)] -> QuantLinearNode__862:0[Int8(1,32,16,16)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_23/transpose__256 + QuantLinearNode__866_quantize_scale_node + StatefulPartitionedCall/model/conv2d_23/BiasAdd + StatefulPartitionedCall/model/add_10/add + StatefulPartitionedCall/model/activation_22/Relu, Tactic: -7665878956594041863, QuantLinearNode__862:0[Int8(1,32,16,16)], QuantLinearNode__854:0[Int8(1,32,16,16)] -> QuantLinearNode__874:0[Int8(1,32,16,16)] Layer(FusedConvActConvolution): StatefulPartitionedCall/model/conv2d_24/transpose__268 + QuantLinearNode__878_quantize_scale_node + StatefulPartitionedCall/model/conv2d_24/BiasAdd + StatefulPartitionedCall/model/activation_23/Relu, Tactic: 10682367, QuantLinearNode__874:0[Int8(1,32,16,16)] -> QuantLinearNode__882:0[Int8(1,32,16,16)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_25/transpose__278 + QuantLinearNode__886_quantize_scale_node + StatefulPartitionedCall/model/conv2d_25/BiasAdd + StatefulPartitionedCall/model/add_11/add + StatefulPartitionedCall/model/activation_24/Relu, Tactic: -7665878956594041863, QuantLinearNode__882:0[Int8(1,32,16,16)], QuantLinearNode__874:0[Int8(1,32,16,16)] -> QuantLinearNode__894:0[Int8(1,32,16,16)] Layer(FusedConvActConvolution): StatefulPartitionedCall/model/conv2d_26/transpose__290 + QuantLinearNode__898_quantize_scale_node + StatefulPartitionedCall/model/conv2d_26/BiasAdd + StatefulPartitionedCall/model/activation_25/Relu, Tactic: 10682367, QuantLinearNode__894:0[Int8(1,32,16,16)] -> QuantLinearNode__902:0[Int8(1,32,16,16)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_27/transpose__300 + QuantLinearNode__906_quantize_scale_node + StatefulPartitionedCall/model/conv2d_27/BiasAdd + StatefulPartitionedCall/model/add_12/add + StatefulPartitionedCall/model/activation_26/Relu, Tactic: -7665878956594041863, QuantLinearNode__902:0[Int8(1,32,16,16)], QuantLinearNode__894:0[Int8(1,32,16,16)] -> QuantLinearNode__914:0[Int8(1,32,16,16)] Layer(FusedConvActConvolution): StatefulPartitionedCall/model/conv2d_28/transpose__312 + QuantLinearNode__918_quantize_scale_node + StatefulPartitionedCall/model/conv2d_28/BiasAdd + StatefulPartitionedCall/model/activation_27/Relu, Tactic: 10682367, QuantLinearNode__914:0[Int8(1,32,16,16)] -> QuantLinearNode__922:0[Int8(1,32,16,16)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_29/transpose__322 + QuantLinearNode__926_quantize_scale_node + StatefulPartitionedCall/model/conv2d_29/BiasAdd + StatefulPartitionedCall/model/add_13/add + StatefulPartitionedCall/model/activation_28/Relu, Tactic: -7665878956594041863, QuantLinearNode__922:0[Int8(1,32,16,16)], QuantLinearNode__914:0[Int8(1,32,16,16)] -> QuantLinearNode__934:0[Int8(1,32,16,16)] Layer(FusedConvActConvolution): StatefulPartitionedCall/model/conv2d_30/transpose__334 + QuantLinearNode__938_quantize_scale_node + StatefulPartitionedCall/model/conv2d_30/BiasAdd + StatefulPartitionedCall/model/activation_29/Relu, Tactic: 10682367, QuantLinearNode__934:0[Int8(1,32,16,16)] -> QuantLinearNode__942:0[Int8(1,32,16,16)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_31/transpose__344 + QuantLinearNode__946_quantize_scale_node + StatefulPartitionedCall/model/conv2d_31/BiasAdd + StatefulPartitionedCall/model/add_14/add + StatefulPartitionedCall/model/activation_30/Relu, Tactic: -7665878956594041863, QuantLinearNode__942:0[Int8(1,32,16,16)], QuantLinearNode__934:0[Int8(1,32,16,16)] -> QuantLinearNode__954:0[Int8(1,32,16,16)] Layer(FusedConvActConvolution): StatefulPartitionedCall/model/conv2d_32/transpose__356 + QuantLinearNode__958_quantize_scale_node + StatefulPartitionedCall/model/conv2d_32/BiasAdd + StatefulPartitionedCall/model/activation_31/Relu, Tactic: 10682367, QuantLinearNode__954:0[Int8(1,32,16,16)] -> QuantLinearNode__962:0[Int8(1,32,16,16)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_33/transpose__366 + QuantLinearNode__966_quantize_scale_node + StatefulPartitionedCall/model/conv2d_33/BiasAdd + StatefulPartitionedCall/model/add_15/add + StatefulPartitionedCall/model/activation_32/Relu, Tactic: -7665878956594041863, QuantLinearNode__962:0[Int8(1,32,16,16)], QuantLinearNode__954:0[Int8(1,32,16,16)] -> QuantLinearNode__974:0[Int8(1,32,16,16)] Layer(FusedConvActConvolution): StatefulPartitionedCall/model/conv2d_34/transpose__378 + QuantLinearNode__978_quantize_scale_node + StatefulPartitionedCall/model/conv2d_34/BiasAdd + StatefulPartitionedCall/model/activation_33/Relu, Tactic: 10682367, QuantLinearNode__974:0[Int8(1,32,16,16)] -> QuantLinearNode__982:0[Int8(1,32,16,16)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_35/transpose__388 + QuantLinearNode__986_quantize_scale_node + StatefulPartitionedCall/model/conv2d_35/BiasAdd + StatefulPartitionedCall/model/add_16/add + StatefulPartitionedCall/model/activation_34/Relu, Tactic: -7665878956594041863, QuantLinearNode__982:0[Int8(1,32,16,16)], QuantLinearNode__974:0[Int8(1,32,16,16)] -> QuantLinearNode__994:0[Int8(1,32,16,16)] Layer(FusedConvActConvolution): StatefulPartitionedCall/model/conv2d_36/transpose__400 + QuantLinearNode__998_quantize_scale_node + StatefulPartitionedCall/model/conv2d_36/BiasAdd + StatefulPartitionedCall/model/activation_35/Relu, Tactic: 10682367, QuantLinearNode__994:0[Int8(1,32,16,16)] -> QuantLinearNode__1002:0[Int8(1,32,16,16)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_37/transpose__410 + QuantLinearNode__1006_quantize_scale_node + StatefulPartitionedCall/model/conv2d_37/BiasAdd + StatefulPartitionedCall/model/add_17/add + StatefulPartitionedCall/model/activation_36/Relu, Tactic: -7665878956594041863, QuantLinearNode__1002:0[Int8(1,32,16,16)], QuantLinearNode__994:0[Int8(1,32,16,16)] -> QuantLinearNode__1022:0[Int8(1,32,16,16)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_38/transpose__428 + QuantLinearNode__1026_quantize_scale_node + StatefulPartitionedCall/model/conv2d_38/BiasAdd + StatefulPartitionedCall/model/activation_37/Relu, Tactic: -7665878956594041863, QuantLinearNode__1022:0[Int8(1,32,16,16)] -> QuantLinearNode__1030:0[Int8(1,64,8,8)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_40/transpose__420 + QuantLinearNode__1014_quantize_scale_node + StatefulPartitionedCall/model/conv2d_40/BiasAdd, Tactic: -7665878956594041863, QuantLinearNode__1022:0[Int8(1,32,16,16)] -> QuantLinearNode__1018:0[Int8(1,64,8,8)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_39/transpose__438 + QuantLinearNode__1034_quantize_scale_node + StatefulPartitionedCall/model/conv2d_39/BiasAdd + StatefulPartitionedCall/model/add_18/add + StatefulPartitionedCall/model/activation_38/Relu, Tactic: -7665878956594041863, QuantLinearNode__1030:0[Int8(1,64,8,8)], QuantLinearNode__1018:0[Int8(1,64,8,8)] -> QuantLinearNode__1042:0[Int8(1,64,8,8)] Layer(FusedConvActConvolution): StatefulPartitionedCall/model/conv2d_41/transpose__450 + QuantLinearNode__1046_quantize_scale_node + StatefulPartitionedCall/model/conv2d_41/BiasAdd + StatefulPartitionedCall/model/activation_39/Relu, Tactic: 7274495, QuantLinearNode__1042:0[Int8(1,64,8,8)] -> QuantLinearNode__1050:0[Int8(1,64,8,8)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_42/transpose__460 + QuantLinearNode__1054_quantize_scale_node + StatefulPartitionedCall/model/conv2d_42/BiasAdd + StatefulPartitionedCall/model/add_19/add + StatefulPartitionedCall/model/activation_40/Relu, Tactic: -7665878956594041863, QuantLinearNode__1050:0[Int8(1,64,8,8)], QuantLinearNode__1042:0[Int8(1,64,8,8)] -> QuantLinearNode__1062:0[Int8(1,64,8,8)] Layer(FusedConvActConvolution): StatefulPartitionedCall/model/conv2d_43/transpose__472 + QuantLinearNode__1066_quantize_scale_node + StatefulPartitionedCall/model/conv2d_43/BiasAdd + StatefulPartitionedCall/model/activation_41/Relu, Tactic: 7274495, QuantLinearNode__1062:0[Int8(1,64,8,8)] -> QuantLinearNode__1070:0[Int8(1,64,8,8)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_44/transpose__482 + QuantLinearNode__1074_quantize_scale_node + StatefulPartitionedCall/model/conv2d_44/BiasAdd + StatefulPartitionedCall/model/add_20/add + StatefulPartitionedCall/model/activation_42/Relu, Tactic: -7665878956594041863, QuantLinearNode__1070:0[Int8(1,64,8,8)], QuantLinearNode__1062:0[Int8(1,64,8,8)] -> QuantLinearNode__1082:0[Int8(1,64,8,8)] Layer(FusedConvActConvolution): StatefulPartitionedCall/model/conv2d_45/transpose__494 + QuantLinearNode__1086_quantize_scale_node + StatefulPartitionedCall/model/conv2d_45/BiasAdd + StatefulPartitionedCall/model/activation_43/Relu, Tactic: 7274495, QuantLinearNode__1082:0[Int8(1,64,8,8)] -> QuantLinearNode__1090:0[Int8(1,64,8,8)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_46/transpose__504 + QuantLinearNode__1094_quantize_scale_node + StatefulPartitionedCall/model/conv2d_46/BiasAdd + StatefulPartitionedCall/model/add_21/add + StatefulPartitionedCall/model/activation_44/Relu, Tactic: -7665878956594041863, QuantLinearNode__1090:0[Int8(1,64,8,8)], QuantLinearNode__1082:0[Int8(1,64,8,8)] -> QuantLinearNode__1102:0[Int8(1,64,8,8)] Layer(FusedConvActConvolution): StatefulPartitionedCall/model/conv2d_47/transpose__516 + QuantLinearNode__1106_quantize_scale_node + StatefulPartitionedCall/model/conv2d_47/BiasAdd + StatefulPartitionedCall/model/activation_45/Relu, Tactic: 7274495, QuantLinearNode__1102:0[Int8(1,64,8,8)] -> QuantLinearNode__1110:0[Int8(1,64,8,8)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_48/transpose__526 + QuantLinearNode__1114_quantize_scale_node + StatefulPartitionedCall/model/conv2d_48/BiasAdd + StatefulPartitionedCall/model/add_22/add + StatefulPartitionedCall/model/activation_46/Relu, Tactic: -7665878956594041863, QuantLinearNode__1110:0[Int8(1,64,8,8)], QuantLinearNode__1102:0[Int8(1,64,8,8)] -> QuantLinearNode__1122:0[Int8(1,64,8,8)] Layer(FusedConvActConvolution): StatefulPartitionedCall/model/conv2d_49/transpose__538 + QuantLinearNode__1126_quantize_scale_node + StatefulPartitionedCall/model/conv2d_49/BiasAdd + StatefulPartitionedCall/model/activation_47/Relu, Tactic: 7274495, QuantLinearNode__1122:0[Int8(1,64,8,8)] -> QuantLinearNode__1130:0[Int8(1,64,8,8)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_50/transpose__548 + QuantLinearNode__1134_quantize_scale_node + StatefulPartitionedCall/model/conv2d_50/BiasAdd + StatefulPartitionedCall/model/add_23/add + StatefulPartitionedCall/model/activation_48/Relu, Tactic: -7665878956594041863, QuantLinearNode__1130:0[Int8(1,64,8,8)], QuantLinearNode__1122:0[Int8(1,64,8,8)] -> QuantLinearNode__1142:0[Int8(1,64,8,8)] Layer(FusedConvActConvolution): StatefulPartitionedCall/model/conv2d_51/transpose__560 + QuantLinearNode__1146_quantize_scale_node + StatefulPartitionedCall/model/conv2d_51/BiasAdd + StatefulPartitionedCall/model/activation_49/Relu, Tactic: 7274495, QuantLinearNode__1142:0[Int8(1,64,8,8)] -> QuantLinearNode__1150:0[Int8(1,64,8,8)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_52/transpose__570 + QuantLinearNode__1154_quantize_scale_node + StatefulPartitionedCall/model/conv2d_52/BiasAdd + StatefulPartitionedCall/model/add_24/add + StatefulPartitionedCall/model/activation_50/Relu, Tactic: -7665878956594041863, QuantLinearNode__1150:0[Int8(1,64,8,8)], QuantLinearNode__1142:0[Int8(1,64,8,8)] -> QuantLinearNode__1162:0[Int8(1,64,8,8)] Layer(FusedConvActConvolution): StatefulPartitionedCall/model/conv2d_53/transpose__582 + QuantLinearNode__1166_quantize_scale_node + StatefulPartitionedCall/model/conv2d_53/BiasAdd + StatefulPartitionedCall/model/activation_51/Relu, Tactic: 7274495, QuantLinearNode__1162:0[Int8(1,64,8,8)] -> QuantLinearNode__1170:0[Int8(1,64,8,8)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_54/transpose__592 + QuantLinearNode__1174_quantize_scale_node + StatefulPartitionedCall/model/conv2d_54/BiasAdd + StatefulPartitionedCall/model/add_25/add + StatefulPartitionedCall/model/activation_52/Relu, Tactic: -7665878956594041863, QuantLinearNode__1170:0[Int8(1,64,8,8)], QuantLinearNode__1162:0[Int8(1,64,8,8)] -> QuantLinearNode__1182:0[Int8(1,64,8,8)] Layer(FusedConvActConvolution): StatefulPartitionedCall/model/conv2d_55/transpose__604 + QuantLinearNode__1186_quantize_scale_node + StatefulPartitionedCall/model/conv2d_55/BiasAdd + StatefulPartitionedCall/model/activation_53/Relu, Tactic: 7274495, QuantLinearNode__1182:0[Int8(1,64,8,8)] -> QuantLinearNode__1190:0[Int8(1,64,8,8)] Layer(CaskConvolution): StatefulPartitionedCall/model/conv2d_56/transpose__614 + QuantLinearNode__1194_quantize_scale_node + StatefulPartitionedCall/model/conv2d_56/BiasAdd + StatefulPartitionedCall/model/add_26/add + StatefulPartitionedCall/model/activation_54/Relu, Tactic: -7665878956594041863, QuantLinearNode__1190:0[Int8(1,64,8,8)], QuantLinearNode__1182:0[Int8(1,64,8,8)] -> QuantLinearNode__1198:0[Int8(1,64,8,8)] Layer(CudaPooling): StatefulPartitionedCall/model/global_average_pooling2d/Mean, Tactic: -3, QuantLinearNode__1198:0[Int8(1,64,8,8)] -> StatefulPartitionedCall/model/global_average_pooling2d/Mean_Squeeze__2038:0[Int8(1,64,1,1)] Layer(CaskConvolution): StatefulPartitionedCall/model/dense/quantize_and_dequantize_1/ReadVariableOp__626 + QuantLinearNode__1206_quantize_scale_node + shuffle_after_StatefulPartitionedCall/model/dense/quantize_and_dequantize_1:0 + node_of_dense + to_FC, Tactic: -5622265363201188577, StatefulPartitionedCall/model/global_average_pooling2d/Mean_Squeeze__2038:0[Int8(1,64,1,1)] -> node_of_dense + to_FC_out_tensor[Float(1,10,1,1)] [10/12/2021-21:20:02] [I] [TRT] [MemUsageSnapshot] Builder end: CPU 9445 MiB, GPU 1119 MiB [10/12/2021-21:20:02] [I] [TRT] Loaded engine size: 1 MB [10/12/2021-21:20:02] [I] [TRT] [MemUsageSnapshot] deserializeCudaEngine begin: CPU 9446 MiB, GPU 1115 MiB [10/12/2021-21:20:02] [V] [TRT] Using cublas a tactic source [10/12/2021-21:20:02] [10/12/2021-21:20:02] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +8, now: CPU 9446, GPU 1123 (MiB) [10/12/2021-21:20:02] [V] [TRT] Using cuDNN as a tactic source [10/12/2021-21:20:02] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +8, now: CPU 9446, GPU 1131 (MiB) [10/12/2021-21:20:02] [10/12/2021-21:20:02] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +0, now: CPU 9445, GPU 1115 (MiB) [10/12/2021-21:20:02] [V] [TRT] Deserialization required 26006 microseconds. [10/12/2021-21:20:02] [I] [TRT] [MemUsageSnapshot] deserializeCudaEngine end: CPU 9445 MiB, GPU 1115 MiB [10/12/2021-21:20:02] [I] Engine built in 3.56683 sec. [10/12/2021-21:20:02] [I] [TRT] [MemUsageSnapshot] ExecutionContext creation begin: CPU 9445 MiB, GPU 1115 MiB [10/12/2021-21:20:02] [V] [TRT] Using cublas a tactic source [10/12/2021-21:20:02] [10/12/2021-21:20:02] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +8, now: CPU 9445, GPU 1123 (MiB) [10/12/2021-21:20:02] [V] [TRT] Using cuDNN as a tactic source [10/12/2021-21:20:02] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +8, now: CPU 9445, GPU 1131 (MiB) [10/12/2021-21:20:02] [10/12/2021-21:20:02] [V] [TRT] Total per-runner device memory is 702976 [10/12/2021-21:20:02] [V] [TRT] Total per-runner host memory is 104960 [10/12/2021-21:20:02] [V] [TRT] Allocated activation device memory of size 49152 [10/12/2021-21:20:02] [I] [TRT] [MemUsageSnapshot] ExecutionContext creation end: CPU 9445 MiB, GPU 1133 MiB [10/12/2021-21:20:02] [I] Created input binding for input_1 with dimensions 1x3x32x32 [10/12/2021-21:20:02] [I] Created output binding for dense with dimensions 1x10 [10/12/2021-21:20:02] [I] Starting inference [10/12/2021-21:20:06] [I] Warmup completed 258 queries over 200 ms [10/12/2021-21:20:06] [I] Timing trace has 4697 queries over 3.00116 s [10/12/2021-21:20:06] [I] [10/12/2021-21:20:06] [I] === Trace details === [10/12/2021-21:20:06] [I] Trace averages of 10 runs: [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.612993 ms - Host latency: 0.612993 ms (end to end 0.612993 ms, enqueue 0.0309265 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.641386 ms - Host latency: 0.641386 ms (end to end 0.641386 ms, enqueue 0.0228104 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.606622 ms - Host latency: 0.606622 ms (end to end 0.606622 ms, enqueue 0.0217422 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.623407 ms - Host latency: 0.623407 ms (end to end 0.623407 ms, enqueue 0.0220688 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.694261 ms - Host latency: 0.694261 ms (end to end 0.694261 ms, enqueue 0.0219299 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.607686 ms - Host latency: 0.607686 ms (end to end 0.607686 ms, enqueue 0.0249573 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.643265 ms - Host latency: 0.643265 ms (end to end 0.643265 ms, enqueue 0.0257187 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.613513 ms - Host latency: 0.613513 ms (end to end 0.613513 ms, enqueue 0.0249664 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.691034 ms - Host latency: 0.691034 ms (end to end 0.691034 ms, enqueue 0.0445953 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.613831 ms - Host latency: 0.613831 ms (end to end 0.613831 ms, enqueue 0.0253052 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.607877 ms - Host latency: 0.607877 ms (end to end 0.607877 ms, enqueue 0.0223175 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.607779 ms - Host latency: 0.607779 ms (end to end 0.607779 ms, enqueue 0.0213409 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.611792 ms - Host latency: 0.611792 ms (end to end 0.611792 ms, enqueue 0.0209808 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.609399 ms - Host latency: 0.609399 ms (end to end 0.609399 ms, enqueue 0.0255676 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.605884 ms - Host latency: 0.605884 ms (end to end 0.605884 ms, enqueue 0.0210114 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.605341 ms - Host latency: 0.605341 ms (end to end 0.605341 ms, enqueue 0.0234589 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.606311 ms - Host latency: 0.606311 ms (end to end 0.606311 ms, enqueue 0.0211517 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.605151 ms - Host latency: 0.605151 ms (end to end 0.605151 ms, enqueue 0.022583 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.605447 ms - Host latency: 0.605447 ms (end to end 0.605447 ms, enqueue 0.0226868 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.610068 ms - Host latency: 0.610068 ms (end to end 0.610068 ms, enqueue 0.0213501 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.555817 ms - Host latency: 0.555817 ms (end to end 0.555817 ms, enqueue 0.0231842 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.561441 ms - Host latency: 0.561441 ms (end to end 0.561441 ms, enqueue 0.0276489 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.556317 ms - Host latency: 0.556317 ms (end to end 0.556317 ms, enqueue 0.0264984 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.561743 ms - Host latency: 0.561743 ms (end to end 0.561743 ms, enqueue 0.0244965 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.572183 ms - Host latency: 0.572183 ms (end to end 0.572183 ms, enqueue 0.0218018 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.555832 ms - Host latency: 0.555832 ms (end to end 0.555832 ms, enqueue 0.0211304 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.554242 ms - Host latency: 0.554242 ms (end to end 0.554242 ms, enqueue 0.0210205 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.56337 ms - Host latency: 0.56337 ms (end to end 0.56337 ms, enqueue 0.021936 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.555737 ms - Host latency: 0.555737 ms (end to end 0.555737 ms, enqueue 0.0245575 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.55434 ms - Host latency: 0.55434 ms (end to end 0.55434 ms, enqueue 0.0217804 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.552908 ms - Host latency: 0.552908 ms (end to end 0.552908 ms, enqueue 0.0213409 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.555704 ms - Host latency: 0.555704 ms (end to end 0.555704 ms, enqueue 0.0227478 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.55473 ms - Host latency: 0.55473 ms (end to end 0.55473 ms, enqueue 0.0222565 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.556955 ms - Host latency: 0.556955 ms (end to end 0.556955 ms, enqueue 0.0214325 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.554263 ms - Host latency: 0.554263 ms (end to end 0.554263 ms, enqueue 0.0228394 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.553271 ms - Host latency: 0.553271 ms (end to end 0.553271 ms, enqueue 0.0248505 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.573474 ms - Host latency: 0.573474 ms (end to end 0.573474 ms, enqueue 0.0215759 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.55668 ms - Host latency: 0.55668 ms (end to end 0.55668 ms, enqueue 0.0208649 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.560983 ms - Host latency: 0.560983 ms (end to end 0.560983 ms, enqueue 0.023349 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.564612 ms - Host latency: 0.564612 ms (end to end 0.564612 ms, enqueue 0.0208984 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.564847 ms - Host latency: 0.564847 ms (end to end 0.564847 ms, enqueue 0.021109 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.559122 ms - Host latency: 0.559122 ms (end to end 0.559122 ms, enqueue 0.021109 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.554346 ms - Host latency: 0.554346 ms (end to end 0.554346 ms, enqueue 0.0210938 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.556137 ms - Host latency: 0.556137 ms (end to end 0.556137 ms, enqueue 0.0222443 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.554422 ms - Host latency: 0.554422 ms (end to end 0.554422 ms, enqueue 0.022171 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.558527 ms - Host latency: 0.558527 ms (end to end 0.558527 ms, enqueue 0.0214355 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.5474 ms - Host latency: 0.5474 ms (end to end 0.5474 ms, enqueue 0.0238251 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.546918 ms - Host latency: 0.546918 ms (end to end 0.546918 ms, enqueue 0.0219666 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542035 ms - Host latency: 0.542035 ms (end to end 0.542035 ms, enqueue 0.0213745 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541058 ms - Host latency: 0.541058 ms (end to end 0.541058 ms, enqueue 0.0216309 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541547 ms - Host latency: 0.541547 ms (end to end 0.541547 ms, enqueue 0.0213257 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.555682 ms - Host latency: 0.555682 ms (end to end 0.555682 ms, enqueue 0.0250183 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.539868 ms - Host latency: 0.539868 ms (end to end 0.539868 ms, enqueue 0.0211365 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540497 ms - Host latency: 0.540497 ms (end to end 0.540497 ms, enqueue 0.0226379 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541669 ms - Host latency: 0.541669 ms (end to end 0.541669 ms, enqueue 0.0301392 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542572 ms - Host latency: 0.542572 ms (end to end 0.542572 ms, enqueue 0.0213318 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.551483 ms - Host latency: 0.551483 ms (end to end 0.551483 ms, enqueue 0.0212036 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541022 ms - Host latency: 0.541022 ms (end to end 0.541022 ms, enqueue 0.0212341 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541046 ms - Host latency: 0.541046 ms (end to end 0.541046 ms, enqueue 0.0210083 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.54046 ms - Host latency: 0.54046 ms (end to end 0.54046 ms, enqueue 0.0217712 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.543872 ms - Host latency: 0.543872 ms (end to end 0.543872 ms, enqueue 0.0228333 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.550897 ms - Host latency: 0.550897 ms (end to end 0.550897 ms, enqueue 0.0208679 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542462 ms - Host latency: 0.542462 ms (end to end 0.542462 ms, enqueue 0.0218445 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541449 ms - Host latency: 0.541449 ms (end to end 0.541449 ms, enqueue 0.0210205 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540234 ms - Host latency: 0.540234 ms (end to end 0.540234 ms, enqueue 0.0217163 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542694 ms - Host latency: 0.542694 ms (end to end 0.542694 ms, enqueue 0.0230347 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542566 ms - Host latency: 0.542566 ms (end to end 0.542566 ms, enqueue 0.0215698 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541229 ms - Host latency: 0.541229 ms (end to end 0.541229 ms, enqueue 0.0211609 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542847 ms - Host latency: 0.542847 ms (end to end 0.542847 ms, enqueue 0.0222107 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540887 ms - Host latency: 0.540887 ms (end to end 0.540887 ms, enqueue 0.021167 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.547357 ms - Host latency: 0.547357 ms (end to end 0.547357 ms, enqueue 0.0215576 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541064 ms - Host latency: 0.541064 ms (end to end 0.541064 ms, enqueue 0.0247803 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.54057 ms - Host latency: 0.54057 ms (end to end 0.54057 ms, enqueue 0.0216125 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541333 ms - Host latency: 0.541333 ms (end to end 0.541333 ms, enqueue 0.0246582 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.547406 ms - Host latency: 0.547406 ms (end to end 0.547406 ms, enqueue 0.0231873 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.547522 ms - Host latency: 0.547522 ms (end to end 0.547522 ms, enqueue 0.0255188 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540949 ms - Host latency: 0.540949 ms (end to end 0.540949 ms, enqueue 0.0217896 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.54035 ms - Host latency: 0.54035 ms (end to end 0.54035 ms, enqueue 0.0213623 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541309 ms - Host latency: 0.541309 ms (end to end 0.541309 ms, enqueue 0.0348145 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541162 ms - Host latency: 0.541162 ms (end to end 0.541162 ms, enqueue 0.0245789 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542065 ms - Host latency: 0.542065 ms (end to end 0.542065 ms, enqueue 0.0215942 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541272 ms - Host latency: 0.541272 ms (end to end 0.541272 ms, enqueue 0.0213928 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540533 ms - Host latency: 0.540533 ms (end to end 0.540533 ms, enqueue 0.0227661 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542065 ms - Host latency: 0.542065 ms (end to end 0.542065 ms, enqueue 0.0217773 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541333 ms - Host latency: 0.541333 ms (end to end 0.541333 ms, enqueue 0.0213013 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540289 ms - Host latency: 0.540289 ms (end to end 0.540289 ms, enqueue 0.021759 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.548236 ms - Host latency: 0.548236 ms (end to end 0.548236 ms, enqueue 0.0213196 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541382 ms - Host latency: 0.541382 ms (end to end 0.541382 ms, enqueue 0.021167 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.543262 ms - Host latency: 0.543262 ms (end to end 0.543262 ms, enqueue 0.0210999 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542944 ms - Host latency: 0.542944 ms (end to end 0.542944 ms, enqueue 0.0213074 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541595 ms - Host latency: 0.541595 ms (end to end 0.541595 ms, enqueue 0.0216003 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.569983 ms - Host latency: 0.569983 ms (end to end 0.569983 ms, enqueue 0.0251343 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541913 ms - Host latency: 0.541913 ms (end to end 0.541913 ms, enqueue 0.0211121 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.634576 ms - Host latency: 0.634576 ms (end to end 0.634576 ms, enqueue 0.0212463 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.551929 ms - Host latency: 0.551929 ms (end to end 0.551929 ms, enqueue 0.0219727 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541229 ms - Host latency: 0.541229 ms (end to end 0.541229 ms, enqueue 0.0214416 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540289 ms - Host latency: 0.540289 ms (end to end 0.540289 ms, enqueue 0.0298645 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.548615 ms - Host latency: 0.548615 ms (end to end 0.548615 ms, enqueue 0.0244263 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.539954 ms - Host latency: 0.539954 ms (end to end 0.539954 ms, enqueue 0.021283 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.557611 ms - Host latency: 0.557611 ms (end to end 0.557611 ms, enqueue 0.0220337 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.54151 ms - Host latency: 0.54151 ms (end to end 0.54151 ms, enqueue 0.0238831 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.54281 ms - Host latency: 0.54281 ms (end to end 0.54281 ms, enqueue 0.0218628 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541162 ms - Host latency: 0.541162 ms (end to end 0.541162 ms, enqueue 0.0221069 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.5414 ms - Host latency: 0.5414 ms (end to end 0.5414 ms, enqueue 0.0242432 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.54032 ms - Host latency: 0.54032 ms (end to end 0.54032 ms, enqueue 0.0249084 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541895 ms - Host latency: 0.541895 ms (end to end 0.541895 ms, enqueue 0.0224792 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541144 ms - Host latency: 0.541144 ms (end to end 0.541144 ms, enqueue 0.0214294 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540552 ms - Host latency: 0.540552 ms (end to end 0.540552 ms, enqueue 0.0248291 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.54032 ms - Host latency: 0.54032 ms (end to end 0.54032 ms, enqueue 0.0210266 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541705 ms - Host latency: 0.541705 ms (end to end 0.541705 ms, enqueue 0.0213623 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.545026 ms - Host latency: 0.545026 ms (end to end 0.545026 ms, enqueue 0.0214539 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.552258 ms - Host latency: 0.552258 ms (end to end 0.552258 ms, enqueue 0.0209717 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542242 ms - Host latency: 0.542242 ms (end to end 0.542242 ms, enqueue 0.0291138 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540472 ms - Host latency: 0.540472 ms (end to end 0.540472 ms, enqueue 0.0213135 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540363 ms - Host latency: 0.540363 ms (end to end 0.540363 ms, enqueue 0.0232788 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541388 ms - Host latency: 0.541388 ms (end to end 0.541388 ms, enqueue 0.0211121 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540912 ms - Host latency: 0.540912 ms (end to end 0.540912 ms, enqueue 0.0210205 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542053 ms - Host latency: 0.542053 ms (end to end 0.542053 ms, enqueue 0.0218506 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.54046 ms - Host latency: 0.54046 ms (end to end 0.54046 ms, enqueue 0.0225586 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.548212 ms - Host latency: 0.548212 ms (end to end 0.548212 ms, enqueue 0.0247681 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541486 ms - Host latency: 0.541486 ms (end to end 0.541486 ms, enqueue 0.021283 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541321 ms - Host latency: 0.541321 ms (end to end 0.541321 ms, enqueue 0.02099 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541479 ms - Host latency: 0.541479 ms (end to end 0.541479 ms, enqueue 0.0231689 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.549475 ms - Host latency: 0.549475 ms (end to end 0.549475 ms, enqueue 0.0219482 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540619 ms - Host latency: 0.540619 ms (end to end 0.540619 ms, enqueue 0.0210022 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540576 ms - Host latency: 0.540576 ms (end to end 0.540576 ms, enqueue 0.0227539 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541132 ms - Host latency: 0.541132 ms (end to end 0.541132 ms, enqueue 0.0218201 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540417 ms - Host latency: 0.540417 ms (end to end 0.540417 ms, enqueue 0.021936 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540417 ms - Host latency: 0.540417 ms (end to end 0.540417 ms, enqueue 0.0248047 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.538953 ms - Host latency: 0.538953 ms (end to end 0.538953 ms, enqueue 0.021167 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.547241 ms - Host latency: 0.547241 ms (end to end 0.547241 ms, enqueue 0.0221436 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.555994 ms - Host latency: 0.555994 ms (end to end 0.555994 ms, enqueue 0.0208252 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.543066 ms - Host latency: 0.543066 ms (end to end 0.543066 ms, enqueue 0.0245728 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.547058 ms - Host latency: 0.547058 ms (end to end 0.547058 ms, enqueue 0.0213135 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.547583 ms - Host latency: 0.547583 ms (end to end 0.547583 ms, enqueue 0.0224487 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541479 ms - Host latency: 0.541479 ms (end to end 0.541479 ms, enqueue 0.0236328 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541125 ms - Host latency: 0.541125 ms (end to end 0.541125 ms, enqueue 0.0212158 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541382 ms - Host latency: 0.541382 ms (end to end 0.541382 ms, enqueue 0.0210083 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540247 ms - Host latency: 0.540247 ms (end to end 0.540247 ms, enqueue 0.0259155 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.53999 ms - Host latency: 0.53999 ms (end to end 0.53999 ms, enqueue 0.0214233 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.544409 ms - Host latency: 0.544409 ms (end to end 0.544409 ms, enqueue 0.0221436 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.54176 ms - Host latency: 0.54176 ms (end to end 0.54176 ms, enqueue 0.0213379 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541479 ms - Host latency: 0.541479 ms (end to end 0.541479 ms, enqueue 0.021106 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540906 ms - Host latency: 0.540906 ms (end to end 0.540906 ms, enqueue 0.0212891 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.546179 ms - Host latency: 0.546179 ms (end to end 0.546179 ms, enqueue 0.0209473 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.539636 ms - Host latency: 0.539636 ms (end to end 0.539636 ms, enqueue 0.0209595 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.544226 ms - Host latency: 0.544226 ms (end to end 0.544226 ms, enqueue 0.0290405 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.552991 ms - Host latency: 0.552991 ms (end to end 0.552991 ms, enqueue 0.0214111 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.54032 ms - Host latency: 0.54032 ms (end to end 0.54032 ms, enqueue 0.0261597 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540601 ms - Host latency: 0.540601 ms (end to end 0.540601 ms, enqueue 0.0214844 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.543213 ms - Host latency: 0.543213 ms (end to end 0.543213 ms, enqueue 0.0212769 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541089 ms - Host latency: 0.541089 ms (end to end 0.541089 ms, enqueue 0.0211548 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541345 ms - Host latency: 0.541345 ms (end to end 0.541345 ms, enqueue 0.0217529 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.55426 ms - Host latency: 0.55426 ms (end to end 0.55426 ms, enqueue 0.0240479 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.54447 ms - Host latency: 0.54447 ms (end to end 0.54447 ms, enqueue 0.0254395 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541638 ms - Host latency: 0.541638 ms (end to end 0.541638 ms, enqueue 0.0211914 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.556323 ms - Host latency: 0.556323 ms (end to end 0.556323 ms, enqueue 0.0234375 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.54696 ms - Host latency: 0.54696 ms (end to end 0.54696 ms, enqueue 0.0211304 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.558069 ms - Host latency: 0.558069 ms (end to end 0.558069 ms, enqueue 0.0211548 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.652734 ms - Host latency: 0.652734 ms (end to end 0.652734 ms, enqueue 0.0267578 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.545862 ms - Host latency: 0.545862 ms (end to end 0.545862 ms, enqueue 0.0213623 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540381 ms - Host latency: 0.540381 ms (end to end 0.540381 ms, enqueue 0.0228882 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.551758 ms - Host latency: 0.551758 ms (end to end 0.551758 ms, enqueue 0.022168 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.557483 ms - Host latency: 0.557483 ms (end to end 0.557483 ms, enqueue 0.0270996 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.54165 ms - Host latency: 0.54165 ms (end to end 0.54165 ms, enqueue 0.0235352 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542188 ms - Host latency: 0.542188 ms (end to end 0.542188 ms, enqueue 0.0209961 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542139 ms - Host latency: 0.542139 ms (end to end 0.542139 ms, enqueue 0.0221802 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542493 ms - Host latency: 0.542493 ms (end to end 0.542493 ms, enqueue 0.0229614 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.546472 ms - Host latency: 0.546472 ms (end to end 0.546472 ms, enqueue 0.0212646 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542371 ms - Host latency: 0.542371 ms (end to end 0.542371 ms, enqueue 0.0210938 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.5422 ms - Host latency: 0.5422 ms (end to end 0.5422 ms, enqueue 0.0229126 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.554785 ms - Host latency: 0.554785 ms (end to end 0.554785 ms, enqueue 0.0306641 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541003 ms - Host latency: 0.541003 ms (end to end 0.541003 ms, enqueue 0.0213989 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.539905 ms - Host latency: 0.539905 ms (end to end 0.539905 ms, enqueue 0.0210571 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.543469 ms - Host latency: 0.543469 ms (end to end 0.543469 ms, enqueue 0.022522 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.550623 ms - Host latency: 0.550623 ms (end to end 0.550623 ms, enqueue 0.0223633 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.545752 ms - Host latency: 0.545752 ms (end to end 0.545752 ms, enqueue 0.023938 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.594214 ms - Host latency: 0.594214 ms (end to end 0.594214 ms, enqueue 0.0249634 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.539917 ms - Host latency: 0.539917 ms (end to end 0.539917 ms, enqueue 0.0241211 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541528 ms - Host latency: 0.541528 ms (end to end 0.541528 ms, enqueue 0.0213501 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.629529 ms - Host latency: 0.629529 ms (end to end 0.629529 ms, enqueue 0.0226929 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.552783 ms - Host latency: 0.552783 ms (end to end 0.552783 ms, enqueue 0.0205933 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.547961 ms - Host latency: 0.547961 ms (end to end 0.547961 ms, enqueue 0.0209351 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.543054 ms - Host latency: 0.543054 ms (end to end 0.543054 ms, enqueue 0.0226318 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.549658 ms - Host latency: 0.549658 ms (end to end 0.549658 ms, enqueue 0.0212036 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.545251 ms - Host latency: 0.545251 ms (end to end 0.545251 ms, enqueue 0.0214966 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.544409 ms - Host latency: 0.544409 ms (end to end 0.544409 ms, enqueue 0.027417 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.54115 ms - Host latency: 0.54115 ms (end to end 0.54115 ms, enqueue 0.0224487 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541309 ms - Host latency: 0.541309 ms (end to end 0.541309 ms, enqueue 0.0247925 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540662 ms - Host latency: 0.540662 ms (end to end 0.540662 ms, enqueue 0.0231323 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.546167 ms - Host latency: 0.546167 ms (end to end 0.546167 ms, enqueue 0.0250854 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541443 ms - Host latency: 0.541443 ms (end to end 0.541443 ms, enqueue 0.021167 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540833 ms - Host latency: 0.540833 ms (end to end 0.540833 ms, enqueue 0.0246216 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541504 ms - Host latency: 0.541504 ms (end to end 0.541504 ms, enqueue 0.0236938 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541211 ms - Host latency: 0.541211 ms (end to end 0.541211 ms, enqueue 0.0214111 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.551758 ms - Host latency: 0.551758 ms (end to end 0.551758 ms, enqueue 0.0211182 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.550537 ms - Host latency: 0.550537 ms (end to end 0.550537 ms, enqueue 0.0224609 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.554614 ms - Host latency: 0.554614 ms (end to end 0.554614 ms, enqueue 0.02052 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.546143 ms - Host latency: 0.546143 ms (end to end 0.546143 ms, enqueue 0.0207031 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.549695 ms - Host latency: 0.549695 ms (end to end 0.549695 ms, enqueue 0.0204834 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.544006 ms - Host latency: 0.544006 ms (end to end 0.544006 ms, enqueue 0.021228 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.5427 ms - Host latency: 0.5427 ms (end to end 0.5427 ms, enqueue 0.0208008 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542456 ms - Host latency: 0.542456 ms (end to end 0.542456 ms, enqueue 0.0210449 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.539819 ms - Host latency: 0.539819 ms (end to end 0.539819 ms, enqueue 0.0224609 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542249 ms - Host latency: 0.542249 ms (end to end 0.542249 ms, enqueue 0.0213257 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.548303 ms - Host latency: 0.548303 ms (end to end 0.548303 ms, enqueue 0.0212646 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.544275 ms - Host latency: 0.544275 ms (end to end 0.544275 ms, enqueue 0.0258179 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.553552 ms - Host latency: 0.553552 ms (end to end 0.553552 ms, enqueue 0.0212158 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.55199 ms - Host latency: 0.55199 ms (end to end 0.55199 ms, enqueue 0.0218628 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.551123 ms - Host latency: 0.551123 ms (end to end 0.551123 ms, enqueue 0.0213745 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542249 ms - Host latency: 0.542249 ms (end to end 0.542249 ms, enqueue 0.0220215 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540784 ms - Host latency: 0.540784 ms (end to end 0.540784 ms, enqueue 0.0222778 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.545447 ms - Host latency: 0.545447 ms (end to end 0.545447 ms, enqueue 0.0213013 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.544128 ms - Host latency: 0.544128 ms (end to end 0.544128 ms, enqueue 0.0214722 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540454 ms - Host latency: 0.540454 ms (end to end 0.540454 ms, enqueue 0.0268433 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.551038 ms - Host latency: 0.551038 ms (end to end 0.551038 ms, enqueue 0.0213257 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.556042 ms - Host latency: 0.556042 ms (end to end 0.556042 ms, enqueue 0.0213501 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540112 ms - Host latency: 0.540112 ms (end to end 0.540112 ms, enqueue 0.0212524 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540503 ms - Host latency: 0.540503 ms (end to end 0.540503 ms, enqueue 0.0213379 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.554443 ms - Host latency: 0.554443 ms (end to end 0.554443 ms, enqueue 0.0230103 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.54054 ms - Host latency: 0.54054 ms (end to end 0.54054 ms, enqueue 0.0212036 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541272 ms - Host latency: 0.541272 ms (end to end 0.541272 ms, enqueue 0.021582 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541272 ms - Host latency: 0.541272 ms (end to end 0.541272 ms, enqueue 0.0341675 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.54093 ms - Host latency: 0.54093 ms (end to end 0.54093 ms, enqueue 0.0209961 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540186 ms - Host latency: 0.540186 ms (end to end 0.540186 ms, enqueue 0.0209473 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.543311 ms - Host latency: 0.543311 ms (end to end 0.543311 ms, enqueue 0.0288452 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541907 ms - Host latency: 0.541907 ms (end to end 0.541907 ms, enqueue 0.0251953 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541467 ms - Host latency: 0.541467 ms (end to end 0.541467 ms, enqueue 0.0215088 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541296 ms - Host latency: 0.541296 ms (end to end 0.541296 ms, enqueue 0.021228 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.54259 ms - Host latency: 0.54259 ms (end to end 0.54259 ms, enqueue 0.0232422 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541492 ms - Host latency: 0.541492 ms (end to end 0.541492 ms, enqueue 0.0248169 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541272 ms - Host latency: 0.541272 ms (end to end 0.541272 ms, enqueue 0.0212891 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.548486 ms - Host latency: 0.548486 ms (end to end 0.548486 ms, enqueue 0.0217407 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.55708 ms - Host latency: 0.55708 ms (end to end 0.55708 ms, enqueue 0.0218384 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.54198 ms - Host latency: 0.54198 ms (end to end 0.54198 ms, enqueue 0.0220093 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.544189 ms - Host latency: 0.544189 ms (end to end 0.544189 ms, enqueue 0.0244995 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541504 ms - Host latency: 0.541504 ms (end to end 0.541504 ms, enqueue 0.0212524 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.54408 ms - Host latency: 0.54408 ms (end to end 0.54408 ms, enqueue 0.0220581 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.550513 ms - Host latency: 0.550513 ms (end to end 0.550513 ms, enqueue 0.0220215 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.548779 ms - Host latency: 0.548779 ms (end to end 0.548779 ms, enqueue 0.0205322 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.547717 ms - Host latency: 0.547717 ms (end to end 0.547717 ms, enqueue 0.0240845 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.549622 ms - Host latency: 0.549622 ms (end to end 0.549622 ms, enqueue 0.0230957 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.549097 ms - Host latency: 0.549097 ms (end to end 0.549097 ms, enqueue 0.0218018 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.559912 ms - Host latency: 0.559912 ms (end to end 0.559912 ms, enqueue 0.0221191 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.54231 ms - Host latency: 0.54231 ms (end to end 0.54231 ms, enqueue 0.0210815 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540405 ms - Host latency: 0.540405 ms (end to end 0.540405 ms, enqueue 0.0206543 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.547461 ms - Host latency: 0.547461 ms (end to end 0.547461 ms, enqueue 0.0219849 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.550024 ms - Host latency: 0.550024 ms (end to end 0.550024 ms, enqueue 0.0209595 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.546741 ms - Host latency: 0.546741 ms (end to end 0.546741 ms, enqueue 0.0213501 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.549707 ms - Host latency: 0.549707 ms (end to end 0.549707 ms, enqueue 0.0210083 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.548962 ms - Host latency: 0.548962 ms (end to end 0.548962 ms, enqueue 0.0216187 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542273 ms - Host latency: 0.542273 ms (end to end 0.542273 ms, enqueue 0.021167 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541418 ms - Host latency: 0.541418 ms (end to end 0.541418 ms, enqueue 0.0210083 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541211 ms - Host latency: 0.541211 ms (end to end 0.541211 ms, enqueue 0.0209839 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541211 ms - Host latency: 0.541211 ms (end to end 0.541211 ms, enqueue 0.0241455 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.539697 ms - Host latency: 0.539697 ms (end to end 0.539697 ms, enqueue 0.0210938 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540137 ms - Host latency: 0.540137 ms (end to end 0.540137 ms, enqueue 0.0225098 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.545776 ms - Host latency: 0.545776 ms (end to end 0.545776 ms, enqueue 0.0207153 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.549548 ms - Host latency: 0.549548 ms (end to end 0.549548 ms, enqueue 0.0206421 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.544897 ms - Host latency: 0.544897 ms (end to end 0.544897 ms, enqueue 0.0272095 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.53999 ms - Host latency: 0.53999 ms (end to end 0.53999 ms, enqueue 0.0222534 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542993 ms - Host latency: 0.542993 ms (end to end 0.542993 ms, enqueue 0.0216553 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.5427 ms - Host latency: 0.5427 ms (end to end 0.5427 ms, enqueue 0.0207397 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542456 ms - Host latency: 0.542456 ms (end to end 0.542456 ms, enqueue 0.021521 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.599548 ms - Host latency: 0.599548 ms (end to end 0.599548 ms, enqueue 0.0218872 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.549939 ms - Host latency: 0.549939 ms (end to end 0.549939 ms, enqueue 0.0299927 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.549121 ms - Host latency: 0.549121 ms (end to end 0.549121 ms, enqueue 0.0221558 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.655847 ms - Host latency: 0.655847 ms (end to end 0.655847 ms, enqueue 0.023938 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.553479 ms - Host latency: 0.553479 ms (end to end 0.553479 ms, enqueue 0.0212036 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.548376 ms - Host latency: 0.548376 ms (end to end 0.548376 ms, enqueue 0.0249023 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541016 ms - Host latency: 0.541016 ms (end to end 0.541016 ms, enqueue 0.021228 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.539539 ms - Host latency: 0.539539 ms (end to end 0.539539 ms, enqueue 0.021936 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541589 ms - Host latency: 0.541589 ms (end to end 0.541589 ms, enqueue 0.0223633 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542432 ms - Host latency: 0.542432 ms (end to end 0.542432 ms, enqueue 0.0210693 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.539709 ms - Host latency: 0.539709 ms (end to end 0.539709 ms, enqueue 0.0307373 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542188 ms - Host latency: 0.542188 ms (end to end 0.542188 ms, enqueue 0.0209961 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.551941 ms - Host latency: 0.551941 ms (end to end 0.551941 ms, enqueue 0.0205444 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.547156 ms - Host latency: 0.547156 ms (end to end 0.547156 ms, enqueue 0.0251831 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.547034 ms - Host latency: 0.547034 ms (end to end 0.547034 ms, enqueue 0.0204102 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.547949 ms - Host latency: 0.547949 ms (end to end 0.547949 ms, enqueue 0.0242676 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.549817 ms - Host latency: 0.549817 ms (end to end 0.549817 ms, enqueue 0.0204712 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.547266 ms - Host latency: 0.547266 ms (end to end 0.547266 ms, enqueue 0.022522 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.546716 ms - Host latency: 0.546716 ms (end to end 0.546716 ms, enqueue 0.024707 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540503 ms - Host latency: 0.540503 ms (end to end 0.540503 ms, enqueue 0.0212646 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542004 ms - Host latency: 0.542004 ms (end to end 0.542004 ms, enqueue 0.0210693 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542053 ms - Host latency: 0.542053 ms (end to end 0.542053 ms, enqueue 0.030603 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542065 ms - Host latency: 0.542065 ms (end to end 0.542065 ms, enqueue 0.0214966 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540771 ms - Host latency: 0.540771 ms (end to end 0.540771 ms, enqueue 0.0245361 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542871 ms - Host latency: 0.542871 ms (end to end 0.542871 ms, enqueue 0.0241455 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542676 ms - Host latency: 0.542676 ms (end to end 0.542676 ms, enqueue 0.0207031 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541089 ms - Host latency: 0.541089 ms (end to end 0.541089 ms, enqueue 0.0253174 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.555127 ms - Host latency: 0.555127 ms (end to end 0.555127 ms, enqueue 0.0216553 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.566162 ms - Host latency: 0.566162 ms (end to end 0.566162 ms, enqueue 0.0212158 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.555103 ms - Host latency: 0.555103 ms (end to end 0.555103 ms, enqueue 0.0212646 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.55603 ms - Host latency: 0.55603 ms (end to end 0.55603 ms, enqueue 0.0216797 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.545972 ms - Host latency: 0.545972 ms (end to end 0.545972 ms, enqueue 0.0221436 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.553809 ms - Host latency: 0.553809 ms (end to end 0.553809 ms, enqueue 0.0214844 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542236 ms - Host latency: 0.542236 ms (end to end 0.542236 ms, enqueue 0.0213379 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.54104 ms - Host latency: 0.54104 ms (end to end 0.54104 ms, enqueue 0.0215332 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541333 ms - Host latency: 0.541333 ms (end to end 0.541333 ms, enqueue 0.0212402 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541333 ms - Host latency: 0.541333 ms (end to end 0.541333 ms, enqueue 0.0214355 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540259 ms - Host latency: 0.540259 ms (end to end 0.540259 ms, enqueue 0.0210693 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540161 ms - Host latency: 0.540161 ms (end to end 0.540161 ms, enqueue 0.0215332 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541382 ms - Host latency: 0.541382 ms (end to end 0.541382 ms, enqueue 0.0212402 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.544482 ms - Host latency: 0.544482 ms (end to end 0.544482 ms, enqueue 0.0212158 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.545215 ms - Host latency: 0.545215 ms (end to end 0.545215 ms, enqueue 0.0247314 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541992 ms - Host latency: 0.541992 ms (end to end 0.541992 ms, enqueue 0.0212402 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542603 ms - Host latency: 0.542603 ms (end to end 0.542603 ms, enqueue 0.0213379 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541138 ms - Host latency: 0.541138 ms (end to end 0.541138 ms, enqueue 0.0245361 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.54082 ms - Host latency: 0.54082 ms (end to end 0.54082 ms, enqueue 0.0213379 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541211 ms - Host latency: 0.541211 ms (end to end 0.541211 ms, enqueue 0.0216553 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542505 ms - Host latency: 0.542505 ms (end to end 0.542505 ms, enqueue 0.0256348 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541553 ms - Host latency: 0.541553 ms (end to end 0.541553 ms, enqueue 0.0210693 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.550513 ms - Host latency: 0.550513 ms (end to end 0.550513 ms, enqueue 0.0210449 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.545166 ms - Host latency: 0.545166 ms (end to end 0.545166 ms, enqueue 0.0216309 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.556396 ms - Host latency: 0.556396 ms (end to end 0.556396 ms, enqueue 0.0211914 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.621899 ms - Host latency: 0.621899 ms (end to end 0.621899 ms, enqueue 0.027124 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.549902 ms - Host latency: 0.549902 ms (end to end 0.549902 ms, enqueue 0.0268066 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.55708 ms - Host latency: 0.55708 ms (end to end 0.55708 ms, enqueue 0.0226563 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.553418 ms - Host latency: 0.553418 ms (end to end 0.553418 ms, enqueue 0.021875 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.547681 ms - Host latency: 0.547681 ms (end to end 0.547681 ms, enqueue 0.0229492 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540259 ms - Host latency: 0.540259 ms (end to end 0.540259 ms, enqueue 0.0265381 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541528 ms - Host latency: 0.541528 ms (end to end 0.541528 ms, enqueue 0.0341309 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541211 ms - Host latency: 0.541211 ms (end to end 0.541211 ms, enqueue 0.0284424 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540894 ms - Host latency: 0.540894 ms (end to end 0.540894 ms, enqueue 0.02146 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.539941 ms - Host latency: 0.539941 ms (end to end 0.539941 ms, enqueue 0.0213867 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.551831 ms - Host latency: 0.551831 ms (end to end 0.551831 ms, enqueue 0.0256104 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541138 ms - Host latency: 0.541138 ms (end to end 0.541138 ms, enqueue 0.0227295 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.54126 ms - Host latency: 0.54126 ms (end to end 0.54126 ms, enqueue 0.0211426 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.546338 ms - Host latency: 0.546338 ms (end to end 0.546338 ms, enqueue 0.0322754 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.547778 ms - Host latency: 0.547778 ms (end to end 0.547778 ms, enqueue 0.0208008 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542065 ms - Host latency: 0.542065 ms (end to end 0.542065 ms, enqueue 0.0211914 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.54563 ms - Host latency: 0.54563 ms (end to end 0.54563 ms, enqueue 0.0215576 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.548755 ms - Host latency: 0.548755 ms (end to end 0.548755 ms, enqueue 0.0211426 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542114 ms - Host latency: 0.542114 ms (end to end 0.542114 ms, enqueue 0.0222412 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.546509 ms - Host latency: 0.546509 ms (end to end 0.546509 ms, enqueue 0.0243652 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.548242 ms - Host latency: 0.548242 ms (end to end 0.548242 ms, enqueue 0.021167 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542505 ms - Host latency: 0.542505 ms (end to end 0.542505 ms, enqueue 0.021582 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540161 ms - Host latency: 0.540161 ms (end to end 0.540161 ms, enqueue 0.0214355 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.552661 ms - Host latency: 0.552661 ms (end to end 0.552661 ms, enqueue 0.0264893 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542725 ms - Host latency: 0.542725 ms (end to end 0.542725 ms, enqueue 0.0215576 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541675 ms - Host latency: 0.541675 ms (end to end 0.541675 ms, enqueue 0.0213379 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540479 ms - Host latency: 0.540479 ms (end to end 0.540479 ms, enqueue 0.0209229 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541064 ms - Host latency: 0.541064 ms (end to end 0.541064 ms, enqueue 0.0209717 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.539478 ms - Host latency: 0.539478 ms (end to end 0.539478 ms, enqueue 0.0211182 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540967 ms - Host latency: 0.540967 ms (end to end 0.540967 ms, enqueue 0.0255127 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541821 ms - Host latency: 0.541821 ms (end to end 0.541821 ms, enqueue 0.0209961 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541748 ms - Host latency: 0.541748 ms (end to end 0.541748 ms, enqueue 0.0245605 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541089 ms - Host latency: 0.541089 ms (end to end 0.541089 ms, enqueue 0.0230225 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540723 ms - Host latency: 0.540723 ms (end to end 0.540723 ms, enqueue 0.0215576 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.576099 ms - Host latency: 0.576099 ms (end to end 0.576099 ms, enqueue 0.0250732 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.549951 ms - Host latency: 0.549951 ms (end to end 0.549951 ms, enqueue 0.0220459 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.548755 ms - Host latency: 0.548755 ms (end to end 0.548755 ms, enqueue 0.0204834 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.630078 ms - Host latency: 0.630078 ms (end to end 0.630078 ms, enqueue 0.0254639 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542529 ms - Host latency: 0.542529 ms (end to end 0.542529 ms, enqueue 0.0216309 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540894 ms - Host latency: 0.540894 ms (end to end 0.540894 ms, enqueue 0.021167 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.544971 ms - Host latency: 0.544971 ms (end to end 0.544971 ms, enqueue 0.0205078 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.553857 ms - Host latency: 0.553857 ms (end to end 0.553857 ms, enqueue 0.0204346 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.547705 ms - Host latency: 0.547705 ms (end to end 0.547705 ms, enqueue 0.0224121 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.543408 ms - Host latency: 0.543408 ms (end to end 0.543408 ms, enqueue 0.0208984 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.551587 ms - Host latency: 0.551587 ms (end to end 0.551587 ms, enqueue 0.0240479 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.544751 ms - Host latency: 0.544751 ms (end to end 0.544751 ms, enqueue 0.0266846 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.545117 ms - Host latency: 0.545117 ms (end to end 0.545117 ms, enqueue 0.0218506 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.560864 ms - Host latency: 0.560864 ms (end to end 0.560864 ms, enqueue 0.0236084 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.5573 ms - Host latency: 0.5573 ms (end to end 0.5573 ms, enqueue 0.0210449 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542334 ms - Host latency: 0.542334 ms (end to end 0.542334 ms, enqueue 0.0210205 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540039 ms - Host latency: 0.540039 ms (end to end 0.540039 ms, enqueue 0.0234619 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541602 ms - Host latency: 0.541602 ms (end to end 0.541602 ms, enqueue 0.0213623 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.547852 ms - Host latency: 0.547852 ms (end to end 0.547852 ms, enqueue 0.021875 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541748 ms - Host latency: 0.541748 ms (end to end 0.541748 ms, enqueue 0.0214355 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.545264 ms - Host latency: 0.545264 ms (end to end 0.545264 ms, enqueue 0.0223633 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.554077 ms - Host latency: 0.554077 ms (end to end 0.554077 ms, enqueue 0.0218018 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.543066 ms - Host latency: 0.543066 ms (end to end 0.543066 ms, enqueue 0.022168 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541016 ms - Host latency: 0.541016 ms (end to end 0.541016 ms, enqueue 0.0213623 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541309 ms - Host latency: 0.541309 ms (end to end 0.541309 ms, enqueue 0.0212402 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541016 ms - Host latency: 0.541016 ms (end to end 0.541016 ms, enqueue 0.0213135 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541357 ms - Host latency: 0.541357 ms (end to end 0.541357 ms, enqueue 0.0213135 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541406 ms - Host latency: 0.541406 ms (end to end 0.541406 ms, enqueue 0.0212891 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540894 ms - Host latency: 0.540894 ms (end to end 0.540894 ms, enqueue 0.0226074 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540796 ms - Host latency: 0.540796 ms (end to end 0.540796 ms, enqueue 0.0232666 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540332 ms - Host latency: 0.540332 ms (end to end 0.540332 ms, enqueue 0.0217285 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.546924 ms - Host latency: 0.546924 ms (end to end 0.546924 ms, enqueue 0.0228271 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541333 ms - Host latency: 0.541333 ms (end to end 0.541333 ms, enqueue 0.025708 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.552734 ms - Host latency: 0.552734 ms (end to end 0.552734 ms, enqueue 0.0217041 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541162 ms - Host latency: 0.541162 ms (end to end 0.541162 ms, enqueue 0.0258789 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541211 ms - Host latency: 0.541211 ms (end to end 0.541211 ms, enqueue 0.0250244 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540601 ms - Host latency: 0.540601 ms (end to end 0.540601 ms, enqueue 0.0220947 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.554004 ms - Host latency: 0.554004 ms (end to end 0.554004 ms, enqueue 0.0243164 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541211 ms - Host latency: 0.541211 ms (end to end 0.541211 ms, enqueue 0.022168 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540405 ms - Host latency: 0.540405 ms (end to end 0.540405 ms, enqueue 0.0236084 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541284 ms - Host latency: 0.541284 ms (end to end 0.541284 ms, enqueue 0.0230957 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540796 ms - Host latency: 0.540796 ms (end to end 0.540796 ms, enqueue 0.0213379 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.54187 ms - Host latency: 0.54187 ms (end to end 0.54187 ms, enqueue 0.0249268 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.544873 ms - Host latency: 0.544873 ms (end to end 0.544873 ms, enqueue 0.0298584 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.552319 ms - Host latency: 0.552319 ms (end to end 0.552319 ms, enqueue 0.0248047 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.555151 ms - Host latency: 0.555151 ms (end to end 0.555151 ms, enqueue 0.0232666 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.552881 ms - Host latency: 0.552881 ms (end to end 0.552881 ms, enqueue 0.0231934 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541626 ms - Host latency: 0.541626 ms (end to end 0.541626 ms, enqueue 0.0230957 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.543652 ms - Host latency: 0.543652 ms (end to end 0.543652 ms, enqueue 0.0230713 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541577 ms - Host latency: 0.541577 ms (end to end 0.541577 ms, enqueue 0.0212402 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542383 ms - Host latency: 0.542383 ms (end to end 0.542383 ms, enqueue 0.0209717 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541821 ms - Host latency: 0.541821 ms (end to end 0.541821 ms, enqueue 0.0222168 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542188 ms - Host latency: 0.542188 ms (end to end 0.542188 ms, enqueue 0.0213867 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542651 ms - Host latency: 0.542651 ms (end to end 0.542651 ms, enqueue 0.021582 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541089 ms - Host latency: 0.541089 ms (end to end 0.541089 ms, enqueue 0.0213623 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541113 ms - Host latency: 0.541113 ms (end to end 0.541113 ms, enqueue 0.022876 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541309 ms - Host latency: 0.541309 ms (end to end 0.541309 ms, enqueue 0.0212646 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541113 ms - Host latency: 0.541113 ms (end to end 0.541113 ms, enqueue 0.024707 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.54104 ms - Host latency: 0.54104 ms (end to end 0.54104 ms, enqueue 0.0218506 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541211 ms - Host latency: 0.541211 ms (end to end 0.541211 ms, enqueue 0.0214111 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540771 ms - Host latency: 0.540771 ms (end to end 0.540771 ms, enqueue 0.0220215 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.551685 ms - Host latency: 0.551685 ms (end to end 0.551685 ms, enqueue 0.022876 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.54126 ms - Host latency: 0.54126 ms (end to end 0.54126 ms, enqueue 0.0209717 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.539624 ms - Host latency: 0.539624 ms (end to end 0.539624 ms, enqueue 0.0212402 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540503 ms - Host latency: 0.540503 ms (end to end 0.540503 ms, enqueue 0.0214111 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.552026 ms - Host latency: 0.552026 ms (end to end 0.552026 ms, enqueue 0.0210205 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541113 ms - Host latency: 0.541113 ms (end to end 0.541113 ms, enqueue 0.0213623 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.545508 ms - Host latency: 0.545508 ms (end to end 0.545508 ms, enqueue 0.0244629 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.543799 ms - Host latency: 0.543799 ms (end to end 0.543799 ms, enqueue 0.021582 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.547949 ms - Host latency: 0.547949 ms (end to end 0.547949 ms, enqueue 0.0223389 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.543848 ms - Host latency: 0.543848 ms (end to end 0.543848 ms, enqueue 0.0210449 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541528 ms - Host latency: 0.541528 ms (end to end 0.541528 ms, enqueue 0.0231934 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.539966 ms - Host latency: 0.539966 ms (end to end 0.539966 ms, enqueue 0.0226074 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.543042 ms - Host latency: 0.543042 ms (end to end 0.543042 ms, enqueue 0.021167 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.5427 ms - Host latency: 0.5427 ms (end to end 0.5427 ms, enqueue 0.0259277 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.548071 ms - Host latency: 0.548071 ms (end to end 0.548071 ms, enqueue 0.0206787 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540283 ms - Host latency: 0.540283 ms (end to end 0.540283 ms, enqueue 0.0210938 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541089 ms - Host latency: 0.541089 ms (end to end 0.541089 ms, enqueue 0.027002 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540869 ms - Host latency: 0.540869 ms (end to end 0.540869 ms, enqueue 0.0213379 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540625 ms - Host latency: 0.540625 ms (end to end 0.540625 ms, enqueue 0.0216797 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.542969 ms - Host latency: 0.542969 ms (end to end 0.542969 ms, enqueue 0.0249023 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541626 ms - Host latency: 0.541626 ms (end to end 0.541626 ms, enqueue 0.0214355 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.539819 ms - Host latency: 0.539819 ms (end to end 0.539819 ms, enqueue 0.0248291 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540308 ms - Host latency: 0.540308 ms (end to end 0.540308 ms, enqueue 0.0212402 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.545435 ms - Host latency: 0.545435 ms (end to end 0.545435 ms, enqueue 0.0218018 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540894 ms - Host latency: 0.540894 ms (end to end 0.540894 ms, enqueue 0.0211426 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.54165 ms - Host latency: 0.54165 ms (end to end 0.54165 ms, enqueue 0.0216064 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.598511 ms - Host latency: 0.598511 ms (end to end 0.598511 ms, enqueue 0.0220459 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.54043 ms - Host latency: 0.54043 ms (end to end 0.54043 ms, enqueue 0.021167 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540845 ms - Host latency: 0.540845 ms (end to end 0.540845 ms, enqueue 0.0209717 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.656909 ms - Host latency: 0.656909 ms (end to end 0.656909 ms, enqueue 0.0233154 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.543994 ms - Host latency: 0.543994 ms (end to end 0.543994 ms, enqueue 0.0241699 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.551514 ms - Host latency: 0.551514 ms (end to end 0.551514 ms, enqueue 0.0217529 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.543188 ms - Host latency: 0.543188 ms (end to end 0.543188 ms, enqueue 0.0213867 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.5427 ms - Host latency: 0.5427 ms (end to end 0.5427 ms, enqueue 0.0213379 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.553101 ms - Host latency: 0.553101 ms (end to end 0.553101 ms, enqueue 0.0211914 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541675 ms - Host latency: 0.541675 ms (end to end 0.541675 ms, enqueue 0.0211182 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.541333 ms - Host latency: 0.541333 ms (end to end 0.541333 ms, enqueue 0.0222656 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540918 ms - Host latency: 0.540918 ms (end to end 0.540918 ms, enqueue 0.0213135 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.548437 ms - Host latency: 0.548437 ms (end to end 0.548437 ms, enqueue 0.0219727 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.546875 ms - Host latency: 0.546875 ms (end to end 0.546875 ms, enqueue 0.0257324 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.548462 ms - Host latency: 0.548462 ms (end to end 0.548462 ms, enqueue 0.0224609 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.543457 ms - Host latency: 0.543457 ms (end to end 0.543457 ms, enqueue 0.0208984 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540845 ms - Host latency: 0.540845 ms (end to end 0.540845 ms, enqueue 0.0217041 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540454 ms - Host latency: 0.540454 ms (end to end 0.540454 ms, enqueue 0.0212402 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.54021 ms - Host latency: 0.54021 ms (end to end 0.54021 ms, enqueue 0.0232422 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540723 ms - Host latency: 0.540723 ms (end to end 0.540723 ms, enqueue 0.0216064 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.548584 ms - Host latency: 0.548584 ms (end to end 0.548584 ms, enqueue 0.0206055 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.551807 ms - Host latency: 0.551807 ms (end to end 0.551807 ms, enqueue 0.0211426 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.55625 ms - Host latency: 0.55625 ms (end to end 0.55625 ms, enqueue 0.0210205 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.544971 ms - Host latency: 0.544971 ms (end to end 0.544971 ms, enqueue 0.0210449 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.54104 ms - Host latency: 0.54104 ms (end to end 0.54104 ms, enqueue 0.0255127 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.543188 ms - Host latency: 0.543188 ms (end to end 0.543188 ms, enqueue 0.0212646 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.54126 ms - Host latency: 0.54126 ms (end to end 0.54126 ms, enqueue 0.0258301 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.540234 ms - Host latency: 0.540234 ms (end to end 0.540234 ms, enqueue 0.025415 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.549658 ms - Host latency: 0.549658 ms (end to end 0.549658 ms, enqueue 0.021167 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.549146 ms - Host latency: 0.549146 ms (end to end 0.549146 ms, enqueue 0.0223389 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.548804 ms - Host latency: 0.548804 ms (end to end 0.548804 ms, enqueue 0.0206055 ms) [10/12/2021-21:20:06] [I] Average on 10 runs - GPU latency: 0.549219 ms - Host latency: 0.549219 ms (end to end 0.549219 ms, enqueue 0.0206787 ms) [10/12/2021-21:20:06] [I] [10/12/2021-21:20:06] [I] === Performance summary === [10/12/2021-21:20:06] [I] Throughput: 1565.06 qps [10/12/2021-21:20:06] [I] Latency: min = 0.531616 ms, max = 1.51245 ms, mean = 0.550353 ms, median = 0.541504 ms, percentile(99%) = 0.631104 ms [10/12/2021-21:20:06] [I] End-to-End Host Latency: min = 0.531616 ms, max = 1.51245 ms, mean = 0.550353 ms, median = 0.541504 ms, percentile(99%) = 0.631104 ms [10/12/2021-21:20:06] [I] Enqueue Time: min = 0.0200195 ms, max = 0.153442 ms, mean = 0.022665 ms, median = 0.0212402 ms, percentile(99%) = 0.0544434 ms [10/12/2021-21:20:06] [I] H2D Latency: min = 0 ms, max = 0 ms, mean = 0 ms, median = 0 ms, percentile(99%) = 0 ms [10/12/2021-21:20:06] [I] GPU Compute Time: min = 0.531616 ms, max = 1.51245 ms, mean = 0.550353 ms, median = 0.541504 ms, percentile(99%) = 0.631104 ms [10/12/2021-21:20:06] [I] D2H Latency: min = 0 ms, max = 0 ms, mean = 0 ms, median = 0 ms, percentile(99%) = 0 ms [10/12/2021-21:20:06] [I] Total Host Walltime: 3.00116 s [10/12/2021-21:20:06] [I] Total GPU Compute Time: 2.58501 s [10/12/2021-21:20:06] [I] Explanations of the performance metrics are printed in the verbose logs. [10/12/2021-21:20:06] [V] [10/12/2021-21:20:06] [V] === Explanations of the performance metrics === [10/12/2021-21:20:06] [V] Total Host Walltime: the host walltime from when the first query (after warmups) is enqueued to when the last query is completed. [10/12/2021-21:20:06] [V] GPU Compute Time: the GPU latency to execute the kernels for a query. [10/12/2021-21:20:06] [V] Total GPU Compute Time: the summation of the GPU Compute Time of all the queries. If this is significantly shorter than Total Host Walltime, the GPU may be under-utilized because of host-side overheads or data transfers. [10/12/2021-21:20:06] [V] Throughput: the observed throughput computed by dividing the number of queries by the Total Host Walltime. If this is significantly lower than the reciprocal of GPU Compute Time, the GPU may be under-utilized because of host-side overheads or data transfers. [10/12/2021-21:20:06] [V] Enqueue Time: the host latency to enqueue a query. If this is longer than GPU Compute Time, the GPU may be under-utilized. [10/12/2021-21:20:06] [V] H2D Latency: the latency for host-to-device data transfers for input tensors of a single query. [10/12/2021-21:20:06] [V] D2H Latency: the latency for device-to-host data transfers for output tensors of a single query. [10/12/2021-21:20:06] [V] Latency: the summation of H2D Latency, GPU Compute Time, and D2H Latency. This is the latency to infer a single query. [10/12/2021-21:20:06] [V] End-to-End Host Latency: the duration from when the H2D of a query is called to when the D2H of the same query is completed, which includes the latency to wait for the completion of the previous query. This is the latency of a query if multiple queries are enqueued consecutively. [10/12/2021-21:20:06] [I] &&&& PASSED TensorRT.trtexec [TensorRT v8003] # C:\Program Files\NVIDIA GPU Computing Toolkit\TensorRT-8.0.3.4\bin\trtexec.exe --onnx=resnet_gap_surgery.onnx --useCudaGraph --threads --noDataTransfers --verbose --best [10/12/2021-21:20:06] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +0, now: CPU 9444, GPU 1121 (MiB)